Kenneth Skovhede
d500097e05
Added additional consistency checks to local database
2025-03-10 14:41:36 +01:00
Kenneth Skovhede
55fc5d2e6c
Added support for recreating filesets and remote lists in some scenarios
2025-03-10 14:41:12 +01:00
Kenneth Skovhede
be16323f24
General cleanup, common database validation exception
2025-03-10 14:38:45 +01:00
Kenneth Skovhede
32762bec34
Fixed comment and added warning message
2025-03-10 10:59:53 +01:00
Kenneth Skovhede
9a82beaf8b
Fixed log messages to correspond to actual operation performed
2025-03-10 10:55:07 +01:00
Kenneth Skovhede
12cabf8da7
Merge branch 'feature/improved-failure-resilience' of github.com:duplicati/duplicati into feature/improved-failure-resilience
2025-03-08 15:28:24 +01:00
Kenneth Skovhede
1de0a92413
Strategy is now to disallow compact/delete/purge if the remote state contains partial data.
...
Backup will auto-repair, and user otherwise need to call "repair" to recover the state, before invoking compact/delete/purge.
This is done to prevent cases where the remote state contiains partial data and the automatic cleanup process would remove remote files.
2025-03-08 15:28:02 +01:00
Kenneth Skovhede
5f8ff74bd5
Streamlined handling of previous backup's fileset and dlist file if it failed to upload.
2025-03-08 15:25:55 +01:00
Kenneth Skovhede
fce09596f3
Removed unused parameter and redundant namespace prefixes
2025-03-08 15:18:19 +01:00
Kenneth Skovhede
9952e31f49
Fixed a bug where retention time was incorrectly parsed when reading from the database.
...
This effectively caused the retention time to be ignored when reading from the database.
Also moved some code related to finding an unfinished fileset into the common database class.
2025-03-08 15:13:03 +01:00
Kenneth Skovhede
f6f0cf8b96
More docs
2025-03-07 15:45:51 +01:00
Kenneth Skovhede
c3762a57ca
Added docs
2025-03-07 15:23:06 +01:00
Kenneth Skovhede
58da574130
Moved shutdown logic into separate method so it can be called for both uploads and downloads
2025-03-07 15:19:40 +01:00
Kenneth Skovhede
ca236f03e3
Renamed flag to more precisely describe the purpose
2025-03-06 14:56:35 +01:00
Kenneth Skovhede
7beeb27ade
Extended tests and fixed a case where a left-over upload could cause errors.
2025-03-06 14:53:46 +01:00
Kenneth Skovhede
4e60a7ad49
Merge remote-tracking branch 'origin/master' into feature/improved-failure-resilience
2025-03-06 12:09:42 +01:00
Kenneth Skovhede
1321488527
Improve failure detection
...
This commit adds extra logic to prevent cases where the backup reports success but leaves behind partial files.
A new flag is recorded to track if partial files are possible. If no partial files are possible, the verification will fail if any are found.
2025-03-06 12:02:11 +01:00
Kenneth Skovhede and GitHub
6647c143d5
Merge pull request #5994 from duplicati/feature/log-number-of-remote-filesets
...
Log remote filesets
2025-03-05 16:53:02 +01:00
Kenneth Skovhede
4f62a8a413
Fixed off-by-one for retry count
2025-03-05 09:04:46 +01:00
Kenneth Skovhede
1f7415cc8e
Simplified backend manager handler code
2025-03-04 15:42:31 +01:00
Carl-Johannes Johnsen and GitHub
476774640a
Merge pull request #5991 from carljohnsen/performance/restoreopt2
2025-02-28 13:03:25 +01:00
Kenneth Skovhede
c61cc778a8
Log remote filesets
...
This commit adds the number of known remote filesets to the log output.
2025-02-28 11:18:23 +01:00
Carl Johnsen
6e08affd1a
Rather than having the tempfile database create new ID's for each entry, reuse the File.ID so the connections that do not have access to the temp table can access the same data.
2025-02-28 10:27:02 +01:00
Carl Johnsen
dbe413d889
Fixed the restore BlockManager block counting logic
2025-02-28 10:26:07 +01:00
Carl Johnsen
97df02c57c
Fixed missing docstrings
2025-02-27 14:48:08 +01:00
Carl Johnsen
b9eaa224b8
Renamed variables in VolumeDecompressor
2025-02-27 14:46:04 +01:00
Carl Johnsen
6ef151f4af
Cleaned up FileProcessor
2025-02-27 14:45:05 +01:00
Carl Johnsen
a539af58ca
Removed unused code from FileLister
2025-02-27 14:44:54 +01:00
Carl Johnsen
2ebb021174
Cleaned up BlockManager
2025-02-27 14:40:29 +01:00
Carl Johnsen
2fae2d510e
Removed old block counters from BlockManager
2025-02-27 14:16:06 +01:00
Carl Johnsen
a0eae4131b
Cleaned up LocalRestoreDatabase
2025-02-27 14:14:07 +01:00
Carl Johnsen
260786a91a
Merge branch 'feature/restore-buffer-size-option' into performance/restoreopt2
2025-02-27 14:03:01 +01:00
Carl Johnsen
038e78ad06
The block cache is now always present, as it keeps track of blocks. In case of a cache size 0, every Set() will trigger an evict.
2025-02-27 11:17:11 +01:00
Carl Johnsen
bdfdc7e92a
MemoryCache evict now correctly handles the ArrayPool
2025-02-27 10:54:47 +01:00
Kenneth Skovhede
11a27042bc
Merge remote-tracking branch 'origin/master' into feature/alternate-source-provider
2025-02-26 19:25:46 +01:00
Carl Johnsen
7109155127
Additional block count reporting of the block manager
2025-02-26 16:11:13 +01:00
Carl Johnsen
0e6e1bcbd8
Currently, the block cache cannot compact while using the arraypool, as this doesn't properly return the buffers to the pool
2025-02-26 16:10:51 +01:00
Carl Johnsen
6873162002
Additional internal profiling resolution
2025-02-26 16:09:23 +01:00
Carl Johnsen
692954ee97
Made the local restore database use a connection pool for getting block data
2025-02-26 16:08:55 +01:00
Kenneth Skovhede
f77e529eb6
Merge commit '2339aeff28adba15442d0be60c56568ae642ad0b' into feature/make-backends-async
2025-02-26 15:23:48 +01:00
Carl Johnsen
a49c66bcb5
Added caching of localrestoredatabase data
2025-02-25 17:42:30 +01:00
Carl Johnsen
6d7faf97bb
Whitespace
2025-02-25 17:41:57 +01:00
Carl Johnsen
42ec5b633c
Restore block cache max option didn't match the description
2025-02-25 17:41:35 +01:00
Carl Johnsen
bf3a26ffcd
Added more internal profiling timers to the FileProcessor to get more high-resolution profiling
2025-02-25 16:49:46 +01:00
Carl Johnsen
e773907eed
Changed from allocating a new byte[] buffer in the decompressor to use the Buffers.ArrayPool
2025-02-25 16:45:55 +01:00
Carl Johnsen
d7b8d13bc0
VolumeDecryptor and VolumeManager were unnecessarily sending around and keeping track of disposed encrypted volumes
2025-02-25 16:39:28 +01:00
Carl Johnsen
5c7a933722
FileLister did not report its internal profling properly
2025-02-25 16:37:49 +01:00
Carl Johnsen
b62a1f7600
Added missing comments in filelister
2025-02-25 16:36:30 +01:00
Carl Johnsen
b86794791b
Reallocating byte[] buffer takes up too long time if done for each file
2025-02-25 16:35:46 +01:00
Carl Johnsen
c5ebf4fa71
Added the restore channel depth option
2025-02-25 16:19:04 +01:00
Kenneth Skovhede