Commit Graph
4937 Commits
Author SHA1 Message Date
Carl Johnsen 3d8330bc58 Cleaned up BlockManager 2024-12-02 15:44:01 +01:00
Carl Johnsen e7b2338214 Renamed VolumeCache to VolumeManager for consistency 2024-12-02 15:43:52 +01:00
Carl Johnsen 1bbe26330f Bump CoCoL package version to 1.8.1 2024-12-02 15:18:09 +01:00
Carl Johnsen 7aa19f851e Add configurable volume downloaders for restore process 2024-12-02 15:16:21 +01:00
Carl Johnsen 533088684b Consistent naming of decryptors 2024-12-02 15:12:50 +01:00
Carl Johnsen b6ed72bd6c Reworked the restore CSP network 2024-12-02 15:09:23 +01:00
Carl Johnsen 3156d43adc BlockVolumeReaders are expensive to create - cache them instead. 2024-12-02 10:55:45 +01:00
Carl Johnsen f85ffabe3e Linux SQLite doesn't want values in quotes 2024-12-02 10:45:52 +01:00
Kenneth Skovhede 2b5bb6a4ec Logging unobserved task exceptions 2024-11-29 08:42:43 +01:00
Carl Johnsen cdf0c28fd8 Added internal profiling as an option. Currently only implemented in the restore process. 2024-11-29 05:49:03 +01:00
Carl Johnsen 87747b5580 The metadata SQL query is now prepared in the fileprocessor 2024-11-29 05:46:17 +01:00
Carl Johnsen 079598c2e8 Added database function for getting files alongside symlinks to restore 2024-11-29 03:41:41 +01:00
Carl Johnsen 6aa202fbea Already present files were incorrectly truncated 2024-11-29 03:38:53 +01:00
Kenneth Skovhede 942e0ecee2 Removed a stray debug log message 2024-11-28 12:25:18 +01:00
Carl Johnsen deb98e3322 CreateDirectoryStructure wouldn't always create the target folders, if the file database doesn't list the folder. Empty files should create the directory, if it doesn't exist. 2024-11-28 10:43:51 +01:00
Carl Johnsen 9bcda7d6cf Symlinks are now handled correctly 2024-11-28 09:22:09 +01:00
Marcelo C. 2eab4611de Fix for the streaming error on BackendTester interaction
This issue does not affect the pCloud backend per se and its functioning as expected.

The issue is related to a symptom the BackendTester revealed as discussed here:

https://github.com/duplicati/duplicati/pull/5709

It turns out the backends should assume the caller has set the input stream at the correct position and take it from there.

Therefore the fix is simply to remove the .Position = 0; which was well intended as a way to make sure the stream was at the beginning, but  thats not the pattern to follow when integrating backends.

A future blog post/tutorial on new backend integrations will mention these premises.
2024-11-27 19:34:18 +01:00
Carl Johnsen 1ecb6e7c35 Fixed the metadata block query so that it finds the correct blocks 2024-11-27 11:28:27 +01:00
Carl Johnsen 4128ea3ff3 Empty files can also not have a data block associated 2024-11-27 11:27:55 +01:00
Carl Johnsen 7aa9db533e Added preliminary metadata restoration 2024-11-26 20:01:19 +01:00
Kenneth Skovhede ea2ba06ff6 Suppress HyperV warning option
This adds a new option to suppress the normal warning that is issues on client-version of Windows.

This fixes #5692
2024-11-25 21:25:02 +01:00
Carl Johnsen 164b2a212c Already restored blocks are now tracked according to the cache tracking strategy as well 2024-11-25 17:32:56 +01:00
Carl Johnsen 952aebf685 VolumeDownloader handles when an eviction requests relates to a volume that is not in cache 2024-11-25 17:32:00 +01:00
Kenneth Skovhede 42c4e50482 Fixed issues with update detection.
This fixes a case where the update checker keeps an old reference to the previous updated version, despite running a newer version.

It also removes some use of `Assembly.GetExecutingAssembly().GetName().Version` with the information from `UpdaterManager.SelfVersion.Version` as that should follow the update info.

This fixes #5698
This fixes #5252
2024-11-25 17:27:50 +01:00
Carl Johnsen baaa17a738 Make cache_max and eviction_ratio fields readonly 2024-11-25 17:23:42 +01:00
Carl Johnsen 823b896da1 Removed redundant TODOs 2024-11-25 15:23:59 +01:00
Carl Johnsen c26c54c5f7 Fixed naming inconsistencies in the new restore options 2024-11-25 15:17:10 +01:00
Kenneth SkovhedeandGitHub 52ea353dc5 Merge pull request #5699 from duplicati/feature/fix-crash-log
Made the wrapper async+no-async so it does not loose the caller context.
2024-11-25 15:16:49 +01:00
Carl Johnsen 7c79535572 VolumeDownloader now deletes temporary volumes from both cache and disk when they are no longer needed during restore. 2024-11-25 15:16:03 +01:00
Kenneth Skovhede 992a0fd90c Made the wrapper async+no-async so it does not loose the caller context. 2024-11-25 15:09:23 +01:00
Kenneth Skovhede 0a5baa127c Merge remote-tracking branch 'origin/master' into feature/fix-dst-changing-scheduled-time 2024-11-25 13:05:28 +01:00
Kenneth SkovhedeandGitHub 79d6dc0cad Merge branch 'master' into feature/backends-add-pcloud 2024-11-25 11:08:55 +01:00
Marcelo C. 068ae42aa1 Implementation of changes requested in review 2024-11-25 11:01:59 +01:00
Carl Johnsen 7ee174b6f8 Execute the blockcount check and decrement in a single SQL statement 2024-11-25 09:33:32 +01:00
Carl Johnsen 27c4f93af2 The FileProcessor bursts as much as possible by default 2024-11-25 08:53:27 +01:00
Carl Johnsen ebac24ce04 Rather than specifying multiple guids for a restore, use the one that the restore database has. 2024-11-25 08:52:51 +01:00
Carl Johnsen 5625c4c1ce Add configurable options for scaling the number of restore file processors, decryptors, and decompressors 2024-11-22 16:53:16 +01:00
Carl Johnsen fe6f91dc9a Add option for using legacy restore method 2024-11-22 16:40:54 +01:00
Carl Johnsen 5436b2f9f5 Add eviction ratio option for restore cache management 2024-11-22 16:32:53 +01:00
Carl Johnsen de24a9f15a Added the option to control the size of the data block cache during restore 2024-11-22 16:24:27 +01:00
Carl Johnsen 0cd9374bed Added comments and docstrings 2024-11-22 15:26:04 +01:00
Kenneth SkovhedeandGitHub a2c08cc84e Merge pull request #5686 from duplicati/feature/cleanup-ftp-error-handling
Refactoring the FTP backend
2024-11-22 13:01:51 +01:00
Carl Johnsen 890fa2ce52 Add copyright notices 2024-11-22 11:47:07 +01:00
Carl Johnsen 43a392f139 The tempfiletable name is also required externally from the database. 2024-11-22 11:26:25 +01:00
Carl Johnsen 7094786e23 Removed unnessecarily complex nested ternary statements. 2024-11-22 11:26:01 +01:00
Carl Johnsen c798910658 If the target file already exists and is verified, do nothing more 2024-11-22 11:25:35 +01:00
Carl Johnsen 393cfcf5b2 Broken files tracker wasn't initialized 2024-11-22 11:24:55 +01:00
Carl Johnsen c79793dbe2 Using the field result rather than passing it as an argument 2024-11-22 11:09:47 +01:00
Carl Johnsen 1fc3212144 Added logging of the local and remote files thay may fail during restoration 2024-11-22 11:09:17 +01:00
Carl Johnsen 8a1bf22e27 Shutting down and cleaning up the block directory could be done in an incorrect order where some task was trying to access the removed table.
Disposing has now been moved to after all of the accessors have finished.
2024-11-22 07:05:20 +01:00