Commit Graph
10088 Commits
Author SHA1 Message Date
Carl Johnsen effd50985f The real deadlock on process network initialization was found: the volume downloader did not write asynchronously, which would result it waiting on writing to a process that would never be created. 2024-11-15 12:57:55 +01:00
Carl Johnsen 62e96935ad Added TODOs for future fixes 2024-11-15 08:57:57 +01:00
Carl Johnsen a2ca7239b6 Split up statement to allow for easier debugging. 2024-11-15 08:56:58 +01:00
Carl Johnsen b30f19929b Rather than creating a buffer and then resize to a specific size, just create it with the target size 2024-11-15 08:56:15 +01:00
Carl Johnsen 0e2be45418 Changed the shutdown strategy of BlockManager as it could lead to a deadlock since the channels weren't retired properly. 2024-11-15 08:55:13 +01:00
Carl Johnsen d65937bab7 Restructuring process network generation to allow for easier debugging. 2024-11-15 08:53:54 +01:00
Carl Johnsen dc73380fe8 To minimize database requests (or at least where they emerge), query the database once per block per file, once per newly downloaded volume, and once to build the file list. The results are then "shipped" around the network along with the previous messages. 2024-11-13 16:55:47 +01:00
Carl Johnsen 66df6afc34 Changed the downloader to move the download waiting to the decrypter 2024-11-13 14:31:37 +01:00
Carl Johnsen d0639ee0ae Fixed bug that would leave the restore database in a locked state 2024-11-13 14:30:35 +01:00
Carl Johnsen 569e927e13 Added an explicit wait for backend to complete after running the restore 2024-11-13 14:27:46 +01:00
Carl Johnsen c5eaf409c9 Added preliminary scaling parameters 2024-11-13 14:27:19 +01:00
Carl Johnsen 284755c6b1 Rather than uncompressing everything, only decompress the requested block. 2024-11-12 13:47:25 +01:00
Carl Johnsen 09e04e76d0 Now the restore chain also forwards the block id 2024-11-12 13:45:32 +01:00
Carl Johnsen b686cd4934 Changed from ConcurrentDictionary to MemoryCache, to utilize their cache eviction logic. 2024-11-11 13:02:24 +01:00
Carl Johnsen 48302bf395 Fixed bug where the block lists may not be aligned when decompressing. 2024-11-11 13:01:00 +01:00
Carl Johnsen afa2e9bf07 Added more progress keeping and running the original verification step. 2024-11-08 16:05:57 +01:00
Carl Johnsen 6f354e6d08 Added some progress tracking and removed some debug printing 2024-11-08 15:24:56 +01:00
Carl Johnsen 459664d33b Added restore channel buffer sizes as a variable 2024-11-08 14:38:24 +01:00
Carl Johnsen ec738f4063 Added handling of retired exception to close down the process network 2024-11-08 14:35:44 +01:00
Carl Johnsen 78aa077c2b Handled empty files, where the block volume ID is -1 2024-11-08 13:26:29 +01:00
Carl Johnsen 4d7c8e2455 Volumes in flight should be a concurrent collection, as it's accessed through multiple Tasks 2024-11-08 13:01:05 +01:00
Carl Johnsen 997472127a FileProcessor now writes to disk - the initial circle is complete! 2024-11-08 10:43:19 +01:00
Carl Johnsen f6839160f2 Channels now send the volume / block id around alongside the volume / block 2024-11-08 10:42:54 +01:00
Carl Johnsen 153ef7ed6c Added decompressor initial process 2024-11-08 10:42:11 +01:00
Carl Johnsen d4a073cc8d Fixed typo 2024-11-08 10:06:00 +01:00
Carl Johnsen cb5b973883 Added a TODO in BlockManager 2024-11-08 09:59:39 +01:00
Carl Johnsen bd52be6f6b Added dummy decrypter process 2024-11-08 09:55:17 +01:00
Carl Johnsen 5955cbc036 Modified the VolumeDownloader so that it works 2024-11-08 09:13:54 +01:00
Carl Johnsen 2ecb25483e Moved backend initialization to the outside of the restore process network 2024-11-08 09:13:26 +01:00
Carl Johnsen 50aa530883 db wasn't properly set in the BlockManager's internal cache 2024-11-08 08:45:20 +01:00
Carl Johnsen a6f6cb7f39 CoCoL did not like the array of ChannerMarkers 2024-11-08 08:45:00 +01:00
Carl Johnsen 82669da2d2 Channel arrays weren't instantiated correctly 2024-11-08 08:02:36 +01:00
Carl Johnsen b41b43f430 Now the volume ID is found alongside the block ID 2024-11-08 08:02:17 +01:00
Carl Johnsen adf9d4acf4 Added the draft block manager 2024-11-08 07:20:18 +01:00
Carl Johnsen 50c6fb434c Got the list of block IDs per file 2024-11-08 05:56:48 +01:00
Carl Johnsen bc9c7beb97 Using simplified collection creation expression 2024-11-08 03:56:39 +01:00
Carl Johnsen 60fa5fe031 Started the draft FileProcessor process 2024-11-08 03:55:46 +01:00
Carl Johnsen 494c1d9f3e Moved local restore database creation outside of the filelister - the other processes might need this as well. 2024-11-08 03:55:15 +01:00
Carl Johnsen 027d777fe0 First draft of the Restore.FileLister process 2024-11-08 03:31:30 +01:00
Carl Johnsen 69fd383c71 Started the rework of RestoreHandler's Run() 2024-11-08 03:31:04 +01:00
Carl Johnsen b5745a3be0 Added initial volume downloader process 2024-11-07 10:04:52 +01:00
Kenneth SkovhedeandGitHub b0a34387f6 Merge pull request #5598 from duplicati/feature/add-secret-provider
Feature/add secret provider
v2.0.9.109_canary_2024-11-06
2024-11-06 11:50:58 +01:00
Kenneth SkovhedeandGitHub 1319fbf2ab Merge pull request #5640 from duplicati/feature/auto-connect-on-register-remote
Auto connect on register remote
2024-11-06 08:24:38 +01:00
Kenneth Skovhede bf02a9d99c Hide secret providers that are not supported on the platform 2024-11-05 22:50:55 +01:00
Kenneth Skovhede d8ed4ebd8b Fixed using the interface instead of impl 2024-11-05 22:34:34 +01:00
Kenneth Skovhede c45aa55eb1 Fixed copy-paste duplicate ids 2024-11-05 22:29:16 +01:00
Kenneth Skovhede aed53525de Connect automatically after register 2024-11-05 22:29:04 +01:00
Kenneth SkovhedeandGitHub 667a5132f5 Merge pull request #5639 from duplicati/feature/disable-telegram-until-fixed
Disabled the Telegram notification destination as it is not currently working
2024-11-05 22:26:45 +01:00
Kenneth Skovhede bc7137d140 Disabled the Telegram notification destination as it is not currently working 2024-11-05 22:26:17 +01:00
Kenneth Skovhede 68fa9afa23 Fixed tests and fixed a missing encode 2024-11-05 12:44:00 +01:00