Commit Graph
4937 Commits
Author SHA1 Message Date
Carl Johnsen 8c4f5cebf0 The size of the channels are being used by the FileProcessor so that it knows how much it can burst requests. 2024-11-21 20:57:01 +01:00
Carl Johnsen b18504864f Changed to simple using statement on metadatastorage 2024-11-21 20:56:12 +01:00
Carl Johnsen 7717f32e77 Added tracking of errors on remote files during restoration 2024-11-21 20:55:20 +01:00
Kenneth Skovhede 7e479788d7 Added the missing crashlog feature.
The crashlog feature was lost during the removal of the auto-updater.
This commit adds it back, in a slightly different way.
2024-11-21 20:23:42 +01:00
Carl Johnsen cacc5d18a0 Added tracking of errors of local files during restoration 2024-11-21 15:14:29 +01:00
Kenneth Skovhede c915b70697 Added support for ftp/aftp treating url paths as before the update 2024-11-21 14:37:25 +01:00
Kenneth Skovhede 9dadd514bf Inverted the flag for relative paths, as that is more compatible with the previous library. 2024-11-21 13:13:44 +01:00
Carl Johnsen 916d35e928 Added logic for utilizing the original data when restoring, if it matches the hashes in the database. 2024-11-21 10:39:48 +01:00
Carl Johnsen 1cbed23603 Ordering by file size ensures that we start with the files that'll take the longest 2024-11-21 10:38:47 +01:00
Carl Johnsen b9a4b8c934 Moved local file verification to its own function 2024-11-21 07:19:13 +01:00
Carl Johnsen d109bf5db1 The FileProcessor now verifies whether the target file has already been restored. 2024-11-20 16:33:33 +01:00
Kenneth Skovhede 6c3735fc56 Fixed the no-response timeout to follow the heartbeat interval. 2024-11-19 22:20:46 +01:00
Kenneth Skovhede 5712264e6a Updated some parsing to be simpler.
Changed the strategy to use absolute paths for all operations, to avoid cases where a silent reconnect would end up in a different folder.
Add backwards compatible option to use CWD style relative operations.
Added support for detecting the SSL certificate hash when there is a certificate error.
2024-11-19 13:55:23 +01:00
Carl Johnsen 9955647768 Changed the bursting strategy of the FileProcessor to fill up the pipeline, and then issue a new request after every response 2024-11-19 11:34:10 +01:00
Carl Johnsen 0d7b9403c9 The SleepableDictionary now keeps track of which blocks to restore, so that it only caches the blocks that needs to be cached. 2024-11-19 10:35:57 +01:00
Carl Johnsen 09132cd509 Changed the VolumeDownloader to use prepared statements 2024-11-19 10:34:13 +01:00
Carl Johnsen 4d368f5a17 Changed the FileProcessor to use prepared statements 2024-11-19 10:33:50 +01:00
Carl Johnsen 878780dfe4 Added Database.ExecuteReaderEnumerable for prepared statements 2024-11-19 10:32:54 +01:00
Kenneth Skovhede 2828729a59 Changed logic for how error messages are constructed 2024-11-19 06:52:17 +01:00
Marcelo Ceccon 4beafc0cc7 Added pCloud Integration
Added pCloud backend with custom interface for editing destination.
2024-11-18 13:07:01 +01:00
Carl Johnsen c1751879b2 Started restructuring to return to the original structure and filelister shouldn't be doing the prepatory database work. 2024-11-15 20:32:46 +01:00
Carl Johnsen 75bda5f6c7 Added dryrun logic and logging to the restore processes 2024-11-15 19:02:30 +01:00
Carl Johnsen d47d775a34 Added logging and error handling to BlockManager 2024-11-15 15:00:27 +01:00
Carl Johnsen 5eb6f63c6b Added logging and error handling to FileLister 2024-11-15 14:57:36 +01:00
Kenneth SkovhedeandGitHub b978a9e275 Merge pull request #5679 from duplicati/feature/add-downloads-to-special-folders
Added support for the Downloads folder
2024-11-15 14:51:15 +01:00
Carl Johnsen 339e06ce9c Added logging and error handling to FileProcessor 2024-11-15 14:50:52 +01:00
Kenneth SkovhedeandGitHub f6b0c40880 Merge pull request #5673 from duplicati/feature/tune-log-level
No need for the GPG path to be information
2024-11-15 14:50:44 +01:00
Kenneth SkovhedeandGitHub bec59ebcfc Merge pull request #5682 from duplicati/feature/improve-windows-startup-time
Fixed startup delay on Windows.
2024-11-15 14:47:23 +01:00
Carl Johnsen 0cee612255 Added logging and error handling to VolumeDecrypter 2024-11-15 14:22:58 +01:00
Carl Johnsen f228cc0791 Added logging and error handling to VolumeDownloader 2024-11-15 14:21:41 +01:00
Kenneth Skovhede 2c75de2030 Removed a leftover reference 2024-11-15 14:19:41 +01:00
Kenneth Skovhede 88ae1d18b1 Fixed output from S3 options to mimic previous version 2024-11-15 14:18:39 +01:00
Carl Johnsen 4f1869557d Added logging to VolumeDecompressor 2024-11-15 14:18:24 +01:00
Kenneth Skovhede 38a255eb00 Fixed startup delay on Windows.
Delay was caused by AWS library performing network queries when reading properties on the configuration object.
On top of this, the properties were read twice.
Unified reading+application of options between iDrive and AWS S3.
2024-11-15 14:04:42 +01:00
Kenneth Skovhede 1e85667914 Revert "Fixed startup delay on Windows."
This reverts commit d637dc8957.
2024-11-15 14:03:23 +01:00
Kenneth Skovhede d637dc8957 Fixed startup delay on Windows.
Delay was caused by AWS library performing network queries when reading properties on the configuration object.
On top of this, the properties were read twice.
Unified reading+application of options between iDrive and AWS S3.
2024-11-15 14:02:39 +01:00
Carl Johnsen b7aa1a3856 Added on-the-fly file hash verification 2024-11-15 13:50:45 +01:00
Carl Johnsen 9a8e3ab90c Added on-the-fly block hash verification 2024-11-15 13:50:13 +01:00
Carl Johnsen 5fcdaf334a FileProcessor now bursts their block requests 2024-11-15 13:40:21 +01:00
Carl Johnsen effd50985f The real deadlock on process network initialization was found: the volume downloader did not write asynchronously, which would result it waiting on writing to a process that would never be created. 2024-11-15 12:57:55 +01:00
Carl Johnsen 62e96935ad Added TODOs for future fixes 2024-11-15 08:57:57 +01:00
Carl Johnsen a2ca7239b6 Split up statement to allow for easier debugging. 2024-11-15 08:56:58 +01:00
Carl Johnsen b30f19929b Rather than creating a buffer and then resize to a specific size, just create it with the target size 2024-11-15 08:56:15 +01:00
Carl Johnsen 0e2be45418 Changed the shutdown strategy of BlockManager as it could lead to a deadlock since the channels weren't retired properly. 2024-11-15 08:55:13 +01:00
Carl Johnsen d65937bab7 Restructuring process network generation to allow for easier debugging. 2024-11-15 08:53:54 +01:00
Kenneth Skovhede 8ce96c5bb2 Added support for the Downloads folder 2024-11-14 22:50:07 +01:00
Kenneth Skovhede a3d46c3951 No need for the GPG path to be information 2024-11-14 15:28:07 +01:00
Kenneth Skovhede 6d72ff2c2f Increased heartbeat period and reduced log-spam on the information level. 2024-11-14 11:41:18 +01:00
Kenneth SkovhedeandGitHub c0e1bdd2c1 Merge pull request #5666 from duplicati/feature/report-package-type-id
Added package type ids when sending usage reports to track individual…
2024-11-14 11:12:24 +01:00
Carl Johnsen dc73380fe8 To minimize database requests (or at least where they emerge), query the database once per block per file, once per newly downloaded volume, and once to build the file list. The results are then "shipped" around the network along with the previous messages. 2024-11-13 16:55:47 +01:00