Sean Templeton
05c3f4808c
Move encrypting, hashing, and creating index volumes out of BackendUploader
...
Encrypting, hashing, and creating index volumes are now done
in the DataBlockProcessor and the SpillCollectorProcess. This allows
uploads to always be transferring data and not have to stop to create
a file, encrypt data, etc.
2019-03-03 21:41:09 -06:00
Kenneth Skovhede
729baf76e6
Fixed registering the newly created index volume after upload has completed
2018-06-13 21:43:06 +02:00
Kenneth Skovhede
c50721e0c4
Added input validation to the IndexVolumeCreator to make sure it does not create invalid temporary lists
2018-05-09 17:37:30 +02:00
Kenneth Skovhede
3081447271
Added an on-the-fly index builder to avoid querying the database for each volume
2018-04-30 14:04:30 +02:00
Kenneth Skovhede
683b04741d
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Operation/BackupHandler.cs
Manually fixed the HashAlgorithmHelper case
2017-09-20 13:56:37 +02:00
Kenneth Skovhede
537fe20838
Added a lot of comments.
...
Fixed a few issues that caused parallel uploads.
Fixed the use of the encryption module so the encryption module is not re-used for multiple jobs.
2016-02-25 19:15:51 +01:00
Kenneth Skovhede
5bd03adc96
Added consistency check when building the index file
2016-02-23 20:58:23 +01:00
Kenneth Skovhede
37d04b7b19
More work on making the backup process use the concurrent constructs
2016-02-22 22:40:27 +01:00
Kenneth Skovhede
3ff2f1eb98
The concurrent processing now seems to work, at least in the base case.
...
Rewrote the handling of index volumes to create them on-demand instead of in-advance.
This makes it much simpler to handle upload failures.
2016-02-22 21:27:12 +01:00
Sean Templeton