Sean Templeton
8bd4b825c8
Fix several Codacy issues
2019-03-13 21:51:05 -05:00
Sean Templeton
05c3f4808c
Move encrypting, hashing, and creating index volumes out of BackendUploader
...
Encrypting, hashing, and creating index volumes are now done
in the DataBlockProcessor and the SpillCollectorProcess. This allows
uploads to always be transferring data and not have to stop to create
a file, encrypt data, etc.
2019-03-03 21:41:09 -06:00
Kenneth Hsu
b5d9451b33
Remove redundant casts.
2019-01-21 19:30:52 -08:00
Kenneth Skovhede
c50721e0c4
Added input validation to the IndexVolumeCreator to make sure it does not create invalid temporary lists
2018-05-09 17:37:30 +02:00
Kenneth Skovhede
3081447271
Added an on-the-fly index builder to avoid querying the database for each volume
2018-04-30 14:04:30 +02:00
Kenneth Skovhede
860924bb62
Updated main functions to new CoCoL library
2017-09-20 21:03:24 +02:00
Kenneth Skovhede
a3f2b39d23
Implemented handling of pause/stop/abort in the concurrent code.
...
Implemented the dry-run feature for backups.
2016-02-29 21:52:11 +01:00
Kenneth Skovhede
537fe20838
Added a lot of comments.
...
Fixed a few issues that caused parallel uploads.
Fixed the use of the encryption module so the encryption module is not re-used for multiple jobs.
2016-02-25 19:15:51 +01:00
Kenneth Skovhede
20f7b42945
Fixed channels to use type-safe initializations.
...
Updated logging channel to use a wrapper for later early-filter optimizations.
Various bug fixes and optimizations.
2016-02-24 23:48:42 +01:00
Kenneth Skovhede
3ff2f1eb98
The concurrent processing now seems to work, at least in the base case.
...
Rewrote the handling of index volumes to create them on-demand instead of in-advance.
This makes it much simpler to handle upload failures.
2016-02-22 21:27:12 +01:00
Kenneth Skovhede
ec877696b0
More work on concurrent processing
2016-02-18 16:46:53 +01:00
Kenneth Skovhede
0287c10f91
Wrote the spil collector
2016-02-15 09:01:05 +01:00
Kenneth Skovhede
01c3b3f5c0
More work on a concurrent implementation of the backup process
2016-02-09 09:17:31 +01:00
Sean Templeton