Commit Graph
13 Commits
Author SHA1 Message Date
Kenneth Skovhede ef36a9356b Rewrote the uploader to pass in the index volume blocks, as that is 10x times faster than creating it from the database.
This greatly increases performance because the database read is no longer preventing progress.
2018-01-30 08:34:57 +01:00
Kenneth Skovhede 805a411f8f Fixed a few minor issues with the new approach, and rewrote the zip file packaging to allow packing more data into each volume. 2018-01-28 12:29:02 +01:00
Kenneth Skovhede 1a813e4788 Fixed a problem with using async and enumerable 2018-01-22 21:20:46 +01:00
Kenneth Skovhede 3524756beb Refactored everything related to the databases, such that the transactions are handled within the database class instead of passing around transaction objects. 2018-01-21 07:35:07 +01:00
Kenneth Skovhede 7c063cd3c1 Work on a faster way to get the full code to allow concurrent writes from the backend module 2018-01-20 19:12:20 +01:00
Kenneth Skovhede bc6e32d049 Updated the new backend handler to support the same features as the previous: throttle, error message, and deleteGraceTime. 2017-09-19 14:24:59 +02:00
Kenneth Skovhede a3f2b39d23 Implemented handling of pause/stop/abort in the concurrent code.
Implemented the dry-run feature for backups.
2016-02-29 21:52:11 +01:00
Kenneth Skovhede 537fe20838 Added a lot of comments.
Fixed a few issues that caused parallel uploads.
Fixed the use of the encryption module so the encryption module is not re-used for multiple jobs.
2016-02-25 19:15:51 +01:00
Kenneth Skovhede 37d04b7b19 More work on making the backup process use the concurrent constructs 2016-02-22 22:40:27 +01:00
Kenneth Skovhede 3ff2f1eb98 The concurrent processing now seems to work, at least in the base case.
Rewrote the handling of index volumes to create them on-demand instead of in-advance.
This makes it much simpler to handle upload failures.
2016-02-22 21:27:12 +01:00
Kenneth Skovhede 371965d88c Work towards using the processed based concurrent execution flow 2016-02-19 00:02:38 +01:00
Kenneth Skovhede ec877696b0 More work on concurrent processing 2016-02-18 16:46:53 +01:00
Kenneth Skovhede 01c3b3f5c0 More work on a concurrent implementation of the backup process 2016-02-09 09:17:31 +01:00