Commit Graph
269 Commits
Author SHA1 Message Date
Kenneth Skovhede 60e77cef88 Merge branch 'master' into concurrent_processing
# Conflicts:
#	Duplicati/Library/Main/Operation/BackupHandler.cs
#	Duplicati/Library/Main/Strings.cs
2016-09-23 14:39:05 +02:00
Kenneth Skovhede a0368d5f30 Added support for reporting backend size when --no-backend-verification is supplied.
This fixes #1723
2016-09-23 13:46:42 +02:00
Kenneth Skovhede 94c5e10480 Merge branch 'master' into concurrent_processing
# Conflicts:
#	Duplicati/Library/Main/Database/LocalBackupDatabase.cs
#	Duplicati/Library/Main/Database/LocalDatabase.cs
#	Duplicati/Library/Main/Database/RemoteVolumeEntry.cs
#	Duplicati/Library/Main/Operation/BackupHandler.cs
#	Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
#	Duplicati/Library/Main/Operation/RepairHandler.cs
#	Duplicati/Library/Main/Operation/RestoreControlFilesHandler.cs
2016-09-16 10:33:07 +02:00
Kenneth Skovhede db8c025497 Merge branch 'master' into concurrent_processing
# Conflicts:
#	Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
2016-09-15 11:44:39 +02:00
Kenneth Skovhede 0c68daff6c Fixed all whitespace to be 4 spaces instead of tabs 2016-09-15 11:39:27 +02:00
Kenneth Skovhede 490776ed73 Implemented a database flag to mark a database as partially recreated.
Fixed issue with error messages when attempting to recreate a partial database for restore as described in #1695.
2016-09-13 21:55:15 +02:00
Kenneth Skovhede 2653224da2 Merge branch 'master' into concurrent_processing
# Conflicts:
#	Duplicati/Library/Main/Operation/BackupHandler.cs
2016-08-31 14:17:35 +02:00
Kenneth Skovhede 72e3782b0a Added error reporting to detect errors such as the one reported in #1905. 2016-08-30 12:26:57 +02:00
Kenneth Skovhede 3f829cb6c1 Removed errors related to files reporting to be "reparsepoint" but not being symlinks.
This should fix #1727
2016-04-27 14:49:56 +02:00
Kenneth Skovhede 66eb681541 Fixed issues that arose when using multi-threaded execution 2016-04-05 23:29:14 +02:00
Kenneth Skovhede ce54f8ce2f Updated CoCoL and added options to enable multithreading, but that currently fails 2016-04-04 22:43:07 +02:00
Kenneth Skovhede d101f91c94 Fixed support for metadata larger than blocksize. Now supports one full blocklist of metadata, appx 300mb with default settings.
Added correct handling of metadata hashes, such that a metadata blockset is now handled the same was as a regular file blockset.
The query that creates the filesets does not support more than a single blocklist of metadata, hence the limitiation.
2016-04-04 18:11:48 +02:00
Kenneth Skovhede 72b33bcf93 Extra fixes to support larger metadata (up to appx 300 mb with default blocksize) 2016-04-03 23:54:52 +02:00
Kenneth Skovhede e40bd7f02a Proposed version, not complete with handling large metadata chunks 2016-04-03 23:10:47 +02:00
Kenneth Skovhede 317fd493d8 Merge branch 'master' into concurrent_processing
# Conflicts:
#	Duplicati/Library/Main/Database/LocalDatabase.cs
#	Duplicati/Library/Main/Operation/BackupHandler.cs
#	Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
2016-03-30 08:30:09 +02:00
Kenneth Skovhede 875cd57eab Bit too quick there :) 2016-03-20 12:41:17 +01:00
Kenneth Skovhede bf07813ca8 Real fix for the problem with duplicate fileset timestamp on really short backups 2016-03-20 12:38:36 +01:00
Kenneth Skovhede 0530cb4d52 Added repair-in-progress check to avoid continuing work on a broken database 2016-03-18 13:26:12 +01:00
Kenneth Skovhede be959a8a1b Changed the name of a resource class 2016-03-14 09:35:01 +01:00
Kenneth Skovhede a3f2b39d23 Implemented handling of pause/stop/abort in the concurrent code.
Implemented the dry-run feature for backups.
2016-02-29 21:52:11 +01:00
Kenneth Skovhede 537fe20838 Added a lot of comments.
Fixed a few issues that caused parallel uploads.
Fixed the use of the encryption module so the encryption module is not re-used for multiple jobs.
2016-02-25 19:15:51 +01:00
Kenneth Skovhede 20f7b42945 Fixed channels to use type-safe initializations.
Updated logging channel to use a wrapper for later early-filter optimizations.
Various bug fixes and optimizations.
2016-02-24 23:48:42 +01:00
Kenneth Skovhede a3be862f58 Fixed bug where unmodified files were not added to the dlist 2016-02-23 20:58:50 +01:00
Kenneth Skovhede 37d04b7b19 More work on making the backup process use the concurrent constructs 2016-02-22 22:40:27 +01:00
Kenneth Skovhede 3ff2f1eb98 The concurrent processing now seems to work, at least in the base case.
Rewrote the handling of index volumes to create them on-demand instead of in-advance.
This makes it much simpler to handle upload failures.
2016-02-22 21:27:12 +01:00
Kenneth Skovhede 9d3584a990 Implemented the progress handler and made multi-processing ready 2016-02-20 15:33:25 +01:00
Kenneth Skovhede 8abdf87188 More cleanup and fixes for the concurrent processing 2016-02-20 15:06:29 +01:00
Kenneth Skovhede 6ae9d3a288 Merge branch 'master' into concurrent_processing
# Conflicts:
#	Duplicati/Library/Main/Operation/BackupHandler.cs
2016-02-19 00:17:06 +01:00
Kenneth Skovhede 1fab22c807 Fixed some crashes introduced with the refactoring 2016-02-19 00:15:16 +01:00
Kenneth Skovhede 371965d88c Work towards using the processed based concurrent execution flow 2016-02-19 00:02:38 +01:00
Kenneth Skovhede 3236459f86 More refactoring to reduce the number of shared variables used when calling around in the BackupHandler class 2016-02-18 23:10:26 +01:00
Kenneth Skovhede 93cf6f6690 Changed logic for creating new volumes during backup.
Instead of creating them up front, they are created when needed (lazy init).
2016-02-18 22:49:10 +01:00
Kenneth Skovhede 781d8e4db4 Refactored the main backup routine to be more readable.
It still sucks because it keeps too much state in the class variables between function calls
2016-02-18 22:38:03 +01:00
Kenneth Skovhede 4780c25ff0 Bugfix, uploading control files in synthetic filelists did not work 2016-02-18 22:37:45 +01:00
Kenneth Skovhede 9bfc39120a Improved handling the compaction process with errors, such that deletes are marked and commited to the database before actually being deleted, causing fewer issues when resuming the operation afterwards. 2015-11-17 21:32:55 +01:00
Kenneth Skovhede 8359369952 Added error handling to treat errors in reading metadata as warnings instead of skipping the entire file 2015-09-04 13:14:30 +02:00
Kenneth Skovhede e13978d1c0 Improved handling of non-standard blocksize and hashing algorithms 2015-04-08 20:33:30 +02:00
Kenneth Skovhede 0de9adc606 Added grace-period for incomplete uploads to avoid backups stopping due to the Apache WebDAV issues.
This fixes #1243.
2015-04-05 14:33:13 +02:00
Kenneth Skovhede 3972211757 Added automatic log cleanup
This fixes #1298
2015-02-15 23:44:20 +01:00
Kenneth Skovhede a45b6ea621 Added control files to synthetic dlist files too 2015-02-03 23:49:12 +01:00
Kenneth Skovhede 60389b1e6e Added extra consistency check to detect the missing file issue related to issue #1214. 2015-02-03 23:47:33 +01:00
Kenneth Skovhede 4eefccc4f2 Fixed an issue where changed metadata was not stored if the file data had not changed.
This also includes a fix for a path-lookup that was larger than needed.
2015-01-25 21:55:15 +01:00
Kenneth Skovhede ed6acedd67 Fixed a bug where the old modification timestamp was re-recorded, resulting in repeated scanning of the files 2015-01-25 21:51:34 +01:00
Kenneth Skovhede 4846ffa103 Now using the file modification timestamp and the filesize as indicators that trigger file scanning.
This fixes #1099.
2015-01-24 21:59:53 +01:00
Kenneth Skovhede 16c791f0b5 Removed all resx files, now using Duplicati.Library.Localization exclusively 2015-01-20 21:07:24 +01:00
Kenneth Skovhede 9ebd43bc75 Now guarding put calls with a transaction flush before and after.
This solves #1243.
2015-01-19 11:23:21 +01:00
Kenneth Skovhede 4f9de30936 Added upload of detected missing index files 2014-12-30 18:29:07 +01:00
Kenneth Skovhede 38fc145647 Added code to record remote file sizes early to reduce deletion of files that are uploaded correctly. 2014-12-30 18:28:48 +01:00
Kenneth Skovhede 2f1c059eb7 Reversed order of verify/cleanup and synthetic filelist upload 2014-12-30 17:30:58 +01:00
Kenneth Skovhede 7cbedb8f43 Refactored the synthetic filelist upload and added a check to prevent defect fileslist being uploaded. 2014-12-30 16:13:31 +01:00