Kenneth Skovhede
60e77cef88
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Operation/BackupHandler.cs
# Duplicati/Library/Main/Strings.cs
2016-09-23 14:39:05 +02:00
Kenneth Skovhede
a0368d5f30
Added support for reporting backend size when --no-backend-verification is supplied.
...
This fixes #1723
2016-09-23 13:46:42 +02:00
Kenneth Skovhede
94c5e10480
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Database/LocalBackupDatabase.cs
# Duplicati/Library/Main/Database/LocalDatabase.cs
# Duplicati/Library/Main/Database/RemoteVolumeEntry.cs
# Duplicati/Library/Main/Operation/BackupHandler.cs
# Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
# Duplicati/Library/Main/Operation/RepairHandler.cs
# Duplicati/Library/Main/Operation/RestoreControlFilesHandler.cs
2016-09-16 10:33:07 +02:00
Kenneth Skovhede
db8c025497
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
2016-09-15 11:44:39 +02:00
Kenneth Skovhede
0c68daff6c
Fixed all whitespace to be 4 spaces instead of tabs
2016-09-15 11:39:27 +02:00
Kenneth Skovhede
490776ed73
Implemented a database flag to mark a database as partially recreated.
...
Fixed issue with error messages when attempting to recreate a partial database for restore as described in #1695 .
2016-09-13 21:55:15 +02:00
Kenneth Skovhede
2653224da2
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Operation/BackupHandler.cs
2016-08-31 14:17:35 +02:00
Kenneth Skovhede
72e3782b0a
Added error reporting to detect errors such as the one reported in #1905 .
2016-08-30 12:26:57 +02:00
Kenneth Skovhede
3f829cb6c1
Removed errors related to files reporting to be "reparsepoint" but not being symlinks.
...
This should fix #1727
2016-04-27 14:49:56 +02:00
Kenneth Skovhede
66eb681541
Fixed issues that arose when using multi-threaded execution
2016-04-05 23:29:14 +02:00
Kenneth Skovhede
ce54f8ce2f
Updated CoCoL and added options to enable multithreading, but that currently fails
2016-04-04 22:43:07 +02:00
Kenneth Skovhede
d101f91c94
Fixed support for metadata larger than blocksize. Now supports one full blocklist of metadata, appx 300mb with default settings.
...
Added correct handling of metadata hashes, such that a metadata blockset is now handled the same was as a regular file blockset.
The query that creates the filesets does not support more than a single blocklist of metadata, hence the limitiation.
2016-04-04 18:11:48 +02:00
Kenneth Skovhede
72b33bcf93
Extra fixes to support larger metadata (up to appx 300 mb with default blocksize)
2016-04-03 23:54:52 +02:00
Kenneth Skovhede
e40bd7f02a
Proposed version, not complete with handling large metadata chunks
2016-04-03 23:10:47 +02:00
Kenneth Skovhede
317fd493d8
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Database/LocalDatabase.cs
# Duplicati/Library/Main/Operation/BackupHandler.cs
# Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
2016-03-30 08:30:09 +02:00
Kenneth Skovhede
875cd57eab
Bit too quick there :)
2016-03-20 12:41:17 +01:00
Kenneth Skovhede
bf07813ca8
Real fix for the problem with duplicate fileset timestamp on really short backups
2016-03-20 12:38:36 +01:00
Kenneth Skovhede
0530cb4d52
Added repair-in-progress check to avoid continuing work on a broken database
2016-03-18 13:26:12 +01:00
Kenneth Skovhede
be959a8a1b
Changed the name of a resource class
2016-03-14 09:35:01 +01:00
Kenneth Skovhede
a3f2b39d23
Implemented handling of pause/stop/abort in the concurrent code.
...
Implemented the dry-run feature for backups.
2016-02-29 21:52:11 +01:00
Kenneth Skovhede
537fe20838
Added a lot of comments.
...
Fixed a few issues that caused parallel uploads.
Fixed the use of the encryption module so the encryption module is not re-used for multiple jobs.
2016-02-25 19:15:51 +01:00
Kenneth Skovhede
20f7b42945
Fixed channels to use type-safe initializations.
...
Updated logging channel to use a wrapper for later early-filter optimizations.
Various bug fixes and optimizations.
2016-02-24 23:48:42 +01:00
Kenneth Skovhede
a3be862f58
Fixed bug where unmodified files were not added to the dlist
2016-02-23 20:58:50 +01:00
Kenneth Skovhede
37d04b7b19
More work on making the backup process use the concurrent constructs
2016-02-22 22:40:27 +01:00
Kenneth Skovhede
3ff2f1eb98
The concurrent processing now seems to work, at least in the base case.
...
Rewrote the handling of index volumes to create them on-demand instead of in-advance.
This makes it much simpler to handle upload failures.
2016-02-22 21:27:12 +01:00
Kenneth Skovhede
9d3584a990
Implemented the progress handler and made multi-processing ready
2016-02-20 15:33:25 +01:00
Kenneth Skovhede
8abdf87188
More cleanup and fixes for the concurrent processing
2016-02-20 15:06:29 +01:00
Kenneth Skovhede
6ae9d3a288
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Operation/BackupHandler.cs
2016-02-19 00:17:06 +01:00
Kenneth Skovhede
1fab22c807
Fixed some crashes introduced with the refactoring
2016-02-19 00:15:16 +01:00
Kenneth Skovhede
371965d88c
Work towards using the processed based concurrent execution flow
2016-02-19 00:02:38 +01:00
Kenneth Skovhede
3236459f86
More refactoring to reduce the number of shared variables used when calling around in the BackupHandler class
2016-02-18 23:10:26 +01:00
Kenneth Skovhede
93cf6f6690
Changed logic for creating new volumes during backup.
...
Instead of creating them up front, they are created when needed (lazy init).
2016-02-18 22:49:10 +01:00
Kenneth Skovhede
781d8e4db4
Refactored the main backup routine to be more readable.
...
It still sucks because it keeps too much state in the class variables between function calls
2016-02-18 22:38:03 +01:00
Kenneth Skovhede
4780c25ff0
Bugfix, uploading control files in synthetic filelists did not work
2016-02-18 22:37:45 +01:00
Kenneth Skovhede
9bfc39120a
Improved handling the compaction process with errors, such that deletes are marked and commited to the database before actually being deleted, causing fewer issues when resuming the operation afterwards.
2015-11-17 21:32:55 +01:00
Kenneth Skovhede
8359369952
Added error handling to treat errors in reading metadata as warnings instead of skipping the entire file
2015-09-04 13:14:30 +02:00
Kenneth Skovhede
e13978d1c0
Improved handling of non-standard blocksize and hashing algorithms
2015-04-08 20:33:30 +02:00
Kenneth Skovhede
0de9adc606
Added grace-period for incomplete uploads to avoid backups stopping due to the Apache WebDAV issues.
...
This fixes #1243 .
2015-04-05 14:33:13 +02:00
Kenneth Skovhede
3972211757
Added automatic log cleanup
...
This fixes #1298
2015-02-15 23:44:20 +01:00
Kenneth Skovhede
a45b6ea621
Added control files to synthetic dlist files too
2015-02-03 23:49:12 +01:00
Kenneth Skovhede
60389b1e6e
Added extra consistency check to detect the missing file issue related to issue #1214 .
2015-02-03 23:47:33 +01:00
Kenneth Skovhede
4eefccc4f2
Fixed an issue where changed metadata was not stored if the file data had not changed.
...
This also includes a fix for a path-lookup that was larger than needed.
2015-01-25 21:55:15 +01:00
Kenneth Skovhede
ed6acedd67
Fixed a bug where the old modification timestamp was re-recorded, resulting in repeated scanning of the files
2015-01-25 21:51:34 +01:00
Kenneth Skovhede
4846ffa103
Now using the file modification timestamp and the filesize as indicators that trigger file scanning.
...
This fixes #1099 .
2015-01-24 21:59:53 +01:00
Kenneth Skovhede
16c791f0b5
Removed all resx files, now using Duplicati.Library.Localization exclusively
2015-01-20 21:07:24 +01:00
Kenneth Skovhede
9ebd43bc75
Now guarding put calls with a transaction flush before and after.
...
This solves #1243 .
2015-01-19 11:23:21 +01:00
Kenneth Skovhede
4f9de30936
Added upload of detected missing index files
2014-12-30 18:29:07 +01:00
Kenneth Skovhede
38fc145647
Added code to record remote file sizes early to reduce deletion of files that are uploaded correctly.
2014-12-30 18:28:48 +01:00
Kenneth Skovhede
2f1c059eb7
Reversed order of verify/cleanup and synthetic filelist upload
2014-12-30 17:30:58 +01:00
Kenneth Skovhede
7cbedb8f43
Refactored the synthetic filelist upload and added a check to prevent defect fileslist being uploaded.
2014-12-30 16:13:31 +01:00