Kenneth Skovhede
9a227ada6b
Reworked the cleanup process to allow a dangling filelist, such that this dangling entry can be used as the basis for a synthetic filelist.
...
Also added an option to disable synthetic filelists.
This fixes #2038 .
This fixes #2101
2016-12-24 11:42:26 +01:00
Kenneth Skovhede
606b835f7a
Improved verbose messages when excluding a file based on the size criteria
2016-12-08 11:09:51 +01:00
Kenneth Skovhede
be62ff5556
Added check to avoid adding excluded/missing files to the database.
...
This fixes #1855 .
2016-12-08 11:00:12 +01:00
Kenneth Skovhede
32423d78b5
Added EndTime value in a few places.
...
This fixes #2127
2016-12-02 00:08:09 +01:00
Kenneth Skovhede
cdba1211a5
Fixed integer overflow when calculating maximum metadata size.
...
This fixes #2089
2016-11-08 10:47:02 +01:00
Kenneth Skovhede
1f7110503a
Updated unix symlinks handling to store correct metadata for symlinks
2016-11-03 13:11:53 +01:00
Max
5c7dfcada7
Refactor of hyper-v backup
2016-10-22 23:08:27 +02:00
Kenneth Skovhede and GitHub
431b917ae5
Merge pull request #2020 from AndersGron/master
...
Amazon cloud drive consistency delay
2016-10-18 18:55:30 +02:00
Kenneth Skovhede
8c48937caa
Typo fix
2016-10-18 15:18:31 +02:00
Kenneth Skovhede
8c34b3bd84
Fixed parallelism spawning the correct handlers
2016-10-18 15:17:59 +02:00
Kenneth Skovhede
3880df7e6d
Merge branch 'hyperv_ui' of https://github.com/mnaiman/duplicati into mnaiman-hyperv_ui
...
# Conflicts:
# Duplicati/Library/Main/Operation/BackupHandler.cs
2016-10-18 13:31:22 +02:00
Kenneth Skovhede
c1c8c9a1aa
Merge branch 'master' into concurrent_processing
...
Some changes were required for this merge,
now the StreamBlockSplitter process will take in any stream, store the blocks and return the blockset ID.
This makes it compatible with the changes for metadata handling where they support more than a single block of metadata.
# Conflicts:
# Duplicati/Library/Main/Database/LocalDatabase.cs
# Duplicati/Library/Main/Database/LocalRepairDatabase.cs
# Duplicati/Library/Main/Operation/BackupHandler.cs
# Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
2016-10-18 13:27:36 +02:00
Kenneth Skovhede
60c972cf0b
Added a comment that explains how to get more than 300mb metadata support, should we need it
2016-10-17 15:43:41 +02:00
Kenneth Skovhede
309bf1648d
Merge branch 'master' into feature/fix_for_different_blockhash_and_filehash_plus_multiblocks_metadata
...
# Conflicts:
# Duplicati/Library/Main/Database/LocalDatabase.cs
# Duplicati/Library/Main/Database/LocalRecreateDatabase.cs
# Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
# Duplicati/UnitTest/BorderTests.cs
2016-10-17 13:28:27 +02:00
AndersGron
b008a54302
Fix use of null object
...
Fix use of null object
2016-10-16 22:02:55 +02:00
Max
06cccea7a7
moved hyper-v code to hyper-v classes
2016-10-16 01:40:12 +02:00
Max
8c72cefd5b
changes in hyper-v backed
2016-10-15 23:55:50 +02:00
Kenneth Skovhede
6ef4bfa5ac
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Strings.cs
2016-10-09 01:29:24 +02:00
Max
d03c794d0f
fixes 3
2016-10-07 15:03:53 +02:00
Max
0cbd292924
fixes for hyper-v
...
basic logging
added safe checks
2016-10-06 00:26:54 +02:00
Kenneth Skovhede
60e77cef88
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Operation/BackupHandler.cs
# Duplicati/Library/Main/Strings.cs
2016-09-23 14:39:05 +02:00
Kenneth Skovhede
a0368d5f30
Added support for reporting backend size when --no-backend-verification is supplied.
...
This fixes #1723
2016-09-23 13:46:42 +02:00
Kenneth Skovhede
94c5e10480
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Database/LocalBackupDatabase.cs
# Duplicati/Library/Main/Database/LocalDatabase.cs
# Duplicati/Library/Main/Database/RemoteVolumeEntry.cs
# Duplicati/Library/Main/Operation/BackupHandler.cs
# Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
# Duplicati/Library/Main/Operation/RepairHandler.cs
# Duplicati/Library/Main/Operation/RestoreControlFilesHandler.cs
2016-09-16 10:33:07 +02:00
Kenneth Skovhede
db8c025497
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
2016-09-15 11:44:39 +02:00
Kenneth Skovhede
0c68daff6c
Fixed all whitespace to be 4 spaces instead of tabs
2016-09-15 11:39:27 +02:00
Kenneth Skovhede
490776ed73
Implemented a database flag to mark a database as partially recreated.
...
Fixed issue with error messages when attempting to recreate a partial database for restore as described in #1695 .
2016-09-13 21:55:15 +02:00
Kenneth Skovhede
2653224da2
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Operation/BackupHandler.cs
2016-08-31 14:17:35 +02:00
Kenneth Skovhede
72e3782b0a
Added error reporting to detect errors such as the one reported in #1905 .
2016-08-30 12:26:57 +02:00
Kenneth Skovhede
3f829cb6c1
Removed errors related to files reporting to be "reparsepoint" but not being symlinks.
...
This should fix #1727
2016-04-27 14:49:56 +02:00
Kenneth Skovhede
66eb681541
Fixed issues that arose when using multi-threaded execution
2016-04-05 23:29:14 +02:00
Kenneth Skovhede
ce54f8ce2f
Updated CoCoL and added options to enable multithreading, but that currently fails
2016-04-04 22:43:07 +02:00
Kenneth Skovhede
d101f91c94
Fixed support for metadata larger than blocksize. Now supports one full blocklist of metadata, appx 300mb with default settings.
...
Added correct handling of metadata hashes, such that a metadata blockset is now handled the same was as a regular file blockset.
The query that creates the filesets does not support more than a single blocklist of metadata, hence the limitiation.
2016-04-04 18:11:48 +02:00
Kenneth Skovhede
72b33bcf93
Extra fixes to support larger metadata (up to appx 300 mb with default blocksize)
2016-04-03 23:54:52 +02:00
Kenneth Skovhede
e40bd7f02a
Proposed version, not complete with handling large metadata chunks
2016-04-03 23:10:47 +02:00
Kenneth Skovhede
317fd493d8
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Database/LocalDatabase.cs
# Duplicati/Library/Main/Operation/BackupHandler.cs
# Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
2016-03-30 08:30:09 +02:00
Kenneth Skovhede
875cd57eab
Bit too quick there :)
2016-03-20 12:41:17 +01:00
Kenneth Skovhede
bf07813ca8
Real fix for the problem with duplicate fileset timestamp on really short backups
2016-03-20 12:38:36 +01:00
Kenneth Skovhede
0530cb4d52
Added repair-in-progress check to avoid continuing work on a broken database
2016-03-18 13:26:12 +01:00
Kenneth Skovhede
be959a8a1b
Changed the name of a resource class
2016-03-14 09:35:01 +01:00
Kenneth Skovhede
a3f2b39d23
Implemented handling of pause/stop/abort in the concurrent code.
...
Implemented the dry-run feature for backups.
2016-02-29 21:52:11 +01:00
Kenneth Skovhede
537fe20838
Added a lot of comments.
...
Fixed a few issues that caused parallel uploads.
Fixed the use of the encryption module so the encryption module is not re-used for multiple jobs.
2016-02-25 19:15:51 +01:00
Kenneth Skovhede
20f7b42945
Fixed channels to use type-safe initializations.
...
Updated logging channel to use a wrapper for later early-filter optimizations.
Various bug fixes and optimizations.
2016-02-24 23:48:42 +01:00
Kenneth Skovhede
a3be862f58
Fixed bug where unmodified files were not added to the dlist
2016-02-23 20:58:50 +01:00
Kenneth Skovhede
37d04b7b19
More work on making the backup process use the concurrent constructs
2016-02-22 22:40:27 +01:00
Kenneth Skovhede
3ff2f1eb98
The concurrent processing now seems to work, at least in the base case.
...
Rewrote the handling of index volumes to create them on-demand instead of in-advance.
This makes it much simpler to handle upload failures.
2016-02-22 21:27:12 +01:00
Kenneth Skovhede
9d3584a990
Implemented the progress handler and made multi-processing ready
2016-02-20 15:33:25 +01:00
Kenneth Skovhede
8abdf87188
More cleanup and fixes for the concurrent processing
2016-02-20 15:06:29 +01:00
Kenneth Skovhede
6ae9d3a288
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Operation/BackupHandler.cs
2016-02-19 00:17:06 +01:00
Kenneth Skovhede
1fab22c807
Fixed some crashes introduced with the refactoring
2016-02-19 00:15:16 +01:00
Kenneth Skovhede
371965d88c
Work towards using the processed based concurrent execution flow
2016-02-19 00:02:38 +01:00