verhoek
30cd41585b
Corrected spelling function name.
2018-05-16 20:08:40 +02:00
Kenneth Skovhede
2b54bb9415
Removed the redundant byte-array-to-string method from the MD5 module, and added a using directive.
...
Added some additional logging to better diagnose issues with VSS/LVM snapshots.
2018-05-09 10:44:32 +02:00
Daniel Gehriger
8236cae390
USN change journal based backup now correctly reporting source size
2018-05-02 11:24:24 +02:00
Daniel Gehriger
ad8a3f4d4e
Simplified USN journal interface; corrected folder enumeration broken due to latest merge with master
2018-04-26 23:03:50 +02:00
Daniel Gehriger
0b43c467c7
Merge remote-tracking branch 'upstream/master' into feature/usn
2018-04-25 17:19:13 +02:00
Kenneth Skovhede
83950e78c6
Merge branch 'feature/ignore_filenames_option' into feature/exclude_empty_folders
...
# Conflicts:
# Duplicati/Library/Main/Operation/Backup/CountFilesHandler.cs
# Duplicati/Library/Main/Operation/Backup/FileEnumerationProcess.cs
# Duplicati/Library/Main/Operation/BackupHandler.cs
# Duplicati/Library/Main/Operation/TestFilterHandler.cs
# Duplicati/Library/Main/Options.cs
# Duplicati/Library/Main/Strings.cs
2018-04-24 14:46:46 +02:00
Kenneth Skovhede
c6be934747
Implemented empty folder exclusion flag
2018-04-24 13:11:03 +02:00
Kenneth Skovhede
e51e1b9e5a
Implemented option to use exclude filenames to mark folders for exclusion by placing a specially named file inside
2018-04-24 11:25:37 +02:00
Daniel Gehriger
7bf0a25912
Revert "Merge remote-tracking branch 'upstream/feature/fix_path_storage' into feature/usn"
...
This reverts commit 10d6b4c31c , reversing
changes made to 1af7f9e0ca .
2018-04-23 23:02:52 +02:00
Daniel Gehriger
10d6b4c31c
Merge remote-tracking branch 'upstream/feature/fix_path_storage' into feature/usn
2018-04-23 22:57:32 +02:00
Kenneth Skovhede
a8a32ea115
Added refactoring to improve the storage requirements for the local database, and speed up various queries.
...
This fixes #1283
2018-04-23 22:31:47 +02:00
Daniel Gehriger
1af7f9e0ca
Merge remote-tracking branch 'upstream/master' into feature/usn
2018-04-23 22:28:27 +02:00
Kenneth Skovhede
da7f705def
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Operation/BackupHandler.cs
2018-04-12 22:02:31 +02:00
Kenneth Skovhede
9eef035924
Fixed a case where the counter process would eat the output from the backup operation
2018-04-11 23:34:51 +02:00
Kenneth Skovhede
79f7b22e0f
Merge branch 'master' into concurrent_processing
...
Changed a few things on the way, removing the log process
# Conflicts:
# Duplicati/Library/Main/Controller.cs
# Duplicati/Library/Main/Database/ExtensionMethods.cs
# Duplicati/Library/Main/Database/LocalBackupDatabase.cs
# Duplicati/Library/Main/Duplicati.Library.Main.csproj
# Duplicati/Library/Main/Operation/BackupHandler.cs
# Duplicati/Library/Main/Operation/FilelistProcessor.cs
# Duplicati/Library/Main/Operation/PurgeBrokenFilesHandler.cs
# Duplicati/Library/Main/Operation/TestFilterHandler.cs
# Duplicati/Library/Main/Options.cs
# Duplicati/Library/Main/ResultClasses.cs
# Duplicati/UnitTest/BasicSetupHelper.cs
2018-04-11 23:02:47 +02:00
Kenneth Skovhede
860924bb62
Updated main functions to new CoCoL library
2017-09-20 21:03:24 +02:00
Kenneth Skovhede
683b04741d
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Operation/BackupHandler.cs
Manually fixed the HashAlgorithmHelper case
2017-09-20 13:56:37 +02:00
Kenneth Skovhede
21b7a98dc3
Implemented the blocking flag in the uploader
2017-09-19 14:18:54 +02:00
Dan Stahr
31ac40083a
Prevent temp files in VolumeWriterBase from being deleted prematurely.
...
The fix is hacky and the root cause should be investigated properly.
2017-08-13 11:58:39 +01:00
Dan Stahr
a0d63bf003
Reverted unrelated changes
2017-08-12 14:20:35 +01:00
Dan Stahr
4d98960e75
Fixed empty block handling.
...
Previously, empty files were associasted with empty blocks. These blocks were added to volumes which could result in empty, but valid volumes being garbage collected and valid file entries deleted.
This change changes the logic so that empty blocks are not stored at all.
2017-08-12 14:14:23 +01:00
Kenneth Skovhede
d18431b385
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Controller.cs
# Duplicati/Library/Main/Database/ExtensionMethods.cs
# Duplicati/Library/Main/Database/LocalBackupDatabase.cs
# Duplicati/Library/Main/Duplicati.Library.Main.csproj
# Duplicati/Library/Main/Operation/BackupHandler.cs
# Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
# Duplicati/Library/Main/ResultClasses.cs
First attempt at merging all changes from 2016-10-08 to now :/
2017-05-30 00:35:31 +02:00
Kenneth Skovhede
87373f4eb7
Fixed indentation
...
Fixed an issue with reporting twice the filesize
Fixed an issue with not terminating properly
2016-10-18 15:16:56 +02:00
Kenneth Skovhede
c1c8c9a1aa
Merge branch 'master' into concurrent_processing
...
Some changes were required for this merge,
now the StreamBlockSplitter process will take in any stream, store the blocks and return the blockset ID.
This makes it compatible with the changes for metadata handling where they support more than a single block of metadata.
# Conflicts:
# Duplicati/Library/Main/Database/LocalDatabase.cs
# Duplicati/Library/Main/Database/LocalRepairDatabase.cs
# Duplicati/Library/Main/Operation/BackupHandler.cs
# Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
2016-10-18 13:27:36 +02:00
Kenneth Skovhede
2653224da2
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Operation/BackupHandler.cs
2016-08-31 14:17:35 +02:00
Kenneth Skovhede
46342075c1
Fixed error from last merge
2016-08-10 09:27:13 +02:00
Kenneth Skovhede
f0c0fc3a2e
Merge branch 'master' into concurrent_processing
...
# Conflicts:
# Duplicati/Library/Main/Database/LocalDatabase.cs
# Duplicati/Library/Main/Duplicati.Library.Main.csproj
# Duplicati/Library/Main/Operation/BackupHandler.cs
# thirdparty/CoCoL/CoCoL.dll
2016-08-08 15:03:42 +02:00
Kenneth Skovhede
ce54f8ce2f
Updated CoCoL and added options to enable multithreading, but that currently fails
2016-04-04 22:43:07 +02:00
Kenneth Skovhede
988746c5f9
Fixed correct recording of zero-length files
2016-03-30 12:24:34 +02:00
Kenneth Skovhede
a3f2b39d23
Implemented handling of pause/stop/abort in the concurrent code.
...
Implemented the dry-run feature for backups.
2016-02-29 21:52:11 +01:00
Kenneth Skovhede
537fe20838
Added a lot of comments.
...
Fixed a few issues that caused parallel uploads.
Fixed the use of the encryption module so the encryption module is not re-used for multiple jobs.
2016-02-25 19:15:51 +01:00
Kenneth Skovhede
20f7b42945
Fixed channels to use type-safe initializations.
...
Updated logging channel to use a wrapper for later early-filter optimizations.
Various bug fixes and optimizations.
2016-02-24 23:48:42 +01:00
Kenneth Skovhede
a3be862f58
Fixed bug where unmodified files were not added to the dlist
2016-02-23 20:58:50 +01:00
Kenneth Skovhede
37d04b7b19
More work on making the backup process use the concurrent constructs
2016-02-22 22:40:27 +01:00
Kenneth Skovhede
3ff2f1eb98
The concurrent processing now seems to work, at least in the base case.
...
Rewrote the handling of index volumes to create them on-demand instead of in-advance.
This makes it much simpler to handle upload failures.
2016-02-22 21:27:12 +01:00
Kenneth Skovhede
9d3584a990
Implemented the progress handler and made multi-processing ready
2016-02-20 15:33:25 +01:00
Kenneth Skovhede
8abdf87188
More cleanup and fixes for the concurrent processing
2016-02-20 15:06:29 +01:00
Kenneth Skovhede
371965d88c
Work towards using the processed based concurrent execution flow
2016-02-19 00:02:38 +01:00
Kenneth Skovhede
086547e655
Implemented the missing details for the concurrent setup, it now compiles
2016-02-18 17:20:52 +01:00
Kenneth Skovhede
ec877696b0
More work on concurrent processing
2016-02-18 16:46:53 +01:00
Kenneth Skovhede
0287c10f91
Wrote the spil collector
2016-02-15 09:01:05 +01:00
Kenneth Skovhede
01c3b3f5c0
More work on a concurrent implementation of the backup process
2016-02-09 09:17:31 +01:00
Kenneth Skovhede
0a26e263f1
Work on concurrent processing
2016-01-28 22:24:51 +01:00