haeaeae/duplicati
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
8,782 Commits 140 Branches 416 Tags
b73e94de7ee24c5261e14f29bcceecb39b519aa8
Commit Graph
530 Commits
Author SHA1 Message Date
Kenneth Skovhede f57494ad49 Merge branch 'master' into concurrent_processing 2016-04-04 18:21:13 +02:00
Kenneth Skovhede d101f91c94 Fixed support for metadata larger than blocksize. Now supports one full blocklist of metadata, appx 300mb with default settings. 
Added correct handling of metadata hashes, such that a metadata blockset is now handled the same was as a regular file blockset.
The query that creates the filesets does not support more than a single blocklist of metadata, hence the limitiation.
 2016-04-04 18:11:48 +02:00
Kenneth Skovhede 72b33bcf93 Extra fixes to support larger metadata (up to appx 300 mb with default blocksize) 2016-04-03 23:54:52 +02:00
Kenneth Skovhede e40bd7f02a Proposed version, not complete with handling large metadata chunks 2016-04-03 23:10:47 +02:00
Kenneth Skovhede b92f52331e Added a check to see if there are orphan file entries 2016-03-30 12:29:22 +02:00
Kenneth Skovhede 317fd493d8 Merge branch 'master' into concurrent_processing 
# Conflicts:
#	Duplicati/Library/Main/Database/LocalDatabase.cs
#	Duplicati/Library/Main/Operation/BackupHandler.cs
#	Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
 2016-03-30 08:30:09 +02:00
Kenneth Skovhede a568b1e55e Fixed query and logic for issue reported in #1644 and #1583 2016-03-30 01:30:51 +02:00
Kenneth Skovhede 6aedcea7a6 Deleted extra left parenthesis 2016-03-27 16:07:03 +02:00
Kenneth Skovhede 4df9ec1224 Rewrote query for deleting filesets to support filesets with zero entries. 
This should fix issue #1583
 2016-03-27 15:28:49 +02:00
Kenneth Skovhede a6699e513d Fixed the repair to also support blocksize values that are not evenly divisible with the blockhash size 2016-03-27 12:50:40 +02:00
Kenneth Skovhede a811189e82 Merge pull request #1661 from FootStark/hotfix/RecreateDatabaseError 
Hotfix/recreate database error
 2016-03-26 17:51:43 +01:00
FootStark d715d494ec Quickfix to restore issue 
Fixes blocksize-assumption of 10KB
 2016-03-26 13:14:05 +01:00
Kenneth Skovhede c71058820c Cleanup logic for fixing databases with a registered duplicate remote volume 2016-03-24 16:31:07 +01:00
Kenneth Skovhede 6cd73c1d0a Likely fix for issue #1644 and #1583 2016-03-24 16:30:19 +01:00
Kenneth Skovhede 9fdae7f0c3 Added distinct clause to guard against index files with multiple copies of the same blocklisthash 2016-03-19 22:16:22 +01:00
Kenneth Skovhede 6b18217c0a Merge branch 'feature/improved_rebuild_queries' 
# Conflicts:
#	Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
#	Duplicati/Library/Main/Operation/RepairHandler.cs
 2016-03-18 14:32:43 +01:00
Kenneth Skovhede 0530cb4d52 Added repair-in-progress check to avoid continuing work on a broken database 2016-03-18 13:26:12 +01:00
Kenneth Skovhede 4be7a45067 Fixed the query to correctly compute the size of the trailing blocklisthash block. 2016-03-18 13:24:10 +01:00
Kenneth Skovhede 0ebbef0b97 Implemented feature that does not delete extra index files if their content fits the database. 2016-03-17 21:51:42 +01:00
Kenneth Skovhede ade9db9dca Utility fixes 2016-03-17 21:43:09 +01:00
Kenneth Skovhede 9a58a93894 Fixed an cleaned the rebuild SQL that picks missing blocklist hashes 2016-03-17 21:17:22 +01:00
Kenneth Skovhede 40b96fbedf Bugfix, weird order of arguments 2016-03-17 21:13:48 +01:00
FootStark 7656e891ce Prepocessor for schema, Optimized RemoveRemoteVolume 
Added a preprocessor for schema supporting sqlite_version-dependent
Statements
RemoveRemoteVolume deletes volumes in batch.
 2016-03-16 00:49:28 +01:00
Kenneth Skovhede 9f1c51e891 Improved logic to deal with blocklistshashes that collide but have different lengths. 
Added safeguard to avoid importing blocklists with wrong length, that appears in index files created by older versions of Duplicati.
 2016-03-15 21:02:13 +01:00
FootStark f0525d8ed5 Improved DB schema (version 5) for BlockSetEntry 2016-03-14 23:35:54 +01:00
Kenneth Skovhede 430acb6a07 Merge branch 'master' into concurrent_processing 2016-03-13 14:23:28 +01:00
FootStark 5320a0af13 Mitigate slow vol-deletion by caching slow subquery. 2016-03-13 13:23:06 +01:00
FootStark 27ce3ef5f3 Respect DryRun option when scanning target blocks 2016-03-12 12:48:41 +01:00
Kenneth Skovhede 59df0bf71b Merge branch 'ParalellFileScanning' of https://github.com/FootStark/duplicati into FootStark-ParalellFileScanning 
# Conflicts:
#	Duplicati/Library/Main/Operation/RestoreHandler.cs
 2016-03-07 00:07:43 +01:00
Kenneth Skovhede 72b32a8fe5 Merge branch 'ImpVolumeDownloadOrder' of https://github.com/FootStark/duplicati into FootStark-ImpVolumeDownloadOrder 2016-03-06 21:17:26 +01:00
FootStark e22a47ef83 Merge remote-tracking branch 'refs/remotes/duplicati/master' into ParalellFileScanning 2016-03-05 10:08:47 +01:00
FootStark 412d7fe07b Reorganize ScanForExistingTargetBlocks 
1. Fixes a bug where duplicati truncates forthwritten files backuped
with a size being a multiple of blocksize on rename.
2. Tries to verify file data on beginning. If successful, marks files to
not be reverified in the end.
3. On overwrite restore, removes readonly attribute from files having to
be modified
4. Little speedup by computing parallel blcok and file Hashes
 2016-03-05 02:00:28 +01:00
FootStark 2ff1b85ace Fix update stats if file without blocks 
Fixes progress tracker if there are files included in restore without
any blocks (happens on empty files with skip-metadata option)
 2016-03-04 19:30:32 +01:00
FootStark 1fcf9919a0 Last Adjustment and a measure 2016-03-03 23:18:47 +01:00
FootStark ee5d76837f Volume order by max block index 2016-03-03 20:15:27 +01:00
FootStark 7c1caa6f3d Added comment 2016-02-28 00:16:00 +01:00
FootStark 36984a322b Imrpoved Blockmarker and update statistics 
Updated BlockMarker to alter rows in Blocks table directly
Added Trigger-based update statistics
Prepared for file tracker
 2016-02-27 22:04:48 +01:00
FootStark 150dac30e8 Enable ExecPlans for commands with parameters 2016-02-27 21:59:25 +01:00
Kenneth Skovhede 537fe20838 Added a lot of comments. 
Fixed a few issues that caused parallel uploads.
Fixed the use of the encryption module so the encryption module is not re-used for multiple jobs.
 2016-02-25 19:15:51 +01:00
Kenneth Skovhede 0eba4bf098 Improved debugging for sql commands 2016-02-24 23:45:32 +01:00
Kenneth Skovhede cedd5aff84 Merge branch 'master' into concurrent_processing 2016-02-23 20:57:41 +01:00
Kenneth Skovhede 39a8f4eb7f Fixed an issue with re-creating index files from database in the case where the source file fills the blocklist with consecutive identical blocks. 2016-02-23 20:56:24 +01:00
Kenneth Skovhede 3ff2f1eb98 The concurrent processing now seems to work, at least in the base case. 
Rewrote the handling of index volumes to create them on-demand instead of in-advance.
This makes it much simpler to handle upload failures.
 2016-02-22 21:27:12 +01:00
Kenneth Skovhede 8abdf87188 More cleanup and fixes for the concurrent processing 2016-02-20 15:06:29 +01:00
Kenneth Skovhede 46c1edf88a Merge branch 'master' into concurrent_processing 2016-02-18 22:40:19 +01:00
Kenneth Skovhede 51340c0c1c Merge pull request #1584 from FootStark/master 
Performance improvement on restore
 2016-02-18 22:19:31 +01:00
FootStark 07ef6b754e Update ExtensionMethods.cs 2016-02-18 19:33:08 +01:00
FootStark 2595737e58 Speedup restore (Index + SQL Fix) 
Fix Indexes and SQL's for Commit and Querying Missing Blocks
 2016-02-18 19:31:17 +01:00
Kenneth Skovhede 115d3c92bc Merge branch 'master' into concurrent_processing 2016-02-18 17:20:59 +01:00
Kenneth Skovhede 086547e655 Implemented the missing details for the concurrent setup, it now compiles 2016-02-18 17:20:52 +01:00