haeaeae/duplicati
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,006 Commits 140 Branches 416 Tags
4566ea1c3d885d11b6aac28fa65b683ab215e3c2
Commit Graph
16 Commits
Author SHA1 Message Date
Kenneth Skovhede 4566ea1c3d Refactored the local database. 
Fixed an issue when recreating the database, the operation was not created, making compact and delete commands not working.
 2013-04-03 21:06:27 +02:00
Kenneth Skovhede 2c338fecf5 Renamed the internal option name to avoid confusion 2013-03-31 19:27:32 +02:00
Kenneth Skovhede d64449b48f Work on the cleanup procedure, not tested yet and does not handle cases where some blocks are missing. 2013-03-30 15:23:09 +01:00
Kenneth Skovhede cfda6c4abb Major overhaul, which includes the option to select hash algorithm. 
Implemented delete-all-but-n and delete-older-than.
Implemented compacting.
Added the --dry-run option, which currently works for deleting and compacting, but not restore or backup.
Added output to console for use with dry-run, and added option to redirect this to the log for use in service mode.
 2013-03-27 16:06:45 +01:00
Kenneth Skovhede c34023139f Refactored the database to store the remote volume id instead of the filename for each block, which reduces required storage space for the local database 2013-03-22 21:56:00 +01:00
Kenneth Skovhede 0a80b04352 Made it possible to deactivate all cache tables 2013-03-16 10:37:57 +01:00
Kenneth Skovhede 6d2e39bb38 Added support code to work with the file-change-monitor 2013-03-15 22:04:07 +01:00
Kenneth Skovhede f6a8511d77 Refactored the hash lookup. 
Added hash lookup for metadata.
Added optional path-based lookup, which are disabled because they use a lot of memory.
 2013-03-15 21:14:00 +01:00
Kenneth Skovhede 1231dc24da Made the hash memory requirement configurable 2013-03-11 20:45:48 +01:00
Kenneth Skovhede b7531b3766 Added double lookup for block and file hash, this reduces the execution time to half. 2013-03-11 20:13:40 +01:00
Kenneth Skovhede 11e863eb78 Fixed a bug with the hash lookup table, much faster now 2013-03-10 23:01:17 +01:00
Kenneth Skovhede f055dfd2b4 Optimized block queries 2013-03-10 20:33:30 +01:00
Kenneth Skovhede 5863292f11 Added hash prefix lookup to reduce database pressure 2013-03-10 14:27:13 +01:00
Kenneth Skovhede 513fc9b3d2 Reduced a bottleneck related to storing metadata, and added an option to avoid storing metadata 2013-03-09 13:25:50 +01:00
Kenneth Skovhede aca4ed95cc More work on the block hash. 
Rewrote the backup and restore to work within a transaction as that speeds things up a lot.
Rewrote the backup procedure to generate the file list from the database, instead of on-the-fly as that is more efficient.
Re-arranged the database to use less storage on large sets of unchanged files.
 2013-03-08 22:24:54 +01:00
kenneth@hexad.dk a0521da54d Initial version of the new block-based storage format. 
Still needs a work over in terms of error handling, progress reporting, warning output, refactoring etc.
Also misses the volume reuse/reclaim algorithms.
But it passes the unit tests now, with and without a local database.

git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1526 59da171f-624f-0410-aa54-27559c288bec
 2013-02-12 21:43:14 +00:00