Kenneth Skovhede
0da7039dfd
Renamed shadow to index, and reworked the filename format
2013-04-29 23:50:38 +02:00
Kenneth Skovhede
0470e6200a
Fixed cleanup for shadow and filelists
2013-04-27 15:13:14 +02:00
Kenneth Skovhede
a9aed485f7
Changed the building of shadow files to occur before an upload instead of simultaneously with the block volume
2013-04-25 21:36:00 +02:00
Kenneth Skovhede
b8040f408f
Fixed bug with calculating the number of changes files/folders/symlinks
2013-04-25 19:49:15 +02:00
Kenneth Skovhede
97227f0aa2
Fixed a bug with metadatasets, that would cause the same metadataset to occur multiple times in the database
2013-04-25 19:46:32 +02:00
Kenneth Skovhede
0f61260552
Fixed a bug with GetPreviousFilesetID
2013-04-25 19:45:24 +02:00
Kenneth Skovhede
54317a04ca
Moved db consistency check into LocalDatabase and adjusted point where the verification is called
2013-04-21 20:00:37 +02:00
Kenneth Skovhede
4dba3b034e
Bug-fix for the las bug-fix
2013-04-21 19:52:47 +02:00
Kenneth Skovhede
a8eb96adf3
Bug fix for case with no in-memory lookup
2013-04-21 14:17:23 +02:00
Kenneth Skovhede
199a720870
Improved error message when db verification fails
2013-04-21 14:04:59 +02:00
Kenneth Skovhede
39f719e094
Bugfix with cleanup
2013-04-09 20:45:11 +02:00
Kenneth Skovhede
91935a5315
Added shaddowblock link to keep track of what shadow files to delete
2013-04-08 22:24:54 +02:00
Kenneth Skovhede
e782d5c89d
Renamed lookup table options from *-size to *-memory to make it clearer that it affects only memory allocation
2013-04-07 08:26:40 +02:00
Kenneth Skovhede
4fefbd1645
Work on the block hash format, this should be the last db-restructure
2013-04-06 13:46:58 +02:00
Kenneth Skovhede
a87d1d71ae
Overhaul that fixes some minor issues and leaves the database much cleaner after a restore.
...
Also added extra checks to the manifest to reflect the possibility of choosing another hash algorithm.
2013-04-04 20:34:26 +02:00
Kenneth Skovhede
4566ea1c3d
Refactored the local database.
...
Fixed an issue when recreating the database, the operation was not created, making compact and delete commands not working.
2013-04-03 21:06:27 +02:00
Kenneth Skovhede
2c338fecf5
Renamed the internal option name to avoid confusion
2013-03-31 19:27:32 +02:00
Kenneth Skovhede
d64449b48f
Work on the cleanup procedure, not tested yet and does not handle cases where some blocks are missing.
2013-03-30 15:23:09 +01:00
Kenneth Skovhede
cfda6c4abb
Major overhaul, which includes the option to select hash algorithm.
...
Implemented delete-all-but-n and delete-older-than.
Implemented compacting.
Added the --dry-run option, which currently works for deleting and compacting, but not restore or backup.
Added output to console for use with dry-run, and added option to redirect this to the log for use in service mode.
2013-03-27 16:06:45 +01:00
Kenneth Skovhede
c34023139f
Refactored the database to store the remote volume id instead of the filename for each block, which reduces required storage space for the local database
2013-03-22 21:56:00 +01:00
Kenneth Skovhede
0a80b04352
Made it possible to deactivate all cache tables
2013-03-16 10:37:57 +01:00
Kenneth Skovhede
6d2e39bb38
Added support code to work with the file-change-monitor
2013-03-15 22:04:07 +01:00
Kenneth Skovhede
f6a8511d77
Refactored the hash lookup.
...
Added hash lookup for metadata.
Added optional path-based lookup, which are disabled because they use a lot of memory.
2013-03-15 21:14:00 +01:00
Kenneth Skovhede
1231dc24da
Made the hash memory requirement configurable
2013-03-11 20:45:48 +01:00
Kenneth Skovhede
b7531b3766
Added double lookup for block and file hash, this reduces the execution time to half.
2013-03-11 20:13:40 +01:00
Kenneth Skovhede
11e863eb78
Fixed a bug with the hash lookup table, much faster now
2013-03-10 23:01:17 +01:00
Kenneth Skovhede
f055dfd2b4
Optimized block queries
2013-03-10 20:33:30 +01:00
Kenneth Skovhede
5863292f11
Added hash prefix lookup to reduce database pressure
2013-03-10 14:27:13 +01:00
Kenneth Skovhede
513fc9b3d2
Reduced a bottleneck related to storing metadata, and added an option to avoid storing metadata
2013-03-09 13:25:50 +01:00
Kenneth Skovhede
aca4ed95cc
More work on the block hash.
...
Rewrote the backup and restore to work within a transaction as that speeds things up a lot.
Rewrote the backup procedure to generate the file list from the database, instead of on-the-fly as that is more efficient.
Re-arranged the database to use less storage on large sets of unchanged files.
2013-03-08 22:24:54 +01:00
kenneth@hexad.dk
a0521da54d
Initial version of the new block-based storage format.
...
Still needs a work over in terms of error handling, progress reporting, warning output, refactoring etc.
Also misses the volume reuse/reclaim algorithms.
But it passes the unit tests now, with and without a local database.
git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1526 59da171f-624f-0410-aa54-27559c288bec
2013-02-12 21:43:14 +00:00
Kenneth Skovhede