Commit Graph
28 Commits
Author SHA1 Message Date
Kenneth Skovhede c7836ce403 Removed support for the old file format 2013-05-05 17:54:59 +02:00
Kenneth Skovhede 0da7039dfd Renamed shadow to index, and reworked the filename format 2013-04-29 23:50:38 +02:00
Kenneth Skovhede 39bd247b2a Bugfix for unchanged backups, introduced after rewrite of shadow-volume handling 2013-04-27 13:00:59 +02:00
Kenneth Skovhede a9aed485f7 Changed the building of shadow files to occur before an upload instead of simultaneously with the block volume 2013-04-25 21:36:00 +02:00
Kenneth Skovhede 3df78983ca Removed redundant counter and updated logic for not uploading unchanged filesets 2013-04-25 19:49:47 +02:00
Kenneth Skovhede 740c2a4435 Bugfix to prevent masking errors with a transaction error 2013-04-22 21:21:13 +02:00
Kenneth Skovhede 54317a04ca Moved db consistency check into LocalDatabase and adjusted point where the verification is called 2013-04-21 20:00:37 +02:00
Kenneth Skovhede 42a3b0f39c Added consistency check before starting a backup 2013-04-18 21:55:15 +02:00
Kenneth Skovhede 1ec4423d86 Fixed the logic that decides if a new file list should be written 2013-04-16 22:37:02 +02:00
Kenneth Skovhede f40c6275aa Cleanup that fixes leftover temporary files 2013-04-16 22:36:19 +02:00
Kenneth Skovhede d839ebf791 Fixed exceptions that mask the real erros 2013-04-15 22:19:40 +02:00
Kenneth Skovhede fd4510edd2 Rewrite of transaction handling, so the database is more closely mimicking the actual remote backend state.
This also removes all multi-threaded calls to the database as they were not working as expected.
The transactions are now used to keep the database in a sane state, but as far as possible log all messages from the connection to the database without using cross-thread requests.
Also fixed some errors with cleanup and rewrote some of the remote filename parsing and validation.
2013-04-09 20:44:53 +02:00
Kenneth Skovhede 91935a5315 Added shaddowblock link to keep track of what shadow files to delete 2013-04-08 22:24:54 +02:00
Kenneth Skovhede 7c5b3043a8 More work on ForestHash 2013-04-06 15:28:43 +02:00
Kenneth Skovhede 4fefbd1645 Work on the block hash format, this should be the last db-restructure 2013-04-06 13:46:58 +02:00
Kenneth Skovhede a87d1d71ae Overhaul that fixes some minor issues and leaves the database much cleaner after a restore.
Also added extra checks to the manifest to reflect the possibility of choosing another hash algorithm.
2013-04-04 20:34:26 +02:00
Kenneth Skovhede 34f88cd9ad Added --auto-cleanup handler for backup, when the volume is small 2013-04-03 21:09:30 +02:00
Kenneth Skovhede b09086a534 Added auto-compact after backup if the volume is small 2013-04-01 15:05:33 +02:00
Kenneth Skovhede 383e7dfeb9 Added option verification to various command 2013-03-31 19:28:46 +02:00
Kenneth Skovhede 5a8435408d Added support for dry-run with backup, still need to add it for restore 2013-03-28 15:47:20 +01:00
Kenneth Skovhede cfda6c4abb Major overhaul, which includes the option to select hash algorithm.
Implemented delete-all-but-n and delete-older-than.
Implemented compacting.
Added the --dry-run option, which currently works for deleting and compacting, but not restore or backup.
Added output to console for use with dry-run, and added option to redirect this to the log for use in service mode.
2013-03-27 16:06:45 +01:00
Kenneth Skovhede add22c14cb Added options to disable checking remote storage and to avoid storing shadow files 2013-03-26 22:21:25 +01:00
Kenneth Skovhede c34023139f Refactored the database to store the remote volume id instead of the filename for each block, which reduces required storage space for the local database 2013-03-22 21:56:00 +01:00
Kenneth Skovhede 6d2e39bb38 Added support code to work with the file-change-monitor 2013-03-15 22:04:07 +01:00
Kenneth Skovhede 1231dc24da Made the hash memory requirement configurable 2013-03-11 20:45:48 +01:00
Kenneth Skovhede 513fc9b3d2 Reduced a bottleneck related to storing metadata, and added an option to avoid storing metadata 2013-03-09 13:25:50 +01:00
Kenneth Skovhede aca4ed95cc More work on the block hash.
Rewrote the backup and restore to work within a transaction as that speeds things up a lot.
Rewrote the backup procedure to generate the file list from the database, instead of on-the-fly as that is more efficient.
Re-arranged the database to use less storage on large sets of unchanged files.
2013-03-08 22:24:54 +01:00
kenneth@hexad.dk a0521da54d Initial version of the new block-based storage format.
Still needs a work over in terms of error handling, progress reporting, warning output, refactoring etc.
Also misses the volume reuse/reclaim algorithms.
But it passes the unit tests now, with and without a local database.

git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1526 59da171f-624f-0410-aa54-27559c288bec
2013-02-12 21:43:14 +00:00