Commit Graph
51 Commits
Author SHA1 Message Date
Kenneth Skovhede c7836ce403 Removed support for the old file format 2013-05-05 17:54:59 +02:00
Kenneth Skovhede 0d8ea21760 Improved local restore by not opening source or target files, if the source does not exist 2013-04-29 23:56:01 +02:00
Kenneth Skovhede 0da7039dfd Renamed shadow to index, and reworked the filename format 2013-04-29 23:50:38 +02:00
Kenneth Skovhede d91980dda1 Added faster local-block restore that only restores blocks from the original source files, if restoring to somewhere else. 2013-04-28 12:19:21 +02:00
Kenneth Skovhede 0470e6200a Fixed cleanup for shadow and filelists 2013-04-27 15:13:14 +02:00
Kenneth Skovhede 39bd247b2a Bugfix for unchanged backups, introduced after rewrite of shadow-volume handling 2013-04-27 13:00:59 +02:00
Kenneth Skovhede 4893abb8c3 Added option to scan for local blocks, instead of doing it by default 2013-04-27 11:17:33 +02:00
Kenneth Skovhede 141ffa96a8 Improved restore speed 2013-04-27 10:29:27 +02:00
Kenneth Skovhede a9aed485f7 Changed the building of shadow files to occur before an upload instead of simultaneously with the block volume 2013-04-25 21:36:00 +02:00
Kenneth Skovhede 3df78983ca Removed redundant counter and updated logic for not uploading unchanged filesets 2013-04-25 19:49:47 +02:00
Kenneth Skovhede 740c2a4435 Bugfix to prevent masking errors with a transaction error 2013-04-22 21:21:13 +02:00
Kenneth Skovhede 65b4efdfab Added method to scrub filenames from database 2013-04-22 21:20:14 +02:00
Kenneth Skovhede 54317a04ca Moved db consistency check into LocalDatabase and adjusted point where the verification is called 2013-04-21 20:00:37 +02:00
Kenneth Skovhede 42a3b0f39c Added consistency check before starting a backup 2013-04-18 21:55:15 +02:00
Kenneth Skovhede 1ec4423d86 Fixed the logic that decides if a new file list should be written 2013-04-16 22:37:02 +02:00
Kenneth Skovhede f40c6275aa Cleanup that fixes leftover temporary files 2013-04-16 22:36:19 +02:00
Kenneth Skovhede d839ebf791 Fixed exceptions that mask the real erros 2013-04-15 22:19:40 +02:00
Kenneth Skovhede fd4510edd2 Rewrite of transaction handling, so the database is more closely mimicking the actual remote backend state.
This also removes all multi-threaded calls to the database as they were not working as expected.
The transactions are now used to keep the database in a sane state, but as far as possible log all messages from the connection to the database without using cross-thread requests.
Also fixed some errors with cleanup and rewrote some of the remote filename parsing and validation.
2013-04-09 20:44:53 +02:00
Kenneth Skovhede 6ff8ef7ac7 Style fix 2013-04-08 22:30:12 +02:00
Kenneth Skovhede 91935a5315 Added shaddowblock link to keep track of what shadow files to delete 2013-04-08 22:24:54 +02:00
Kenneth Skovhede d6d11fff20 Improved error message when attempting to re-create the database 2013-04-08 22:21:45 +02:00
Kenneth Skovhede f378d6d188 Better fix for guarding against single-volume compact attempts 2013-04-07 09:10:04 +02:00
Kenneth Skovhede ae968bc626 Does not try to compact, if there are only delete able volume 2013-04-07 09:03:54 +02:00
Kenneth Skovhede 7c5b3043a8 More work on ForestHash 2013-04-06 15:28:43 +02:00
Kenneth Skovhede 4fefbd1645 Work on the block hash format, this should be the last db-restructure 2013-04-06 13:46:58 +02:00
Kenneth Skovhede a87d1d71ae Overhaul that fixes some minor issues and leaves the database much cleaner after a restore.
Also added extra checks to the manifest to reflect the possibility of choosing another hash algorithm.
2013-04-04 20:34:26 +02:00
Kenneth Skovhede 34f88cd9ad Added --auto-cleanup handler for backup, when the volume is small 2013-04-03 21:09:30 +02:00
Kenneth Skovhede 4566ea1c3d Refactored the local database.
Fixed an issue when recreating the database, the operation was not created, making compact and delete commands not working.
2013-04-03 21:06:27 +02:00
Kenneth Skovhede a564891b79 Implemented FindLastFileVersion with and without local database support 2013-04-01 15:06:31 +02:00
Kenneth Skovhede 49173b6961 Bugfix 2013-04-01 15:05:44 +02:00
Kenneth Skovhede b09086a534 Added auto-compact after backup if the volume is small 2013-04-01 15:05:33 +02:00
Kenneth Skovhede a9a67d0203 Added log warning if listing files with no local database 2013-04-01 13:05:55 +02:00
Kenneth Skovhede 30517302ea Removed unsupported list-source-folders as that is irrelevant to ForestHash 2013-04-01 10:50:29 +02:00
Kenneth Skovhede df60bd4fd2 Updated the compact handler to use the AsyncDownloader instead of the makeshift version it was using 2013-03-31 19:34:42 +02:00
Kenneth Skovhede 1a975d8eac Moved the existing database file check into the operation 2013-03-31 19:33:58 +02:00
Kenneth Skovhede 499745220d Improved cleanup to report the file sets that reference a non-accesible block
Added command to allow deleting specific filesets
2013-03-31 19:33:34 +02:00
Kenneth Skovhede 383e7dfeb9 Added option verification to various command 2013-03-31 19:28:46 +02:00
Kenneth Skovhede 2c338fecf5 Renamed the internal option name to avoid confusion 2013-03-31 19:27:32 +02:00
Kenneth Skovhede d64449b48f Work on the cleanup procedure, not tested yet and does not handle cases where some blocks are missing. 2013-03-30 15:23:09 +01:00
Kenneth Skovhede bbfd00ad06 Added support for dry-run with restore 2013-03-29 14:13:31 +01:00
Kenneth Skovhede 5a8435408d Added support for dry-run with backup, still need to add it for restore 2013-03-28 15:47:20 +01:00
Kenneth Skovhede cfda6c4abb Major overhaul, which includes the option to select hash algorithm.
Implemented delete-all-but-n and delete-older-than.
Implemented compacting.
Added the --dry-run option, which currently works for deleting and compacting, but not restore or backup.
Added output to console for use with dry-run, and added option to redirect this to the log for use in service mode.
2013-03-27 16:06:45 +01:00
Kenneth Skovhede add22c14cb Added options to disable checking remote storage and to avoid storing shadow files 2013-03-26 22:21:25 +01:00
Kenneth Skovhede c34023139f Refactored the database to store the remote volume id instead of the filename for each block, which reduces required storage space for the local database 2013-03-22 21:56:00 +01:00
Kenneth Skovhede 6d2e39bb38 Added support code to work with the file-change-monitor 2013-03-15 22:04:07 +01:00
Kenneth Skovhede 1a2034b265 Added error handling to the restore handler 2013-03-15 21:16:44 +01:00
Kenneth Skovhede ac90565c39 Cleaned up some unused code 2013-03-15 21:15:51 +01:00
Kenneth Skovhede 1231dc24da Made the hash memory requirement configurable 2013-03-11 20:45:48 +01:00
Kenneth Skovhede 513fc9b3d2 Reduced a bottleneck related to storing metadata, and added an option to avoid storing metadata 2013-03-09 13:25:50 +01:00
Kenneth Skovhede aca4ed95cc More work on the block hash.
Rewrote the backup and restore to work within a transaction as that speeds things up a lot.
Rewrote the backup procedure to generate the file list from the database, instead of on-the-fly as that is more efficient.
Re-arranged the database to use less storage on large sets of unchanged files.
2013-03-08 22:24:54 +01:00