Commit Graph
57 Commits
Author SHA1 Message Date
Kenneth Skovhede c7836ce403 Removed support for the old file format 2013-05-05 17:54:59 +02:00
Kenneth Skovhede 0d8ea21760 Improved local restore by not opening source or target files, if the source does not exist 2013-04-29 23:56:01 +02:00
Kenneth Skovhede 0da7039dfd Renamed shadow to index, and reworked the filename format 2013-04-29 23:50:38 +02:00
Kenneth Skovhede d91980dda1 Added faster local-block restore that only restores blocks from the original source files, if restoring to somewhere else. 2013-04-28 12:19:21 +02:00
Kenneth Skovhede 0470e6200a Fixed cleanup for shadow and filelists 2013-04-27 15:13:14 +02:00
Kenneth Skovhede 141ffa96a8 Improved restore speed 2013-04-27 10:29:27 +02:00
Kenneth Skovhede a9aed485f7 Changed the building of shadow files to occur before an upload instead of simultaneously with the block volume 2013-04-25 21:36:00 +02:00
Kenneth Skovhede b8040f408f Fixed bug with calculating the number of changes files/folders/symlinks 2013-04-25 19:49:15 +02:00
Kenneth Skovhede 97227f0aa2 Fixed a bug with metadatasets, that would cause the same metadataset to occur multiple times in the database 2013-04-25 19:46:32 +02:00
Kenneth Skovhede 0f61260552 Fixed a bug with GetPreviousFilesetID 2013-04-25 19:45:24 +02:00
Kenneth Skovhede 65b4efdfab Added method to scrub filenames from database 2013-04-22 21:20:14 +02:00
Kenneth Skovhede 17ec5a5b54 Rollback the schema change and implemented a real fix for the problem 2013-04-22 21:06:52 +02:00
Kenneth Skovhede 6ccc681e6f Fixed a bug that would cause re-use of database IDs 2013-04-21 20:01:32 +02:00
Kenneth Skovhede 54317a04ca Moved db consistency check into LocalDatabase and adjusted point where the verification is called 2013-04-21 20:00:37 +02:00
Kenneth Skovhede 4dba3b034e Bug-fix for the las bug-fix 2013-04-21 19:52:47 +02:00
Kenneth Skovhede a8eb96adf3 Bug fix for case with no in-memory lookup 2013-04-21 14:17:23 +02:00
Kenneth Skovhede 199a720870 Improved error message when db verification fails 2013-04-21 14:04:59 +02:00
Kenneth Skovhede b7c4ff79c8 Added sorting to the compact function, so that old blocks are grouped together, as they are expected to be required longer than new blocks 2013-04-16 22:37:54 +02:00
Kenneth Skovhede 66367d662b Fixed problem with dbpath with no path component 2013-04-09 22:59:34 +02:00
Kenneth Skovhede 39f719e094 Bugfix with cleanup 2013-04-09 20:45:11 +02:00
Kenneth Skovhede fd4510edd2 Rewrite of transaction handling, so the database is more closely mimicking the actual remote backend state.
This also removes all multi-threaded calls to the database as they were not working as expected.
The transactions are now used to keep the database in a sane state, but as far as possible log all messages from the connection to the database without using cross-thread requests.
Also fixed some errors with cleanup and rewrote some of the remote filename parsing and validation.
2013-04-09 20:44:53 +02:00
Kenneth Skovhede 709c4ee15a Improved check for compacting 2013-04-08 22:29:50 +02:00
Kenneth Skovhede 765078bca4 Fixed bug where blocklisthashes would be marked as unused in volumes 2013-04-08 22:29:04 +02:00
Kenneth Skovhede 064593bc14 Removed debug output 2013-04-08 22:28:28 +02:00
Kenneth Skovhede 63be6f3afd SQL Style fix 2013-04-08 22:25:30 +02:00
Kenneth Skovhede 91935a5315 Added shaddowblock link to keep track of what shadow files to delete 2013-04-08 22:24:54 +02:00
Kenneth Skovhede f378d6d188 Better fix for guarding against single-volume compact attempts 2013-04-07 09:10:04 +02:00
Kenneth Skovhede bef04017de Bugfix 2013-04-07 09:02:55 +02:00
Kenneth Skovhede e782d5c89d Renamed lookup table options from *-size to *-memory to make it clearer that it affects only memory allocation 2013-04-07 08:26:40 +02:00
Kenneth Skovhede 7c5b3043a8 More work on ForestHash 2013-04-06 15:28:43 +02:00
Kenneth Skovhede 4fefbd1645 Work on the block hash format, this should be the last db-restructure 2013-04-06 13:46:58 +02:00
Kenneth Skovhede a87d1d71ae Overhaul that fixes some minor issues and leaves the database much cleaner after a restore.
Also added extra checks to the manifest to reflect the possibility of choosing another hash algorithm.
2013-04-04 20:34:26 +02:00
Kenneth Skovhede 4566ea1c3d Refactored the local database.
Fixed an issue when recreating the database, the operation was not created, making compact and delete commands not working.
2013-04-03 21:06:27 +02:00
Kenneth Skovhede a564891b79 Implemented FindLastFileVersion with and without local database support 2013-04-01 15:06:31 +02:00
Kenneth Skovhede b09086a534 Added auto-compact after backup if the volume is small 2013-04-01 15:05:33 +02:00
Kenneth Skovhede df60bd4fd2 Updated the compact handler to use the AsyncDownloader instead of the makeshift version it was using 2013-03-31 19:34:42 +02:00
Kenneth Skovhede 499745220d Improved cleanup to report the file sets that reference a non-accesible block
Added command to allow deleting specific filesets
2013-03-31 19:33:34 +02:00
Kenneth Skovhede 2c338fecf5 Renamed the internal option name to avoid confusion 2013-03-31 19:27:32 +02:00
Kenneth Skovhede 778699326a Added incompatible option detection 2013-03-31 19:25:59 +02:00
Kenneth Skovhede d64449b48f Work on the cleanup procedure, not tested yet and does not handle cases where some blocks are missing. 2013-03-30 15:23:09 +01:00
Kenneth Skovhede cfda6c4abb Major overhaul, which includes the option to select hash algorithm.
Implemented delete-all-but-n and delete-older-than.
Implemented compacting.
Added the --dry-run option, which currently works for deleting and compacting, but not restore or backup.
Added output to console for use with dry-run, and added option to redirect this to the log for use in service mode.
2013-03-27 16:06:45 +01:00
Kenneth Skovhede c34023139f Refactored the database to store the remote volume id instead of the filename for each block, which reduces required storage space for the local database 2013-03-22 21:56:00 +01:00
Kenneth Skovhede ed7ed5e6c2 Fixed a bug that caused 8x larger memory to be used than what was specified 2013-03-16 12:30:29 +01:00
Kenneth Skovhede 0a80b04352 Made it possible to deactivate all cache tables 2013-03-16 10:37:57 +01:00
Kenneth Skovhede 6d2e39bb38 Added support code to work with the file-change-monitor 2013-03-15 22:04:07 +01:00
Kenneth Skovhede 7bc6c2b6ff Rewrote the way the restore operation uses file lists for partial restore 2013-03-15 21:16:29 +01:00
Kenneth Skovhede ac90565c39 Cleaned up some unused code 2013-03-15 21:15:51 +01:00
Kenneth Skovhede f6a8511d77 Refactored the hash lookup.
Added hash lookup for metadata.
Added optional path-based lookup, which are disabled because they use a lot of memory.
2013-03-15 21:14:00 +01:00
Kenneth Skovhede 1231dc24da Made the hash memory requirement configurable 2013-03-11 20:45:48 +01:00
Kenneth Skovhede b7531b3766 Added double lookup for block and file hash, this reduces the execution time to half. 2013-03-11 20:13:40 +01:00