Kenneth Skovhede
a9aed485f7
Changed the building of shadow files to occur before an upload instead of simultaneously with the block volume
2013-04-25 21:36:00 +02:00
Kenneth Skovhede
b8040f408f
Fixed bug with calculating the number of changes files/folders/symlinks
2013-04-25 19:49:15 +02:00
Kenneth Skovhede
97227f0aa2
Fixed a bug with metadatasets, that would cause the same metadataset to occur multiple times in the database
2013-04-25 19:46:32 +02:00
Kenneth Skovhede
0f61260552
Fixed a bug with GetPreviousFilesetID
2013-04-25 19:45:24 +02:00
Kenneth Skovhede
65b4efdfab
Added method to scrub filenames from database
2013-04-22 21:20:14 +02:00
Kenneth Skovhede
17ec5a5b54
Rollback the schema change and implemented a real fix for the problem
2013-04-22 21:06:52 +02:00
Kenneth Skovhede
6ccc681e6f
Fixed a bug that would cause re-use of database IDs
2013-04-21 20:01:32 +02:00
Kenneth Skovhede
54317a04ca
Moved db consistency check into LocalDatabase and adjusted point where the verification is called
2013-04-21 20:00:37 +02:00
Kenneth Skovhede
4dba3b034e
Bug-fix for the las bug-fix
2013-04-21 19:52:47 +02:00
Kenneth Skovhede
a8eb96adf3
Bug fix for case with no in-memory lookup
2013-04-21 14:17:23 +02:00
Kenneth Skovhede
199a720870
Improved error message when db verification fails
2013-04-21 14:04:59 +02:00
Kenneth Skovhede
b7c4ff79c8
Added sorting to the compact function, so that old blocks are grouped together, as they are expected to be required longer than new blocks
2013-04-16 22:37:54 +02:00
Kenneth Skovhede
66367d662b
Fixed problem with dbpath with no path component
2013-04-09 22:59:34 +02:00
Kenneth Skovhede
39f719e094
Bugfix with cleanup
2013-04-09 20:45:11 +02:00
Kenneth Skovhede
fd4510edd2
Rewrite of transaction handling, so the database is more closely mimicking the actual remote backend state.
...
This also removes all multi-threaded calls to the database as they were not working as expected.
The transactions are now used to keep the database in a sane state, but as far as possible log all messages from the connection to the database without using cross-thread requests.
Also fixed some errors with cleanup and rewrote some of the remote filename parsing and validation.
2013-04-09 20:44:53 +02:00
Kenneth Skovhede
709c4ee15a
Improved check for compacting
2013-04-08 22:29:50 +02:00
Kenneth Skovhede
765078bca4
Fixed bug where blocklisthashes would be marked as unused in volumes
2013-04-08 22:29:04 +02:00
Kenneth Skovhede
064593bc14
Removed debug output
2013-04-08 22:28:28 +02:00
Kenneth Skovhede
63be6f3afd
SQL Style fix
2013-04-08 22:25:30 +02:00
Kenneth Skovhede
91935a5315
Added shaddowblock link to keep track of what shadow files to delete
2013-04-08 22:24:54 +02:00
Kenneth Skovhede
f378d6d188
Better fix for guarding against single-volume compact attempts
2013-04-07 09:10:04 +02:00
Kenneth Skovhede
bef04017de
Bugfix
2013-04-07 09:02:55 +02:00
Kenneth Skovhede
e782d5c89d
Renamed lookup table options from *-size to *-memory to make it clearer that it affects only memory allocation
2013-04-07 08:26:40 +02:00
Kenneth Skovhede
7c5b3043a8
More work on ForestHash
2013-04-06 15:28:43 +02:00
Kenneth Skovhede
4fefbd1645
Work on the block hash format, this should be the last db-restructure
2013-04-06 13:46:58 +02:00
Kenneth Skovhede
a87d1d71ae
Overhaul that fixes some minor issues and leaves the database much cleaner after a restore.
...
Also added extra checks to the manifest to reflect the possibility of choosing another hash algorithm.
2013-04-04 20:34:26 +02:00
Kenneth Skovhede
4566ea1c3d
Refactored the local database.
...
Fixed an issue when recreating the database, the operation was not created, making compact and delete commands not working.
2013-04-03 21:06:27 +02:00
Kenneth Skovhede
a564891b79
Implemented FindLastFileVersion with and without local database support
2013-04-01 15:06:31 +02:00
Kenneth Skovhede
b09086a534
Added auto-compact after backup if the volume is small
2013-04-01 15:05:33 +02:00
Kenneth Skovhede
df60bd4fd2
Updated the compact handler to use the AsyncDownloader instead of the makeshift version it was using
2013-03-31 19:34:42 +02:00
Kenneth Skovhede
499745220d
Improved cleanup to report the file sets that reference a non-accesible block
...
Added command to allow deleting specific filesets
2013-03-31 19:33:34 +02:00
Kenneth Skovhede
2c338fecf5
Renamed the internal option name to avoid confusion
2013-03-31 19:27:32 +02:00
Kenneth Skovhede
778699326a
Added incompatible option detection
2013-03-31 19:25:59 +02:00
Kenneth Skovhede
d64449b48f
Work on the cleanup procedure, not tested yet and does not handle cases where some blocks are missing.
2013-03-30 15:23:09 +01:00
Kenneth Skovhede
cfda6c4abb
Major overhaul, which includes the option to select hash algorithm.
...
Implemented delete-all-but-n and delete-older-than.
Implemented compacting.
Added the --dry-run option, which currently works for deleting and compacting, but not restore or backup.
Added output to console for use with dry-run, and added option to redirect this to the log for use in service mode.
2013-03-27 16:06:45 +01:00
Kenneth Skovhede
c34023139f
Refactored the database to store the remote volume id instead of the filename for each block, which reduces required storage space for the local database
2013-03-22 21:56:00 +01:00
Kenneth Skovhede
ed7ed5e6c2
Fixed a bug that caused 8x larger memory to be used than what was specified
2013-03-16 12:30:29 +01:00
Kenneth Skovhede
0a80b04352
Made it possible to deactivate all cache tables
2013-03-16 10:37:57 +01:00
Kenneth Skovhede
6d2e39bb38
Added support code to work with the file-change-monitor
2013-03-15 22:04:07 +01:00
Kenneth Skovhede
7bc6c2b6ff
Rewrote the way the restore operation uses file lists for partial restore
2013-03-15 21:16:29 +01:00
Kenneth Skovhede
ac90565c39
Cleaned up some unused code
2013-03-15 21:15:51 +01:00
Kenneth Skovhede
f6a8511d77
Refactored the hash lookup.
...
Added hash lookup for metadata.
Added optional path-based lookup, which are disabled because they use a lot of memory.
2013-03-15 21:14:00 +01:00
Kenneth Skovhede
1231dc24da
Made the hash memory requirement configurable
2013-03-11 20:45:48 +01:00
Kenneth Skovhede
b7531b3766
Added double lookup for block and file hash, this reduces the execution time to half.
2013-03-11 20:13:40 +01:00
Kenneth Skovhede
11e863eb78
Fixed a bug with the hash lookup table, much faster now
2013-03-10 23:01:17 +01:00
Kenneth Skovhede
f055dfd2b4
Optimized block queries
2013-03-10 20:33:30 +01:00
Kenneth Skovhede
5863292f11
Added hash prefix lookup to reduce database pressure
2013-03-10 14:27:13 +01:00
Kenneth Skovhede
f6d963ddb9
Added extra convenience method
2013-03-10 14:25:45 +01:00
Kenneth Skovhede
513fc9b3d2
Reduced a bottleneck related to storing metadata, and added an option to avoid storing metadata
2013-03-09 13:25:50 +01:00
Kenneth Skovhede
aca4ed95cc
More work on the block hash.
...
Rewrote the backup and restore to work within a transaction as that speeds things up a lot.
Rewrote the backup procedure to generate the file list from the database, instead of on-the-fly as that is more efficient.
Re-arranged the database to use less storage on large sets of unchanged files.
2013-03-08 22:24:54 +01:00
Kenneth Skovhede