Kenneth Skovhede
30517302ea
Removed unsupported list-source-folders as that is irrelevant to ForestHash
2013-04-01 10:50:29 +02:00
Kenneth Skovhede
df60bd4fd2
Updated the compact handler to use the AsyncDownloader instead of the makeshift version it was using
2013-03-31 19:34:42 +02:00
Kenneth Skovhede
1a975d8eac
Moved the existing database file check into the operation
2013-03-31 19:33:58 +02:00
Kenneth Skovhede
499745220d
Improved cleanup to report the file sets that reference a non-accesible block
...
Added command to allow deleting specific filesets
2013-03-31 19:33:34 +02:00
Kenneth Skovhede
383e7dfeb9
Added option verification to various command
2013-03-31 19:28:46 +02:00
Kenneth Skovhede
2c338fecf5
Renamed the internal option name to avoid confusion
2013-03-31 19:27:32 +02:00
Kenneth Skovhede
778699326a
Added incompatible option detection
2013-03-31 19:25:59 +02:00
Kenneth Skovhede
d64449b48f
Work on the cleanup procedure, not tested yet and does not handle cases where some blocks are missing.
2013-03-30 15:23:09 +01:00
Kenneth Skovhede
bbfd00ad06
Added support for dry-run with restore
2013-03-29 14:13:31 +01:00
Kenneth Skovhede
5a8435408d
Added support for dry-run with backup, still need to add it for restore
2013-03-28 15:47:20 +01:00
Kenneth Skovhede
6e5a62319c
Fixed copy-paste error
2013-03-28 13:40:18 +01:00
Kenneth Skovhede
77e3e97bf3
Fixed a typo.
2013-03-27 16:10:47 +01:00
Kenneth Skovhede
09c8c4a87b
Fixed a typo.
2013-03-27 16:09:35 +01:00
Kenneth Skovhede
cfda6c4abb
Major overhaul, which includes the option to select hash algorithm.
...
Implemented delete-all-but-n and delete-older-than.
Implemented compacting.
Added the --dry-run option, which currently works for deleting and compacting, but not restore or backup.
Added output to console for use with dry-run, and added option to redirect this to the log for use in service mode.
2013-03-27 16:06:45 +01:00
Kenneth Skovhede
add22c14cb
Added options to disable checking remote storage and to avoid storing shadow files
2013-03-26 22:21:25 +01:00
Kenneth Skovhede
254b637dfd
Updated the block size to the real expected default 100kb.
...
Default activated the file path cache, after the memory issue was resolved.
2013-03-22 22:55:53 +01:00
Kenneth Skovhede
c34023139f
Refactored the database to store the remote volume id instead of the filename for each block, which reduces required storage space for the local database
2013-03-22 21:56:00 +01:00
Kenneth Skovhede
0e89e90461
Description syntax fix
2013-03-16 12:30:44 +01:00
Kenneth Skovhede
ed7ed5e6c2
Fixed a bug that caused 8x larger memory to be used than what was specified
2013-03-16 12:30:29 +01:00
Kenneth Skovhede
0a80b04352
Made it possible to deactivate all cache tables
2013-03-16 10:37:57 +01:00
Kenneth Skovhede
6d2e39bb38
Added support code to work with the file-change-monitor
2013-03-15 22:04:07 +01:00
Kenneth Skovhede
1a2034b265
Added error handling to the restore handler
2013-03-15 21:16:44 +01:00
Kenneth Skovhede
7bc6c2b6ff
Rewrote the way the restore operation uses file lists for partial restore
2013-03-15 21:16:29 +01:00
Kenneth Skovhede
ac90565c39
Cleaned up some unused code
2013-03-15 21:15:51 +01:00
Kenneth Skovhede
f6a8511d77
Refactored the hash lookup.
...
Added hash lookup for metadata.
Added optional path-based lookup, which are disabled because they use a lot of memory.
2013-03-15 21:14:00 +01:00
Kenneth Skovhede
1231dc24da
Made the hash memory requirement configurable
2013-03-11 20:45:48 +01:00
Kenneth Skovhede
b7531b3766
Added double lookup for block and file hash, this reduces the execution time to half.
2013-03-11 20:13:40 +01:00
Kenneth Skovhede
11e863eb78
Fixed a bug with the hash lookup table, much faster now
2013-03-10 23:01:17 +01:00
Kenneth Skovhede
f055dfd2b4
Optimized block queries
2013-03-10 20:33:30 +01:00
Kenneth Skovhede
5863292f11
Added hash prefix lookup to reduce database pressure
2013-03-10 14:27:13 +01:00
Kenneth Skovhede
f6d963ddb9
Added extra convenience method
2013-03-10 14:25:45 +01:00
Kenneth Skovhede
513fc9b3d2
Reduced a bottleneck related to storing metadata, and added an option to avoid storing metadata
2013-03-09 13:25:50 +01:00
Kenneth Skovhede
ab8b3e5ca1
Update issue #758
...
Removed the m_patches variable that is not used.
2013-03-08 23:18:27 +01:00
Kenneth Skovhede
dce24980dd
Update issue #797
...
Status: Fixed
Now creating folder for log path, if not already existing
2013-03-08 23:04:19 +01:00
Kenneth Skovhede
aca4ed95cc
More work on the block hash.
...
Rewrote the backup and restore to work within a transaction as that speeds things up a lot.
Rewrote the backup procedure to generate the file list from the database, instead of on-the-fly as that is more efficient.
Re-arranged the database to use less storage on large sets of unchanged files.
2013-03-08 22:24:54 +01:00
Kenneth Skovhede
a7f0c3de0b
Merge branch 'master' into sandboxes/Kenneth/ForestHash
2013-03-08 12:25:53 +01:00
Kenneth Skovhede
4f4e29638c
Fixed a problem where not supplying the tempdir option could cause a non-default value to be used.
2013-03-08 12:25:35 +01:00
kenneth@hexad.dk
e170d781f0
Resynced trunk into ForestHash
...
git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1536 59da171f-624f-0410-aa54-27559c288bec
2013-02-27 20:57:58 +00:00
kenneth@hexad.dk
be0d503951
Implemented file-extension based rules for disabling compression for already compressed files
...
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1535 59da171f-624f-0410-aa54-27559c288bec
2013-02-27 20:54:22 +00:00
kenneth@hexad.dk
a0521da54d
Initial version of the new block-based storage format.
...
Still needs a work over in terms of error handling, progress reporting, warning output, refactoring etc.
Also misses the volume reuse/reclaim algorithms.
But it passes the unit tests now, with and without a local database.
git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1526 59da171f-624f-0410-aa54-27559c288bec
2013-02-12 21:43:14 +00:00
kenneth@hexad.dk
6a0c6b583e
Merged r1500 into trunk, reintegrated branch sandboxes/Aaron/issue331
...
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1512 59da171f-624f-0410-aa54-27559c288bec
2013-01-22 19:20:19 +00:00
kenneth@hexad.dk
f8dc5bbafd
Added the "Password" type to argument types for simplified handling of password masking.
...
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1509 59da171f-624f-0410-aa54-27559c288bec
2013-01-22 09:28:43 +00:00
kenneth@hexad.dk
4a5a1dec41
Update issue #236
...
Updated to fix incorrect reporting of default options --tempdir and --volsize
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1508 59da171f-624f-0410-aa54-27559c288bec
2013-01-21 11:43:41 +00:00
kenneth@hexad.dk
9a1a1b70c2
Fixed a wrong type on the disable-filetime-check option
...
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1505 59da171f-624f-0410-aa54-27559c288bec
2013-01-19 12:22:09 +00:00
kenneth@hexad.dk
b0b5267d46
Merged r1484 into trunk
...
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1485 59da171f-624f-0410-aa54-27559c288bec
2012-11-27 09:53:45 +00:00
kenneth@hexad.dk
93705d5b81
Updated some informative strings, thanks to feedback from Phillip
...
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1483 59da171f-624f-0410-aa54-27559c288bec
2012-11-20 09:07:20 +00:00
kenneth@hexad.dk
ca53afe000
Merged r1464 and r1465 into trunk
...
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1466 59da171f-624f-0410-aa54-27559c288bec
2012-10-08 18:48:36 +00:00
kenneth@hexad.dk
1330690187
Update issue #711
...
Status: Fixed
Now correctly parsing the "auto" option for USN and Snapshots
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1461 59da171f-624f-0410-aa54-27559c288bec
2012-10-06 12:46:04 +00:00
kenneth@hexad.dk
23515674fd
Added --backup-name to help when constructing emails and running scripts
...
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1445 59da171f-624f-0410-aa54-27559c288bec
2012-08-27 18:43:58 +00:00
kenneth@hexad.dk
a4bbe8db1d
Added some comments to the main file processing loop
...
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1443 59da171f-624f-0410-aa54-27559c288bec
2012-08-23 07:15:15 +00:00
Kenneth Skovhede