Commit Graph
4937 Commits
Author SHA1 Message Date
Kenneth Skovhede b09086a534 Added auto-compact after backup if the volume is small 2013-04-01 15:05:33 +02:00
Kenneth Skovhede a3450fa878 Missing commit 2013-04-01 15:04:41 +02:00
Kenneth Skovhede a9a67d0203 Added log warning if listing files with no local database 2013-04-01 13:05:55 +02:00
Kenneth Skovhede 30517302ea Removed unsupported list-source-folders as that is irrelevant to ForestHash 2013-04-01 10:50:29 +02:00
Kenneth Skovhede df60bd4fd2 Updated the compact handler to use the AsyncDownloader instead of the makeshift version it was using 2013-03-31 19:34:42 +02:00
Kenneth Skovhede 1a975d8eac Moved the existing database file check into the operation 2013-03-31 19:33:58 +02:00
Kenneth Skovhede 499745220d Improved cleanup to report the file sets that reference a non-accesible block
Added command to allow deleting specific filesets
2013-03-31 19:33:34 +02:00
Kenneth Skovhede 383e7dfeb9 Added option verification to various command 2013-03-31 19:28:46 +02:00
Kenneth Skovhede 2c338fecf5 Renamed the internal option name to avoid confusion 2013-03-31 19:27:32 +02:00
Kenneth Skovhede 778699326a Added incompatible option detection 2013-03-31 19:25:59 +02:00
Kenneth Skovhede d64449b48f Work on the cleanup procedure, not tested yet and does not handle cases where some blocks are missing. 2013-03-30 15:23:09 +01:00
Kenneth Skovhede bbfd00ad06 Added support for dry-run with restore 2013-03-29 14:13:31 +01:00
Kenneth Skovhede 5a8435408d Added support for dry-run with backup, still need to add it for restore 2013-03-28 15:47:20 +01:00
Kenneth Skovhede 6e5a62319c Fixed copy-paste error 2013-03-28 13:40:18 +01:00
Kenneth Skovhede 77e3e97bf3 Fixed a typo. 2013-03-27 16:10:47 +01:00
Kenneth Skovhede 09c8c4a87b Fixed a typo. 2013-03-27 16:09:35 +01:00
Kenneth Skovhede cfda6c4abb Major overhaul, which includes the option to select hash algorithm.
Implemented delete-all-but-n and delete-older-than.
Implemented compacting.
Added the --dry-run option, which currently works for deleting and compacting, but not restore or backup.
Added output to console for use with dry-run, and added option to redirect this to the log for use in service mode.
2013-03-27 16:06:45 +01:00
Kenneth Skovhede add22c14cb Added options to disable checking remote storage and to avoid storing shadow files 2013-03-26 22:21:25 +01:00
Kenneth Skovhede 254b637dfd Updated the block size to the real expected default 100kb.
Default activated the file path cache, after the memory issue was resolved.
2013-03-22 22:55:53 +01:00
Kenneth Skovhede c34023139f Refactored the database to store the remote volume id instead of the filename for each block, which reduces required storage space for the local database 2013-03-22 21:56:00 +01:00
Kenneth Skovhede 0e89e90461 Description syntax fix 2013-03-16 12:30:44 +01:00
Kenneth Skovhede ed7ed5e6c2 Fixed a bug that caused 8x larger memory to be used than what was specified 2013-03-16 12:30:29 +01:00
Kenneth Skovhede 53a6631a85 Mono-fication of projects 2013-03-16 12:07:58 +01:00
Kenneth Skovhede 0a80b04352 Made it possible to deactivate all cache tables 2013-03-16 10:37:57 +01:00
Kenneth Skovhede 6d2e39bb38 Added support code to work with the file-change-monitor 2013-03-15 22:04:07 +01:00
Kenneth Skovhede 1a2034b265 Added error handling to the restore handler 2013-03-15 21:16:44 +01:00
Kenneth Skovhede 7bc6c2b6ff Rewrote the way the restore operation uses file lists for partial restore 2013-03-15 21:16:29 +01:00
Kenneth Skovhede ac90565c39 Cleaned up some unused code 2013-03-15 21:15:51 +01:00
Kenneth Skovhede f6a8511d77 Refactored the hash lookup.
Added hash lookup for metadata.
Added optional path-based lookup, which are disabled because they use a lot of memory.
2013-03-15 21:14:00 +01:00
Kenneth Skovhede 1231dc24da Made the hash memory requirement configurable 2013-03-11 20:45:48 +01:00
Kenneth Skovhede b7531b3766 Added double lookup for block and file hash, this reduces the execution time to half. 2013-03-11 20:13:40 +01:00
Kenneth Skovhede 11e863eb78 Fixed a bug with the hash lookup table, much faster now 2013-03-10 23:01:17 +01:00
Kenneth Skovhede f055dfd2b4 Optimized block queries 2013-03-10 20:33:30 +01:00
Kenneth Skovhede 5863292f11 Added hash prefix lookup to reduce database pressure 2013-03-10 14:27:13 +01:00
Kenneth Skovhede f6d963ddb9 Added extra convenience method 2013-03-10 14:25:45 +01:00
Kenneth Skovhede 513fc9b3d2 Reduced a bottleneck related to storing metadata, and added an option to avoid storing metadata 2013-03-09 13:25:50 +01:00
Kenneth Skovhede dbea6a2680 Updated S3 backend to use location specific endpoints by default 2013-03-08 23:44:03 +01:00
Kenneth Skovhede ab8b3e5ca1 Update issue #758
Removed the m_patches variable that is not used.
2013-03-08 23:18:27 +01:00
Kenneth Skovhede dce24980dd Update issue #797
Status: Fixed

Now creating folder for log path, if not already existing
2013-03-08 23:04:19 +01:00
Kenneth Skovhede aca4ed95cc More work on the block hash.
Rewrote the backup and restore to work within a transaction as that speeds things up a lot.
Rewrote the backup procedure to generate the file list from the database, instead of on-the-fly as that is more efficient.
Re-arranged the database to use less storage on large sets of unchanged files.
2013-03-08 22:24:54 +01:00
Kenneth Skovhede a7f0c3de0b Merge branch 'master' into sandboxes/Kenneth/ForestHash 2013-03-08 12:25:53 +01:00
Kenneth Skovhede 4f4e29638c Fixed a problem where not supplying the tempdir option could cause a non-default value to be used. 2013-03-08 12:25:35 +01:00
Kenneth Skovhede c0d2f8f0e1 Merge branch 'master' into sandboxes/Kenneth/ForestHash
Conflicts:
	Duplicati.sln
	Duplicati/CommandLine/Program.cs
	Duplicati/CommandLine/Strings/Program.Designer.cs
	Duplicati/CommandLine/Strings/Program.resx
	Duplicati/CommandLine/UnitTest.cs
	Duplicati/CommandLine/help.txt
	Duplicati/GUI/Datamodel/Datamodel.csproj
	Duplicati/GUI/Duplicati.csproj
	Duplicati/GUI/Program.cs
	Duplicati/GUI/Wizard pages/RestoreSetup/FinishedRestoreSetup.cs
	Duplicati/Library/Backend/File/FileBackend.cs
	Duplicati/Library/Compression/FileArchiveDirectory.cs
	Duplicati/Library/Compression/FileArchiveZip.cs
	Duplicati/Library/Interface/ICompression.cs
	Duplicati/Library/Main/Duplicati.Library.Main.csproj
	Duplicati/Library/Main/Interface.cs
	Duplicati/Library/Main/Options.cs
	Duplicati/Library/Main/RSyncDir.cs
	Duplicati/Library/Main/Strings/Interface.Designer.cs
	Duplicati/Library/Main/Strings/Interface.resx
	Duplicati/Library/Utility/BlockingQueue.cs
	Duplicati/Library/Utility/Duplicati.Library.Utility.csproj
	Duplicati/Library/Utility/Strings/Utility.Designer.cs
	Duplicati/Library/Utility/Strings/Utility.resx
	Duplicati/Library/Utility/ThrottledStream.cs
	Duplicati/Library/Utility/Timeparser.cs
	Duplicati/Library/Utility/Utility.cs
	Duplicati/Server/Duplicati.Server.csproj
	Duplicati/Server/DuplicatiRunner.cs
	Duplicati/Server/Program.cs
2013-03-08 12:07:13 +01:00
kenneth@hexad.dk 77c82cf4f7 Fixed the single most commonly reported issue: forgetting to write file:// in front of the target URI.
It is now permitted to specify the target or source path, without the file:// prefix, but ONLY if there is also a "backup" or "restore" argument, otherwise it is not possible to infer what to do.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1538 59da171f-624f-0410-aa54-27559c288bec
2013-03-02 13:41:30 +00:00
kenneth@hexad.dk e170d781f0 Resynced trunk into ForestHash
git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1536 59da171f-624f-0410-aa54-27559c288bec
2013-02-27 20:57:58 +00:00
kenneth@hexad.dk be0d503951 Implemented file-extension based rules for disabling compression for already compressed files
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1535 59da171f-624f-0410-aa54-27559c288bec
2013-02-27 20:54:22 +00:00
kenneth@hexad.dk f317317cb5 Fixed some errors after moving the databaseupgrader into util
git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1534 59da171f-624f-0410-aa54-27559c288bec
2013-02-27 14:26:53 +00:00
kenneth@hexad.dk 310a3f5c4c Synchronized with trunk
git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1533 59da171f-624f-0410-aa54-27559c288bec
2013-02-27 14:25:14 +00:00
kenneth@hexad.dk 3b263f049d Update issue #791
Status: Fixed

Changed the command from --encrypt to --symmetric, and changed default options to blank.
Also exposed the command as an option, so it can be changed to --encrypt if anyone wants to try asymmetric encryption.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1529 59da171f-624f-0410-aa54-27559c288bec
2013-02-24 13:26:17 +00:00
kenneth@hexad.dk a0521da54d Initial version of the new block-based storage format.
Still needs a work over in terms of error handling, progress reporting, warning output, refactoring etc.
Also misses the volume reuse/reclaim algorithms.
But it passes the unit tests now, with and without a local database.

git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1526 59da171f-624f-0410-aa54-27559c288bec
2013-02-12 21:43:14 +00:00