Commit Graph
466 Commits
Author SHA1 Message Date
Kenneth Skovhede 254b637dfd Updated the block size to the real expected default 100kb.
Default activated the file path cache, after the memory issue was resolved.
2013-03-22 22:55:53 +01:00
Kenneth Skovhede c34023139f Refactored the database to store the remote volume id instead of the filename for each block, which reduces required storage space for the local database 2013-03-22 21:56:00 +01:00
Kenneth Skovhede 0e89e90461 Description syntax fix 2013-03-16 12:30:44 +01:00
Kenneth Skovhede ed7ed5e6c2 Fixed a bug that caused 8x larger memory to be used than what was specified 2013-03-16 12:30:29 +01:00
Kenneth Skovhede 53a6631a85 Mono-fication of projects 2013-03-16 12:07:58 +01:00
Kenneth Skovhede 0a80b04352 Made it possible to deactivate all cache tables 2013-03-16 10:37:57 +01:00
Kenneth Skovhede 6d2e39bb38 Added support code to work with the file-change-monitor 2013-03-15 22:04:07 +01:00
Kenneth Skovhede 1a2034b265 Added error handling to the restore handler 2013-03-15 21:16:44 +01:00
Kenneth Skovhede 7bc6c2b6ff Rewrote the way the restore operation uses file lists for partial restore 2013-03-15 21:16:29 +01:00
Kenneth Skovhede ac90565c39 Cleaned up some unused code 2013-03-15 21:15:51 +01:00
Kenneth Skovhede f6a8511d77 Refactored the hash lookup.
Added hash lookup for metadata.
Added optional path-based lookup, which are disabled because they use a lot of memory.
2013-03-15 21:14:00 +01:00
Kenneth Skovhede 1231dc24da Made the hash memory requirement configurable 2013-03-11 20:45:48 +01:00
Kenneth Skovhede b7531b3766 Added double lookup for block and file hash, this reduces the execution time to half. 2013-03-11 20:13:40 +01:00
Kenneth Skovhede 11e863eb78 Fixed a bug with the hash lookup table, much faster now 2013-03-10 23:01:17 +01:00
Kenneth Skovhede f055dfd2b4 Optimized block queries 2013-03-10 20:33:30 +01:00
Kenneth Skovhede 5863292f11 Added hash prefix lookup to reduce database pressure 2013-03-10 14:27:13 +01:00
Kenneth Skovhede f6d963ddb9 Added extra convenience method 2013-03-10 14:25:45 +01:00
Kenneth Skovhede 513fc9b3d2 Reduced a bottleneck related to storing metadata, and added an option to avoid storing metadata 2013-03-09 13:25:50 +01:00
Kenneth Skovhede aca4ed95cc More work on the block hash.
Rewrote the backup and restore to work within a transaction as that speeds things up a lot.
Rewrote the backup procedure to generate the file list from the database, instead of on-the-fly as that is more efficient.
Re-arranged the database to use less storage on large sets of unchanged files.
2013-03-08 22:24:54 +01:00
Kenneth Skovhede a7f0c3de0b Merge branch 'master' into sandboxes/Kenneth/ForestHash 2013-03-08 12:25:53 +01:00
Kenneth Skovhede 4f4e29638c Fixed a problem where not supplying the tempdir option could cause a non-default value to be used. 2013-03-08 12:25:35 +01:00
Kenneth Skovhede c0d2f8f0e1 Merge branch 'master' into sandboxes/Kenneth/ForestHash
Conflicts:
	Duplicati.sln
	Duplicati/CommandLine/Program.cs
	Duplicati/CommandLine/Strings/Program.Designer.cs
	Duplicati/CommandLine/Strings/Program.resx
	Duplicati/CommandLine/UnitTest.cs
	Duplicati/CommandLine/help.txt
	Duplicati/GUI/Datamodel/Datamodel.csproj
	Duplicati/GUI/Duplicati.csproj
	Duplicati/GUI/Program.cs
	Duplicati/GUI/Wizard pages/RestoreSetup/FinishedRestoreSetup.cs
	Duplicati/Library/Backend/File/FileBackend.cs
	Duplicati/Library/Compression/FileArchiveDirectory.cs
	Duplicati/Library/Compression/FileArchiveZip.cs
	Duplicati/Library/Interface/ICompression.cs
	Duplicati/Library/Main/Duplicati.Library.Main.csproj
	Duplicati/Library/Main/Interface.cs
	Duplicati/Library/Main/Options.cs
	Duplicati/Library/Main/RSyncDir.cs
	Duplicati/Library/Main/Strings/Interface.Designer.cs
	Duplicati/Library/Main/Strings/Interface.resx
	Duplicati/Library/Utility/BlockingQueue.cs
	Duplicati/Library/Utility/Duplicati.Library.Utility.csproj
	Duplicati/Library/Utility/Strings/Utility.Designer.cs
	Duplicati/Library/Utility/Strings/Utility.resx
	Duplicati/Library/Utility/ThrottledStream.cs
	Duplicati/Library/Utility/Timeparser.cs
	Duplicati/Library/Utility/Utility.cs
	Duplicati/Server/Duplicati.Server.csproj
	Duplicati/Server/DuplicatiRunner.cs
	Duplicati/Server/Program.cs
2013-03-08 12:07:13 +01:00
kenneth@hexad.dk 77c82cf4f7 Fixed the single most commonly reported issue: forgetting to write file:// in front of the target URI.
It is now permitted to specify the target or source path, without the file:// prefix, but ONLY if there is also a "backup" or "restore" argument, otherwise it is not possible to infer what to do.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1538 59da171f-624f-0410-aa54-27559c288bec
2013-03-02 13:41:30 +00:00
kenneth@hexad.dk e170d781f0 Resynced trunk into ForestHash
git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1536 59da171f-624f-0410-aa54-27559c288bec
2013-02-27 20:57:58 +00:00
kenneth@hexad.dk be0d503951 Implemented file-extension based rules for disabling compression for already compressed files
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1535 59da171f-624f-0410-aa54-27559c288bec
2013-02-27 20:54:22 +00:00
kenneth@hexad.dk f317317cb5 Fixed some errors after moving the databaseupgrader into util
git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1534 59da171f-624f-0410-aa54-27559c288bec
2013-02-27 14:26:53 +00:00
kenneth@hexad.dk 310a3f5c4c Synchronized with trunk
git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1533 59da171f-624f-0410-aa54-27559c288bec
2013-02-27 14:25:14 +00:00
kenneth@hexad.dk 3b263f049d Update issue #791
Status: Fixed

Changed the command from --encrypt to --symmetric, and changed default options to blank.
Also exposed the command as an option, so it can be changed to --encrypt if anyone wants to try asymmetric encryption.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1529 59da171f-624f-0410-aa54-27559c288bec
2013-02-24 13:26:17 +00:00
kenneth@hexad.dk a0521da54d Initial version of the new block-based storage format.
Still needs a work over in terms of error handling, progress reporting, warning output, refactoring etc.
Also misses the volume reuse/reclaim algorithms.
But it passes the unit tests now, with and without a local database.

git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1526 59da171f-624f-0410-aa54-27559c288bec
2013-02-12 21:43:14 +00:00
kenneth@hexad.dk 6a0c6b583e Merged r1500 into trunk, reintegrated branch sandboxes/Aaron/issue331
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1512 59da171f-624f-0410-aa54-27559c288bec
2013-01-22 19:20:19 +00:00
kenneth@hexad.dk bc099b0f97 Update issue #766
Refactored the patch from issue #766
Moved reading into a function in the utility module.
Moved parsing of file data into a function.

Added parameters to the command line client, such that the CLI may have options.
Implemented these options in the help output, so the --parameters-file can be viewed from the help.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1511 59da171f-624f-0410-aa54-27559c288bec
2013-01-22 16:12:24 +00:00
kenneth@hexad.dk f8dc5bbafd Added the "Password" type to argument types for simplified handling of password masking.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1509 59da171f-624f-0410-aa54-27559c288bec
2013-01-22 09:28:43 +00:00
kenneth@hexad.dk 4a5a1dec41 Update issue #236
Updated to fix incorrect reporting of default options --tempdir and --volsize

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1508 59da171f-624f-0410-aa54-27559c288bec
2013-01-21 11:43:41 +00:00
kenneth@hexad.dk 9a1a1b70c2 Fixed a wrong type on the disable-filetime-check option
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1505 59da171f-624f-0410-aa54-27559c288bec
2013-01-19 12:22:09 +00:00
kenneth@hexad.dk 2b2642defb Delayed the time before a compression volume is opened.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1492 59da171f-624f-0410-aa54-27559c288bec
2012-12-13 21:10:18 +00:00
kenneth@hexad.dk 8bf025134c Added option to specify multiple hashes in the hash override option
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1491 59da171f-624f-0410-aa54-27559c288bec
2012-12-08 12:54:56 +00:00
kenneth@hexad.dk b0b5267d46 Merged r1484 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1485 59da171f-624f-0410-aa54-27559c288bec
2012-11-27 09:53:45 +00:00
kenneth@hexad.dk 93705d5b81 Updated some informative strings, thanks to feedback from Phillip
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1483 59da171f-624f-0410-aa54-27559c288bec
2012-11-20 09:07:20 +00:00
kenneth@hexad.dk f256d2cfa8 Reintegrated sandbox Andreas/webui into trunk, as that is what we will be using onwards
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1482 59da171f-624f-0410-aa54-27559c288bec
2012-11-18 16:24:32 +00:00
kenneth@hexad.dk 534d2a2ab7 Updated S3 backend with new AWS Sydney region
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1475 59da171f-624f-0410-aa54-27559c288bec
2012-11-17 12:27:43 +00:00
kenneth@hexad.dk c6f2fe9a5b Fixed a spelling error, thanks to Phillip!
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1474 59da171f-624f-0410-aa54-27559c288bec
2012-11-13 12:46:26 +00:00
kenneth@hexad.dk 86e19e76f8 Fixed a bug where the sendmail-levels were reported as invalid.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1473 59da171f-624f-0410-aa54-27559c288bec
2012-11-03 18:27:37 +00:00
kenneth@hexad.dk ca53afe000 Merged r1464 and r1465 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1466 59da171f-624f-0410-aa54-27559c288bec
2012-10-08 18:48:36 +00:00
kenneth@hexad.dk 1330690187 Update issue #711
Status: Fixed

Now correctly parsing the "auto" option for USN and Snapshots

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1461 59da171f-624f-0410-aa54-27559c288bec
2012-10-06 12:46:04 +00:00
kenneth@hexad.dk 4b28d6e8f2 Fixed a case where AWS returns a timestamp that is not .Net compatible.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1450 59da171f-624f-0410-aa54-27559c288bec
2012-09-08 10:39:48 +00:00
kenneth@hexad.dk 23515674fd Added --backup-name to help when constructing emails and running scripts
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1445 59da171f-624f-0410-aa54-27559c288bec
2012-08-27 18:43:58 +00:00
kenneth@hexad.dk a4bbe8db1d Added some comments to the main file processing loop
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1443 59da171f-624f-0410-aa54-27559c288bec
2012-08-23 07:15:15 +00:00
kenneth@hexad.dk 806f9fcad5 Fixed a bug introduced with r1437 that could cause backups to generate infinite set of empty volumes.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1441 59da171f-624f-0410-aa54-27559c288bec
2012-08-23 07:07:52 +00:00
kenneth@hexad.dk fa97957296 Fixed a bug introduced with r1381 that could cause incomplete backups.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1437 59da171f-624f-0410-aa54-27559c288bec
2012-08-22 09:49:11 +00:00
kenneth@hexad.dk 6822fc69fa Update issue #29
This adds the email feature to Duplicati.
Currently there is no GUI for this, just advanced options.
The options supported are:
--send-mail-to="Name <test@example.com>, Other <test2@example.com>, test3@example.com"
--send-mail-from="Backup Admin <admin@example.com>
--send-mail-subject="Duplicati %OPERATIONNAME% Report"
--send-mail-body="%RESULT%%"
--send-mail-url="tls://smtp.google.com:587"
--send-mail-username="username"
--send-mail-password="password"
--send-mail-level="Warning"
--send-mail-any-operation=true

The only required setting is --send-mail-to.
If the --send-mail-from is not set, it will use the host of the "to" and set "no-reply@" in front.
E.g. --send-mail-to="name@example.com" will cause the sender to be "no-reply@example.com".

If the --send-mail-url is not set, a DNS lookup will find the MX record for the first recipient domain,
and send directly to that. The url can be either "smtp://server:port" or "tis://server:port".

The --send-mail-subject and --send-mail-body parameters can contain placeholders like %RESULT%.
Each option will be exported like this, e.g. %volsize% or %use-ssl%. The special placeholders are:
%RESULT% - The result/log of the backup
%OPERATIONNAME% - The name of the operation, usually "Backup", but could be "Restore" etc.
%REMOTEURL% - The backend url
%LOCALPATH% - The path to the local folders involved (i.e. the folders being backed up)

The --send-mail-level can be either "Success", "Warning" or "Error". Default "Success" means all backups generate an email. "Warning" will only send an email if the backup caused a warning or an error. "Error" will only send an email if the backup failed.

The --send-mail-any-operation can be set to "true" if all operations (e.g. "Restore", "Cleanup", "DeleteAllButN", ...) should generate an email. By default only backup operations will send an email.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1436 59da171f-624f-0410-aa54-27559c288bec
2012-08-21 09:35:55 +00:00