Commit Graph
136 Commits
Author SHA1 Message Date
Kenneth Skovhede b78f7ab8a3 Merge branch 'master' into sandboxes/Kenneth/ForestHash
Conflicts:
	Duplicati/Library/Utility/Duplicati.Library.Utility.csproj
2013-05-05 23:52:01 +02:00
Kenneth Skovhede e5b3f0ea93 Rewrote all backends to use the new Uri parser.
Updated the regex to be a little more forgiving.
Does not handle paths with @, like "ftp://server/@folder"
2013-05-05 23:46:00 +02:00
Kenneth Skovhede 211edcffdd Some cleanup after removing the old format 2013-05-05 18:14:27 +02:00
Kenneth Skovhede c7836ce403 Removed support for the old file format 2013-05-05 17:54:59 +02:00
Kenneth Skovhede 9c5183f794 Merge branch 'master' into sandboxes/Kenneth/ForestHash
Conflicts:
	Duplicati.sln
	Duplicati/CommandLine/BackendTester/Duplicati.CommandLine.BackendTester.csproj
	Duplicati/CommandLine/Decrypter/Duplicati.CommandLine.Decrypter.csproj
	Duplicati/CommandLine/Duplicati.CommandLine.csproj
	Duplicati/GUI/Datamodel/Datamodel.csproj
	Duplicati/GUI/Duplicati.GUI.MacTrayIcon/Duplicati.GUI.MacTrayIcon.csproj
	Duplicati/GUI/Duplicati.GUI.TrayIcon/Duplicati.GUI.TrayIcon.csproj
	Duplicati/GUI/Duplicati.csproj
	Duplicati/Library/Backend/CloudFiles/Duplicati.Library.Backend.CloudFiles.csproj
	Duplicati/Library/Backend/FTP/Duplicati.Library.Backend.FTP.csproj
	Duplicati/Library/Backend/File/Duplicati.Library.Backend.File.csproj
	Duplicati/Library/Backend/GoogleDocs/Duplicati.Library.Backend.GoogleDocs.csproj
	Duplicati/Library/Backend/S3/Duplicati.Library.Backend.S3.csproj
	Duplicati/Library/Backend/SSHv2/Duplicati.Library.Backend.SSHv2.csproj
	Duplicati/Library/Backend/TahoeLAFS/Duplicati.Library.Backend.TahoeLAFS.csproj
	Duplicati/Library/Backend/WEBDAV/Duplicati.Library.Backend.WEBDAV.csproj
	Duplicati/Library/Compression/Duplicati.Library.Compression.csproj
	Duplicati/Library/DynamicLoader/Duplicati.Library.DynamicLoader.csproj
	Duplicati/Library/Encryption/Duplicati.Library.Encryption.csproj
	Duplicati/Library/Interface/Duplicati.Library.Interface.csproj
	Duplicati/Library/Logging/Duplicati.Library.Logging.csproj
	Duplicati/Library/Main/Duplicati.Library.Main.csproj
	Duplicati/Library/Modules/Builtin/Duplicati.Library.Modules.Builtin.csproj
	Duplicati/Library/SharpRSync/Duplicati.Library.SharpRSync.csproj
	Duplicati/Library/Snapshots/Duplicati.Library.Snapshots.csproj
	Duplicati/Library/Utility/Duplicati.Library.Utility.csproj
	Duplicati/License/Duplicati.License.csproj
	Duplicati/Server/Duplicati.Server.Serialization/Duplicati.Server.Serialization.csproj
	Duplicati/Server/Duplicati.Server.csproj
	Duplicati/Winforms/Controls/Duplicati.Winforms.Controls.csproj
	WizardForm/WizardForm.csproj
2013-05-05 13:55:18 +02:00
Kenneth Skovhede 066e4e6106 Fixed some bugs with the new url-parsing system 2013-05-05 13:09:55 +02:00
Kenneth Skovhede 93bdb2a434 Merge branch 'master' into sandboxes/Kenneth/ForestHash
Conflicts:
	Duplicati/CommandLine/Help.cs
	Duplicati/CommandLine/Program.cs
	Duplicati/Library/Main/Strings/Interface.Designer.cs
	Duplicati/Library/Main/Strings/Interface.resx
	Duplicati/Library/Main/Strings/Options.Designer.cs
	Duplicati/Library/Main/Strings/Options.resx
2013-05-04 14:07:04 +02:00
Kenneth Skovhede 65b4efdfab Added method to scrub filenames from database 2013-04-22 21:20:14 +02:00
Kenneth Skovhede cba82103a6 Added best-effort restore option 2013-04-21 21:04:43 +02:00
Kenneth Skovhede f40c6275aa Cleanup that fixes leftover temporary files 2013-04-16 22:36:19 +02:00
Kenneth Skovhede 6ff1f39540 Fixed a bug in the missing file report and end-of-backup check 2013-04-05 10:22:00 +02:00
Kenneth Skovhede f55b5acf1e Added filenames of missing files to error messages. 2013-04-03 21:11:16 +02:00
Kenneth Skovhede 30517302ea Removed unsupported list-source-folders as that is irrelevant to ForestHash 2013-04-01 10:50:29 +02:00
Kenneth Skovhede 499745220d Improved cleanup to report the file sets that reference a non-accesible block
Added command to allow deleting specific filesets
2013-03-31 19:33:34 +02:00
Kenneth Skovhede cfda6c4abb Major overhaul, which includes the option to select hash algorithm.
Implemented delete-all-but-n and delete-older-than.
Implemented compacting.
Added the --dry-run option, which currently works for deleting and compacting, but not restore or backup.
Added output to console for use with dry-run, and added option to redirect this to the log for use in service mode.
2013-03-27 16:06:45 +01:00
Kenneth Skovhede dce24980dd Update issue #797
Status: Fixed

Now creating folder for log path, if not already existing
2013-03-08 23:04:19 +01:00
Kenneth Skovhede aca4ed95cc More work on the block hash.
Rewrote the backup and restore to work within a transaction as that speeds things up a lot.
Rewrote the backup procedure to generate the file list from the database, instead of on-the-fly as that is more efficient.
Re-arranged the database to use less storage on large sets of unchanged files.
2013-03-08 22:24:54 +01:00
Kenneth Skovhede a7f0c3de0b Merge branch 'master' into sandboxes/Kenneth/ForestHash 2013-03-08 12:25:53 +01:00
Kenneth Skovhede 4f4e29638c Fixed a problem where not supplying the tempdir option could cause a non-default value to be used. 2013-03-08 12:25:35 +01:00
kenneth@hexad.dk e170d781f0 Resynced trunk into ForestHash
git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1536 59da171f-624f-0410-aa54-27559c288bec
2013-02-27 20:57:58 +00:00
kenneth@hexad.dk be0d503951 Implemented file-extension based rules for disabling compression for already compressed files
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1535 59da171f-624f-0410-aa54-27559c288bec
2013-02-27 20:54:22 +00:00
kenneth@hexad.dk a0521da54d Initial version of the new block-based storage format.
Still needs a work over in terms of error handling, progress reporting, warning output, refactoring etc.
Also misses the volume reuse/reclaim algorithms.
But it passes the unit tests now, with and without a local database.

git-svn-id: https://duplicati.googlecode.com/svn/sandboxes/Kenneth/ForestHash@1526 59da171f-624f-0410-aa54-27559c288bec
2013-02-12 21:43:14 +00:00
kenneth@hexad.dk 4a5a1dec41 Update issue #236
Updated to fix incorrect reporting of default options --tempdir and --volsize

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1508 59da171f-624f-0410-aa54-27559c288bec
2013-01-21 11:43:41 +00:00
kenneth@hexad.dk da1150e6cc Added support for callbacks.
Added a run-script module.
Need to make a Windows example script

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1426 59da171f-624f-0410-aa54-27559c288bec
2012-08-15 18:33:46 +00:00
kenneth@hexad.dk d83eb730f2 Update issue #678
Status: Fixed

The CLI now returns error codes.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1420 59da171f-624f-0410-aa54-27559c288bec
2012-08-07 19:36:49 +00:00
kenneth@hexad.dk 65c320c22d Rewrite of the way the compression modules are used.
The number of methods required by the ICompression interface is now reduce and all handling of path conversion and text encoding is now done in the CompressionWrapper class. This should make it easier to implement a new compression module, and reduce the number of errors that occur because of filename/encoding issues.

This commit also contains a fix for reporting a sane error message if the compression module is not found/loaded.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1417 59da171f-624f-0410-aa54-27559c288bec
2012-08-07 17:42:09 +00:00
kenneth@hexad.dk 30c4b4b2d2 Merged r1346 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1347 59da171f-624f-0410-aa54-27559c288bec
2012-06-29 19:38:04 +00:00
kenneth@hexad.dk d6b77fb461 Merged r1295 and r1296 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1297 59da171f-624f-0410-aa54-27559c288bec
2012-05-17 08:07:41 +00:00
kenneth@hexad.dk 722abc9d20 Updated metadata reporting to better reflect the state AFTER the action, instead of before.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1292 59da171f-624f-0410-aa54-27559c288bec
2012-05-15 17:59:40 +00:00
kenneth@hexad.dk 47c7a8d471 I really should not commit this late :)
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1287 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 21:20:04 +00:00
kenneth@hexad.dk 33bf545224 Improved handling of forced full backups
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1285 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 21:13:08 +00:00
kenneth@hexad.dk 2701b1af43 Fixed a bug that prevented forcing full backups
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1283 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 21:09:14 +00:00
kenneth@hexad.dk 203778b911 Added metadata recording, for later use in the new UI.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1274 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 18:48:21 +00:00
kenneth@hexad.dk 90f5a7ae0c Update issue #509
Status: Fixed

The problem is that the the file-based backend returns "Directory not found" when asking for the not-yet-mounted folder.
Duplicati assumed that this error means that the folder will be created later, and thus returned an empty list,
as the folder would be empty when created. This means that the retry logic was not used. 

Backing up to an empty folder will then result in a full backup being made.

But once the files started uploading, the folder is there and the folder is not created, but it is still a full backup.

This commit changes the logic a bit, so the list operation will not return until successful and a missing folder will be created during the list operation.
This ensures that the backup does not start before there has been a successful listing of the folder. If it fails, there is the normal retry delay, which should be enough to ensure that the folder is re-mounted. There may be warnings in the log, that the auto create failed. I have removed the logic that will auto create the folder during upload, as it should no longer be possible to get to the upload stage without verifying that the folder exists.

I have also changed the logic of the --disable-autocreate-folder option, so default value is "false" if it is a backup, and "true" for any other operation, so simply issuing a "list" or "cleanup" will not create folders (it did not do that before either).


git-svn-id: https://duplicati.googlecode.com/svn/trunk@1259 59da171f-624f-0410-aa54-27559c288bec
2012-05-08 19:00:53 +00:00
kenneth@hexad.dk 00b274818f Added list of options in groups to source, but it is not really used yet
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1255 59da171f-624f-0410-aa54-27559c288bec
2012-05-08 18:24:40 +00:00
kenneth@hexad.dk 5880bf9d6c Update issue #559
Status: Fixed

The log file is now closed after each run.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1199 59da171f-624f-0410-aa54-27559c288bec
2012-04-11 19:41:13 +00:00
kenneth@hexad.dk fbf88a33ea Fixed a minor reporting problem with the full backup reason
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1169 59da171f-624f-0410-aa54-27559c288bec
2012-03-20 19:44:41 +00:00
kenneth@hexad.dk 8bd2d7fb73 Added output message that tells why a backup was full or incremental
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1162 59da171f-624f-0410-aa54-27559c288bec
2012-03-17 20:01:29 +00:00
kenneth@hexad.dk 37ba758cf2 Added output message that tells wh
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1160 59da171f-624f-0410-aa54-27559c288bec
2012-03-17 19:45:09 +00:00
kenneth@hexad.dk 72ff1b1bc3 Added option to log operations and expected backend state for debugging purposes.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1098 59da171f-624f-0410-aa54-27559c288bec
2012-01-15 22:15:22 +00:00
kenneth@hexad.dk d776d7d6d5 Update issue #515
Uploading a full backup will always leave files, even if the backup was empty.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1043 59da171f-624f-0410-aa54-27559c288bec
2011-11-29 09:10:54 +00:00
kenneth.skovhede@gmail.com 87ad255acc Update issue #204
Status: Fixed

Duplicati now defaults to not upload a backup if nothing has changed.
This is indicated by a light-green check mark in the status window.
The option --upload-unchanged-backups can be set to revert to the previous way of working.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@958 59da171f-624f-0410-aa54-27559c288bec
2011-10-30 14:31:46 +00:00
kenneth.skovhede@gmail.com e88a619eb3 Update issue #458
Status: Fixed

There is now a delete transaction file being written, which should prevent cases where a large number of orphan files are detected.
If a large number of orphan files are detected, this should now be considered a real error.

I chose not to put in the cleanup button, because it would take too long for me to fit it in there, and I would rather focus on getting 2.0 ready, which will have a new UI anyway.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@957 59da171f-624f-0410-aa54-27559c288bec
2011-10-30 11:56:42 +00:00
kenneth.skovhede@gmail.com e8ec407bd8 Compacted the way retry warnings are reported in the log.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@951 59da171f-624f-0410-aa54-27559c288bec
2011-10-28 05:45:08 +00:00
kenneth.skovhede@gmail.com 789e5e2ca8 Fixed problems where the number of parsed files are not the same as the ones in the manifest.
Update issue #484
Status: Fixed

There is now a detection for situations where a manifest is missed, but signature/content files are uploaded.
This should fix all errors with a message like "N volumes found but the manifest indicates X" where N-X <= 2.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@942 59da171f-624f-0410-aa54-27559c288bec
2011-10-22 14:59:47 +00:00
kenneth.skovhede@gmail.com c138d1668e Added the delete-all-but-n command
git-svn-id: https://duplicati.googlecode.com/svn/trunk@939 59da171f-624f-0410-aa54-27559c288bec
2011-10-19 05:50:10 +00:00
kenneth.skovhede@gmail.com a5fac822cc Added a --full-if-more-than-n-incrementals option
git-svn-id: https://duplicati.googlecode.com/svn/trunk@845 59da171f-624f-0410-aa54-27559c288bec
2011-07-27 07:10:53 +00:00
kenneth.skovhede@gmail.com 65c169b248 Fixed a bug with fake urls that are invalid (eg. spaces in hostname).
git-svn-id: https://duplicati.googlecode.com/svn/trunk@822 59da171f-624f-0410-aa54-27559c288bec
2011-06-30 07:26:07 +00:00
kenneth.skovhede@gmail.com 8600cd48a4 Update issue #352
Status: Fixed

Thanks to Livio, this is now fixed and can be toggled with the --allow-sleep command.
It will be included in the next preview release.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@807 59da171f-624f-0410-aa54-27559c288bec
2011-06-17 13:31:28 +00:00
kenneth.skovhede@gmail.com b0a359fd27 Updated license text
git-svn-id: https://duplicati.googlecode.com/svn/trunk@770 59da171f-624f-0410-aa54-27559c288bec
2011-05-09 19:52:28 +00:00