Commit Graph
3969 Commits
Author SHA1 Message Date
kenneth@hexad.dk 806f9fcad5 Fixed a bug introduced with r1437 that could cause backups to generate infinite set of empty volumes.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1441 59da171f-624f-0410-aa54-27559c288bec
2012-08-23 07:07:52 +00:00
kenneth@hexad.dk fa97957296 Fixed a bug introduced with r1381 that could cause incomplete backups.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1437 59da171f-624f-0410-aa54-27559c288bec
2012-08-22 09:49:11 +00:00
kenneth@hexad.dk 6822fc69fa Update issue #29
This adds the email feature to Duplicati.
Currently there is no GUI for this, just advanced options.
The options supported are:
--send-mail-to="Name <test@example.com>, Other <test2@example.com>, test3@example.com"
--send-mail-from="Backup Admin <admin@example.com>
--send-mail-subject="Duplicati %OPERATIONNAME% Report"
--send-mail-body="%RESULT%%"
--send-mail-url="tls://smtp.google.com:587"
--send-mail-username="username"
--send-mail-password="password"
--send-mail-level="Warning"
--send-mail-any-operation=true

The only required setting is --send-mail-to.
If the --send-mail-from is not set, it will use the host of the "to" and set "no-reply@" in front.
E.g. --send-mail-to="name@example.com" will cause the sender to be "no-reply@example.com".

If the --send-mail-url is not set, a DNS lookup will find the MX record for the first recipient domain,
and send directly to that. The url can be either "smtp://server:port" or "tis://server:port".

The --send-mail-subject and --send-mail-body parameters can contain placeholders like %RESULT%.
Each option will be exported like this, e.g. %volsize% or %use-ssl%. The special placeholders are:
%RESULT% - The result/log of the backup
%OPERATIONNAME% - The name of the operation, usually "Backup", but could be "Restore" etc.
%REMOTEURL% - The backend url
%LOCALPATH% - The path to the local folders involved (i.e. the folders being backed up)

The --send-mail-level can be either "Success", "Warning" or "Error". Default "Success" means all backups generate an email. "Warning" will only send an email if the backup caused a warning or an error. "Error" will only send an email if the backup failed.

The --send-mail-any-operation can be set to "true" if all operations (e.g. "Restore", "Cleanup", "DeleteAllButN", ...) should generate an email. By default only backup operations will send an email.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1436 59da171f-624f-0410-aa54-27559c288bec
2012-08-21 09:35:55 +00:00
kenneth@hexad.dk b5a92cbb35 Update issue #584
Status: Fixed

Removed the non-working eu-west-1 constraint.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1433 59da171f-624f-0410-aa54-27559c288bec
2012-08-20 07:55:12 +00:00
kenneth@hexad.dk 7acbc99fe3 Fixed a bug with the script name parsing for paths with spaces.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1432 59da171f-624f-0410-aa54-27559c288bec
2012-08-17 17:25:55 +00:00
kenneth@hexad.dk 6e8fc9af27 Update issue #106
Updated implementation, and added a Windows .bat example.
Instead of using stdin the result is now written to a file, as Windows has some issues with reading stdin from a script. 

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1427 59da171f-624f-0410-aa54-27559c288bec
2012-08-16 20:00:23 +00:00
kenneth@hexad.dk da1150e6cc Added support for callbacks.
Added a run-script module.
Need to make a Windows example script

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1426 59da171f-624f-0410-aa54-27559c288bec
2012-08-15 18:33:46 +00:00
kenneth@hexad.dk 48ab8e31f4 Added reporting of symlinks.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1422 59da171f-624f-0410-aa54-27559c288bec
2012-08-07 20:14:20 +00:00
kenneth@hexad.dk 8f3d2b961f Added reporting of symlinks.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1421 59da171f-624f-0410-aa54-27559c288bec
2012-08-07 20:12:12 +00:00
kenneth@hexad.dk d83eb730f2 Update issue #678
Status: Fixed

The CLI now returns error codes.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1420 59da171f-624f-0410-aa54-27559c288bec
2012-08-07 19:36:49 +00:00
kenneth@hexad.dk 03758e68ec Fixed a bug introduced with the refactoring and filename parsing changes.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1419 59da171f-624f-0410-aa54-27559c288bec
2012-08-07 19:35:46 +00:00
kenneth@hexad.dk 65c320c22d Rewrite of the way the compression modules are used.
The number of methods required by the ICompression interface is now reduce and all handling of path conversion and text encoding is now done in the CompressionWrapper class. This should make it easier to implement a new compression module, and reduce the number of errors that occur because of filename/encoding issues.

This commit also contains a fix for reporting a sane error message if the compression module is not found/loaded.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1417 59da171f-624f-0410-aa54-27559c288bec
2012-08-07 17:42:09 +00:00
kenneth@hexad.dk 5d0df10c9e There is now an option called "vss-use-mapping" that activates DefineDosDevice and uses short DOS like paths.
I also find a little place that could be a performance problem, so maybe this fixes the issue even without the mapping.


git-svn-id: https://duplicati.googlecode.com/svn/trunk@1414 59da171f-624f-0410-aa54-27559c288bec
2012-08-06 20:17:52 +00:00
kenneth@hexad.dk 9925d7ffed Update issue #435
There is now an option called "vss-use-mapping" that activates DefineDosDevice and uses short DOS like paths.
I also find a little place that could be a performance problem, so maybe this fixes the issue even without the mapping.


git-svn-id: https://duplicati.googlecode.com/svn/trunk@1413 59da171f-624f-0410-aa54-27559c288bec
2012-08-06 20:17:23 +00:00
kenneth@hexad.dk 7081aaed9a Re-integrated the LZMA branch into trunk.
Update issue #92
Duplicati 2.0 trunk now uses SharpCompress and allows compression using LZMA (and bz2, etc.)
Big thanks to Simon Colmer for working on this!

For now the file format is still zip, but the compression inside is different.
Once SharpCompress supports 7zip write, we can add that easily. Same goes for LZMA2 compression.



git-svn-id: https://duplicati.googlecode.com/svn/trunk@1397 59da171f-624f-0410-aa54-27559c288bec
2012-08-01 19:50:40 +00:00
kenneth@hexad.dk b277f6325d Fairly large rewrite of how files and paths are handled.
This fixes issues #144, #577 and #320.

This update introduces a new options called "symlink-policy" that can be set to "store", "ignore" or "follow".
The default setting "store" means all symlinks are recorded as symlinks and recreated as symlinks on restore. This is chosen as default because it is the best replication of the actual disk contents.
Setting it to "ignore" simply means that no information is recorded about any symlinks.
And lastly, setting it to "follow" reverts to the previous default of treating symlinks as if they are normal files/folders.
Caveat: On Windows, you need Administrator privileges to create symlinks (when restoring), but not for reading them (on backup).

Since this change meant that the file attributes must be read, I also added support for the option "exclude-files-attributes", that can be used to ignore/exclude files with certain attributes, such as "hidden", "archive" or "encrypted".

Since I had to much about so much with getting the symlinks supported on Windows, I also added some extra logic to the Windows file handler, so it can now handle files and folders with up to 32k chars in the path. The logic is done so that the normal System.IO operations are used for paths with less than 260 characters (MAX_PATH), and on error or longer paths, the Win32 Unicode API is invoked. This should give maximal backwards compatibility and still allow backup and restore of files with long paths.

This commit also includes a BlockingQueue implementation that is supposed to make file/folder enumeration faster, but this has not been implemented because Duplicati depends on having a "whole world" view of the files and folders before running the backup (i.e. deeper changes required for this).


git-svn-id: https://duplicati.googlecode.com/svn/trunk@1381 59da171f-624f-0410-aa54-27559c288bec
2012-07-29 20:07:10 +00:00
kenneth@hexad.dk 282fb41605 Update issue #671
Status: Fixed

Now setting PreAuthenticate to "true" for all requests, that should speed things up a bit.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1377 59da171f-624f-0410-aa54-27559c288bec
2012-07-28 10:03:33 +00:00
kenneth@hexad.dk 35eb7b3992 Merged r1358 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1359 59da171f-624f-0410-aa54-27559c288bec
2012-07-14 10:37:56 +00:00
kenneth@hexad.dk 30c4b4b2d2 Merged r1346 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1347 59da171f-624f-0410-aa54-27559c288bec
2012-06-29 19:38:04 +00:00
kenneth@hexad.dk d3bc855521 Merged r1339 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1340 59da171f-624f-0410-aa54-27559c288bec
2012-06-26 14:19:45 +00:00
kenneth@hexad.dk b8ed92f38c Merged r1335 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1336 59da171f-624f-0410-aa54-27559c288bec
2012-06-21 20:14:26 +00:00
kenneth@hexad.dk c74092f8a9 Fixed some timeout/abort issues by implementing everything by hand, on top of the async methods.
Now the WebRequest.Timeout property ONLY affects the GetRequestStream() and GetResponse() methods as the documentation says it SHOULD.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1331 59da171f-624f-0410-aa54-27559c288bec
2012-06-06 12:55:48 +00:00
kenneth@hexad.dk 48d5729f83 Updated service/webserver to implement long poll and updated the tray icon to use the long poll update methods.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1323 59da171f-624f-0410-aa54-27559c288bec
2012-05-31 15:30:52 +00:00
kenneth@hexad.dk 0f4fa82c97 Merged r1313 and r1314 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1315 59da171f-624f-0410-aa54-27559c288bec
2012-05-21 21:39:22 +00:00
kenneth@hexad.dk d6b77fb461 Merged r1295 and r1296 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1297 59da171f-624f-0410-aa54-27559c288bec
2012-05-17 08:07:41 +00:00
kenneth@hexad.dk 722abc9d20 Updated metadata reporting to better reflect the state AFTER the action, instead of before.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1292 59da171f-624f-0410-aa54-27559c288bec
2012-05-15 17:59:40 +00:00
kenneth@hexad.dk b950d6e342 Added terabyte (TB) as size format
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1291 59da171f-624f-0410-aa54-27559c288bec
2012-05-15 17:58:51 +00:00
kenneth@hexad.dk 992abc8cb4 Fixed a bug with r1278
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1289 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 21:41:47 +00:00
kenneth@hexad.dk 47c7a8d471 I really should not commit this late :)
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1287 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 21:20:04 +00:00
kenneth@hexad.dk 33bf545224 Improved handling of forced full backups
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1285 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 21:13:08 +00:00
kenneth@hexad.dk 2701b1af43 Fixed a bug that prevented forcing full backups
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1283 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 21:09:14 +00:00
kenneth@hexad.dk b7a99e1659 Moved the date/time EPOCH value to the utility library
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1281 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 20:49:41 +00:00
kenneth@hexad.dk a93c66555b Added logging and reporting of metadata to UI
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1280 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 20:15:27 +00:00
kenneth@hexad.dk a6e0354059 Found and fixed a verification bug that was disabled due to file size not being propagated
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1278 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 20:13:26 +00:00
kenneth@hexad.dk 203778b911 Added metadata recording, for later use in the new UI.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1274 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 18:48:21 +00:00
kenneth@hexad.dk 20c3dcd8e5 Update issue #617
Status: Fixed

The googledocs backend now parses hierarchical folders in any depth, except if a folder has multiple direct parents.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1272 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 18:45:48 +00:00
kenneth@hexad.dk 90f5a7ae0c Update issue #509
Status: Fixed

The problem is that the the file-based backend returns "Directory not found" when asking for the not-yet-mounted folder.
Duplicati assumed that this error means that the folder will be created later, and thus returned an empty list,
as the folder would be empty when created. This means that the retry logic was not used. 

Backing up to an empty folder will then result in a full backup being made.

But once the files started uploading, the folder is there and the folder is not created, but it is still a full backup.

This commit changes the logic a bit, so the list operation will not return until successful and a missing folder will be created during the list operation.
This ensures that the backup does not start before there has been a successful listing of the folder. If it fails, there is the normal retry delay, which should be enough to ensure that the folder is re-mounted. There may be warnings in the log, that the auto create failed. I have removed the logic that will auto create the folder during upload, as it should no longer be possible to get to the upload stage without verifying that the folder exists.

I have also changed the logic of the --disable-autocreate-folder option, so default value is "false" if it is a backup, and "true" for any other operation, so simply issuing a "list" or "cleanup" will not create folders (it did not do that before either).


git-svn-id: https://duplicati.googlecode.com/svn/trunk@1259 59da171f-624f-0410-aa54-27559c288bec
2012-05-08 19:00:53 +00:00
kenneth@hexad.dk 7e5dd2d581 Update command line help to use a friendlier format.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1258 59da171f-624f-0410-aa54-27559c288bec
2012-05-08 18:32:31 +00:00
kenneth@hexad.dk dd3f6b575b Update issue #603
Status: Fixed

Corrected calculating the filename size in UTF-8, rather than local encoding.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1257 59da171f-624f-0410-aa54-27559c288bec
2012-05-08 18:27:12 +00:00
kenneth@hexad.dk e8eddc1acb Update issue #607
Fixed the 404 error with CloudFiles.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1256 59da171f-624f-0410-aa54-27559c288bec
2012-05-08 18:25:57 +00:00
kenneth@hexad.dk 00b274818f Added list of options in groups to source, but it is not really used yet
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1255 59da171f-624f-0410-aa54-27559c288bec
2012-05-08 18:24:40 +00:00
kenneth@hexad.dk e6bcabce5a Fixed a problem with overwriting the log file.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1248 59da171f-624f-0410-aa54-27559c288bec
2012-05-06 19:57:35 +00:00
kenneth@hexad.dk e398e9f5fb Changed AES default to not allow fallback decryption for Duplicati 2.0
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1243 59da171f-624f-0410-aa54-27559c288bec
2012-05-05 20:11:20 +00:00
kenneth@hexad.dk 2ba5e750db Update issue #595
Status: Fixed

Update the Google GData libraries to version 2.0

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1209 59da171f-624f-0410-aa54-27559c288bec
2012-04-21 21:21:03 +00:00
kenneth@hexad.dk 59da039337 Update issue #560
Status: Fixed

The domain is now set to empty instead of null

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1207 59da171f-624f-0410-aa54-27559c288bec
2012-04-19 18:49:37 +00:00
kenneth@hexad.dk 5880bf9d6c Update issue #559
Status: Fixed

The log file is now closed after each run.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1199 59da171f-624f-0410-aa54-27559c288bec
2012-04-11 19:41:13 +00:00
kenneth@hexad.dk fc4e6c1f87 Update issue #444
Status: fixed

Problem was that the backend also supports urls like: file://user:pass@\\server\path.
Now the username and password is only accepted if it does not contain slash or backslash.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1197 59da171f-624f-0410-aa54-27559c288bec
2012-04-09 18:38:51 +00:00
kenneth@hexad.dk 67ec69d1dc Fixed some error reporting with AES Encryption
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1191 59da171f-624f-0410-aa54-27559c288bec
2012-03-29 05:50:26 +00:00
kenneth@hexad.dk 917f5315c7 Changed 64bit detection to be a common property.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1190 59da171f-624f-0410-aa54-27559c288bec
2012-03-29 05:49:07 +00:00
kenneth@hexad.dk e0868ff9e5 Fixed a problem where a file could be left open if the backup was stopped.
Update issue #296

I found and fixed a situation where a single file could be left open if the backup was stopped/aborted.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1173 59da171f-624f-0410-aa54-27559c288bec
2012-03-20 20:22:43 +00:00