Commit Graph
409 Commits
Author SHA1 Message Date
kenneth@hexad.dk 03758e68ec Fixed a bug introduced with the refactoring and filename parsing changes.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1419 59da171f-624f-0410-aa54-27559c288bec
2012-08-07 19:35:46 +00:00
kenneth@hexad.dk 65c320c22d Rewrite of the way the compression modules are used.
The number of methods required by the ICompression interface is now reduce and all handling of path conversion and text encoding is now done in the CompressionWrapper class. This should make it easier to implement a new compression module, and reduce the number of errors that occur because of filename/encoding issues.

This commit also contains a fix for reporting a sane error message if the compression module is not found/loaded.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1417 59da171f-624f-0410-aa54-27559c288bec
2012-08-07 17:42:09 +00:00
kenneth@hexad.dk 5d0df10c9e There is now an option called "vss-use-mapping" that activates DefineDosDevice and uses short DOS like paths.
I also find a little place that could be a performance problem, so maybe this fixes the issue even without the mapping.


git-svn-id: https://duplicati.googlecode.com/svn/trunk@1414 59da171f-624f-0410-aa54-27559c288bec
2012-08-06 20:17:52 +00:00
kenneth@hexad.dk 9925d7ffed Update issue #435
There is now an option called "vss-use-mapping" that activates DefineDosDevice and uses short DOS like paths.
I also find a little place that could be a performance problem, so maybe this fixes the issue even without the mapping.


git-svn-id: https://duplicati.googlecode.com/svn/trunk@1413 59da171f-624f-0410-aa54-27559c288bec
2012-08-06 20:17:23 +00:00
kenneth@hexad.dk 7081aaed9a Re-integrated the LZMA branch into trunk.
Update issue #92
Duplicati 2.0 trunk now uses SharpCompress and allows compression using LZMA (and bz2, etc.)
Big thanks to Simon Colmer for working on this!

For now the file format is still zip, but the compression inside is different.
Once SharpCompress supports 7zip write, we can add that easily. Same goes for LZMA2 compression.



git-svn-id: https://duplicati.googlecode.com/svn/trunk@1397 59da171f-624f-0410-aa54-27559c288bec
2012-08-01 19:50:40 +00:00
kenneth@hexad.dk b277f6325d Fairly large rewrite of how files and paths are handled.
This fixes issues #144, #577 and #320.

This update introduces a new options called "symlink-policy" that can be set to "store", "ignore" or "follow".
The default setting "store" means all symlinks are recorded as symlinks and recreated as symlinks on restore. This is chosen as default because it is the best replication of the actual disk contents.
Setting it to "ignore" simply means that no information is recorded about any symlinks.
And lastly, setting it to "follow" reverts to the previous default of treating symlinks as if they are normal files/folders.
Caveat: On Windows, you need Administrator privileges to create symlinks (when restoring), but not for reading them (on backup).

Since this change meant that the file attributes must be read, I also added support for the option "exclude-files-attributes", that can be used to ignore/exclude files with certain attributes, such as "hidden", "archive" or "encrypted".

Since I had to much about so much with getting the symlinks supported on Windows, I also added some extra logic to the Windows file handler, so it can now handle files and folders with up to 32k chars in the path. The logic is done so that the normal System.IO operations are used for paths with less than 260 characters (MAX_PATH), and on error or longer paths, the Win32 Unicode API is invoked. This should give maximal backwards compatibility and still allow backup and restore of files with long paths.

This commit also includes a BlockingQueue implementation that is supposed to make file/folder enumeration faster, but this has not been implemented because Duplicati depends on having a "whole world" view of the files and folders before running the backup (i.e. deeper changes required for this).


git-svn-id: https://duplicati.googlecode.com/svn/trunk@1381 59da171f-624f-0410-aa54-27559c288bec
2012-07-29 20:07:10 +00:00
kenneth@hexad.dk 282fb41605 Update issue #671
Status: Fixed

Now setting PreAuthenticate to "true" for all requests, that should speed things up a bit.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1377 59da171f-624f-0410-aa54-27559c288bec
2012-07-28 10:03:33 +00:00
kenneth@hexad.dk 35eb7b3992 Merged r1358 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1359 59da171f-624f-0410-aa54-27559c288bec
2012-07-14 10:37:56 +00:00
kenneth@hexad.dk 30c4b4b2d2 Merged r1346 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1347 59da171f-624f-0410-aa54-27559c288bec
2012-06-29 19:38:04 +00:00
kenneth@hexad.dk d3bc855521 Merged r1339 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1340 59da171f-624f-0410-aa54-27559c288bec
2012-06-26 14:19:45 +00:00
kenneth@hexad.dk b8ed92f38c Merged r1335 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1336 59da171f-624f-0410-aa54-27559c288bec
2012-06-21 20:14:26 +00:00
kenneth@hexad.dk c74092f8a9 Fixed some timeout/abort issues by implementing everything by hand, on top of the async methods.
Now the WebRequest.Timeout property ONLY affects the GetRequestStream() and GetResponse() methods as the documentation says it SHOULD.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1331 59da171f-624f-0410-aa54-27559c288bec
2012-06-06 12:55:48 +00:00
kenneth@hexad.dk 48d5729f83 Updated service/webserver to implement long poll and updated the tray icon to use the long poll update methods.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1323 59da171f-624f-0410-aa54-27559c288bec
2012-05-31 15:30:52 +00:00
kenneth@hexad.dk 0f4fa82c97 Merged r1313 and r1314 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1315 59da171f-624f-0410-aa54-27559c288bec
2012-05-21 21:39:22 +00:00
kenneth@hexad.dk d6b77fb461 Merged r1295 and r1296 into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1297 59da171f-624f-0410-aa54-27559c288bec
2012-05-17 08:07:41 +00:00
kenneth@hexad.dk 722abc9d20 Updated metadata reporting to better reflect the state AFTER the action, instead of before.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1292 59da171f-624f-0410-aa54-27559c288bec
2012-05-15 17:59:40 +00:00
kenneth@hexad.dk b950d6e342 Added terabyte (TB) as size format
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1291 59da171f-624f-0410-aa54-27559c288bec
2012-05-15 17:58:51 +00:00
kenneth@hexad.dk 992abc8cb4 Fixed a bug with r1278
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1289 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 21:41:47 +00:00
kenneth@hexad.dk 47c7a8d471 I really should not commit this late :)
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1287 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 21:20:04 +00:00
kenneth@hexad.dk 33bf545224 Improved handling of forced full backups
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1285 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 21:13:08 +00:00
kenneth@hexad.dk 2701b1af43 Fixed a bug that prevented forcing full backups
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1283 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 21:09:14 +00:00
kenneth@hexad.dk b7a99e1659 Moved the date/time EPOCH value to the utility library
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1281 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 20:49:41 +00:00
kenneth@hexad.dk a93c66555b Added logging and reporting of metadata to UI
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1280 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 20:15:27 +00:00
kenneth@hexad.dk a6e0354059 Found and fixed a verification bug that was disabled due to file size not being propagated
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1278 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 20:13:26 +00:00
kenneth@hexad.dk 203778b911 Added metadata recording, for later use in the new UI.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1274 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 18:48:21 +00:00
kenneth@hexad.dk 20c3dcd8e5 Update issue #617
Status: Fixed

The googledocs backend now parses hierarchical folders in any depth, except if a folder has multiple direct parents.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1272 59da171f-624f-0410-aa54-27559c288bec
2012-05-14 18:45:48 +00:00
kenneth@hexad.dk 90f5a7ae0c Update issue #509
Status: Fixed

The problem is that the the file-based backend returns "Directory not found" when asking for the not-yet-mounted folder.
Duplicati assumed that this error means that the folder will be created later, and thus returned an empty list,
as the folder would be empty when created. This means that the retry logic was not used. 

Backing up to an empty folder will then result in a full backup being made.

But once the files started uploading, the folder is there and the folder is not created, but it is still a full backup.

This commit changes the logic a bit, so the list operation will not return until successful and a missing folder will be created during the list operation.
This ensures that the backup does not start before there has been a successful listing of the folder. If it fails, there is the normal retry delay, which should be enough to ensure that the folder is re-mounted. There may be warnings in the log, that the auto create failed. I have removed the logic that will auto create the folder during upload, as it should no longer be possible to get to the upload stage without verifying that the folder exists.

I have also changed the logic of the --disable-autocreate-folder option, so default value is "false" if it is a backup, and "true" for any other operation, so simply issuing a "list" or "cleanup" will not create folders (it did not do that before either).


git-svn-id: https://duplicati.googlecode.com/svn/trunk@1259 59da171f-624f-0410-aa54-27559c288bec
2012-05-08 19:00:53 +00:00
kenneth@hexad.dk 7e5dd2d581 Update command line help to use a friendlier format.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1258 59da171f-624f-0410-aa54-27559c288bec
2012-05-08 18:32:31 +00:00
kenneth@hexad.dk dd3f6b575b Update issue #603
Status: Fixed

Corrected calculating the filename size in UTF-8, rather than local encoding.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1257 59da171f-624f-0410-aa54-27559c288bec
2012-05-08 18:27:12 +00:00
kenneth@hexad.dk e8eddc1acb Update issue #607
Fixed the 404 error with CloudFiles.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1256 59da171f-624f-0410-aa54-27559c288bec
2012-05-08 18:25:57 +00:00
kenneth@hexad.dk 00b274818f Added list of options in groups to source, but it is not really used yet
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1255 59da171f-624f-0410-aa54-27559c288bec
2012-05-08 18:24:40 +00:00
kenneth@hexad.dk e6bcabce5a Fixed a problem with overwriting the log file.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1248 59da171f-624f-0410-aa54-27559c288bec
2012-05-06 19:57:35 +00:00
kenneth@hexad.dk e398e9f5fb Changed AES default to not allow fallback decryption for Duplicati 2.0
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1243 59da171f-624f-0410-aa54-27559c288bec
2012-05-05 20:11:20 +00:00
kenneth@hexad.dk 2ba5e750db Update issue #595
Status: Fixed

Update the Google GData libraries to version 2.0

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1209 59da171f-624f-0410-aa54-27559c288bec
2012-04-21 21:21:03 +00:00
kenneth@hexad.dk 59da039337 Update issue #560
Status: Fixed

The domain is now set to empty instead of null

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1207 59da171f-624f-0410-aa54-27559c288bec
2012-04-19 18:49:37 +00:00
kenneth@hexad.dk 5880bf9d6c Update issue #559
Status: Fixed

The log file is now closed after each run.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1199 59da171f-624f-0410-aa54-27559c288bec
2012-04-11 19:41:13 +00:00
kenneth@hexad.dk fc4e6c1f87 Update issue #444
Status: fixed

Problem was that the backend also supports urls like: file://user:pass@\\server\path.
Now the username and password is only accepted if it does not contain slash or backslash.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1197 59da171f-624f-0410-aa54-27559c288bec
2012-04-09 18:38:51 +00:00
kenneth@hexad.dk 67ec69d1dc Fixed some error reporting with AES Encryption
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1191 59da171f-624f-0410-aa54-27559c288bec
2012-03-29 05:50:26 +00:00
kenneth@hexad.dk 917f5315c7 Changed 64bit detection to be a common property.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1190 59da171f-624f-0410-aa54-27559c288bec
2012-03-29 05:49:07 +00:00
kenneth@hexad.dk e0868ff9e5 Fixed a problem where a file could be left open if the backup was stopped.
Update issue #296

I found and fixed a situation where a single file could be left open if the backup was stopped/aborted.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1173 59da171f-624f-0410-aa54-27559c288bec
2012-03-20 20:22:43 +00:00
kenneth@hexad.dk fbf88a33ea Fixed a minor reporting problem with the full backup reason
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1169 59da171f-624f-0410-aa54-27559c288bec
2012-03-20 19:44:41 +00:00
kenneth@hexad.dk 82b137f52f Update issue #573
Status: Fixed
I found the problem, it was because Duplicati was trying to read the size of the file AFTER it was moved.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1166 59da171f-624f-0410-aa54-27559c288bec
2012-03-17 21:25:40 +00:00
kenneth@hexad.dk 8bd2d7fb73 Added output message that tells why a backup was full or incremental
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1162 59da171f-624f-0410-aa54-27559c288bec
2012-03-17 20:01:29 +00:00
kenneth@hexad.dk 37ba758cf2 Added output message that tells wh
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1160 59da171f-624f-0410-aa54-27559c288bec
2012-03-17 19:45:09 +00:00
kenneth@hexad.dk 15e9d55f07 Update issue #570
Status: Fixed

Changed the way the MD4 library is loaded, as it causes conflicts with built-in MD4 libraries on some Debian/Mono setups.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1152 59da171f-624f-0410-aa54-27559c288bec
2012-02-29 10:49:21 +00:00
kenneth@hexad.dk 815c740390 Updated S3 library to use larger transmissions buffers.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1150 59da171f-624f-0410-aa54-27559c288bec
2012-02-27 14:36:32 +00:00
kenneth@hexad.dk 2debbaa001 Merged copy buffer size fix r1140, into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1141 59da171f-624f-0410-aa54-27559c288bec
2012-02-21 09:50:05 +00:00
kenneth@hexad.dk c5759142c6 Update issue #562
Status: Fixed

This sets the Content-Type, lets hope that Google does not apply validation to the Content-Type field in a future update.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@1136 59da171f-624f-0410-aa54-27559c288bec
2012-02-20 20:34:55 +00:00
kenneth@hexad.dk 0f65a589b8 Merged r1131,r1132,r1133,1134 port upper limit settings, into trunk
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1135 59da171f-624f-0410-aa54-27559c288bec
2012-02-13 08:35:35 +00:00
kenneth@hexad.dk 577ac0b82c Fixed a bug where the FTP upload verification fails due to FTP servers returning full path rather than relative path for filename
git-svn-id: https://duplicati.googlecode.com/svn/trunk@1118 59da171f-624f-0410-aa54-27559c288bec
2012-02-03 07:30:42 +00:00