Commit Graph
63 Commits
Author SHA1 Message Date
kenneth@hexad.dk c67f44d145 Merged r1413 and r1414 into trunk.
git-svn-id: https://duplicati.googlecode.com/svn/branches/1.3.x@1415 59da171f-624f-0410-aa54-27559c288bec
2012-08-06 20:45:45 +00:00
kenneth@hexad.dk 37aa102c49 Merged r1381 into 1.3.x branch including some minor fixes.
git-svn-id: https://duplicati.googlecode.com/svn/branches/1.3.x@1386 59da171f-624f-0410-aa54-27559c288bec
2012-07-31 17:34:54 +00:00
kenneth@hexad.dk cea35fc0ac Added output to the log file, even if the backend is never reached.
git-svn-id: https://duplicati.googlecode.com/svn/branches/1.3.x@1346 59da171f-624f-0410-aa54-27559c288bec
2012-06-29 19:34:06 +00:00
kenneth@hexad.dk 1ce5804884 Merged r1248, and r1255:r1259 into 1.3.2 branch
git-svn-id: https://duplicati.googlecode.com/svn/branches/1.3.2@1261 59da171f-624f-0410-aa54-27559c288bec
2012-05-08 19:21:33 +00:00
kenneth@hexad.dk f6a7a74214 Merged r1159 and 1160 to 1.3.1 branch
git-svn-id: https://duplicati.googlecode.com/svn/branches/1.3.1@1161 59da171f-624f-0410-aa54-27559c288bec
2012-03-17 19:49:49 +00:00
kenneth@hexad.dk 4caa9cc17a Applied backend logging option from r1098
git-svn-id: https://duplicati.googlecode.com/svn/branches/1.3.1@1099 59da171f-624f-0410-aa54-27559c288bec
2012-01-15 22:21:26 +00:00
kenneth.skovhede@gmail.com 87ad255acc Update issue #204
Status: Fixed

Duplicati now defaults to not upload a backup if nothing has changed.
This is indicated by a light-green check mark in the status window.
The option --upload-unchanged-backups can be set to revert to the previous way of working.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@958 59da171f-624f-0410-aa54-27559c288bec
2011-10-30 14:31:46 +00:00
kenneth.skovhede@gmail.com e88a619eb3 Update issue #458
Status: Fixed

There is now a delete transaction file being written, which should prevent cases where a large number of orphan files are detected.
If a large number of orphan files are detected, this should now be considered a real error.

I chose not to put in the cleanup button, because it would take too long for me to fit it in there, and I would rather focus on getting 2.0 ready, which will have a new UI anyway.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@957 59da171f-624f-0410-aa54-27559c288bec
2011-10-30 11:56:42 +00:00
kenneth.skovhede@gmail.com e8ec407bd8 Compacted the way retry warnings are reported in the log.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@951 59da171f-624f-0410-aa54-27559c288bec
2011-10-28 05:45:08 +00:00
kenneth.skovhede@gmail.com 41b1a5ad4a Added a protection against partial downloads
git-svn-id: https://duplicati.googlecode.com/svn/trunk@941 59da171f-624f-0410-aa54-27559c288bec
2011-10-22 14:55:06 +00:00
kenneth.skovhede@gmail.com b94350243c Microfix: Failures in upload/download/delete now show the filename
git-svn-id: https://duplicati.googlecode.com/svn/trunk@932 59da171f-624f-0410-aa54-27559c288bec
2011-10-12 09:05:52 +00:00
kenneth.skovhede@gmail.com 7ef7a98918 Update issue #251
Status: Fixed

The backend connections are now re-used.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@913 59da171f-624f-0410-aa54-27559c288bec
2011-09-24 11:39:50 +00:00
kenneth.skovhede@gmail.com 98d15230de Update issue #254
Status: Fixed

Async upload is now set to on by default 

git-svn-id: https://duplicati.googlecode.com/svn/trunk@905 59da171f-624f-0410-aa54-27559c288bec
2011-09-21 20:26:16 +00:00
kenneth.skovhede@gmail.com c85deda4c4 Updated project files to VS2010 instead of the rather outdated VS2008, this should make things easier for new people joining in.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@874 59da171f-624f-0410-aa54-27559c288bec
2011-09-09 17:10:35 +00:00
kenneth.skovhede@gmail.com a5fac822cc Added a --full-if-more-than-n-incrementals option
git-svn-id: https://duplicati.googlecode.com/svn/trunk@845 59da171f-624f-0410-aa54-27559c288bec
2011-07-27 07:10:53 +00:00
kenneth.skovhede@gmail.com db8cdd0dd2 Update issue #160
Status: Fixed

Changed to the AWSSDK library, which fixes a few quirks, but basically seems to be the Affirma version slightly renamed.



git-svn-id: https://duplicati.googlecode.com/svn/trunk@811 59da171f-624f-0410-aa54-27559c288bec
2011-06-23 21:37:14 +00:00
kenneth.skovhede@gmail.com 8600cd48a4 Update issue #352
Status: Fixed

Thanks to Livio, this is now fixed and can be toggled with the --allow-sleep command.
It will be included in the next preview release.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@807 59da171f-624f-0410-aa54-27559c288bec
2011-06-17 13:31:28 +00:00
kenneth.skovhede@gmail.com a401357291 Update issue #419
The code should now "gracefully" handle missing timestamps.
For files with no modification time, they are assigned 1. jan. 1970 00:00:00 (EPOCH).
This has the drawback that files are read fully because we cannot rely on the modification timestamp, so it may be a bit slower.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@802 59da171f-624f-0410-aa54-27559c288bec
2011-06-16 16:18:05 +00:00
kenneth.skovhede@gmail.com bbeea63ab4 Fixed a typo
git-svn-id: https://duplicati.googlecode.com/svn/trunk@753 59da171f-624f-0410-aa54-27559c288bec
2011-04-12 15:50:16 +00:00
kenneth.skovhede@gmail.com 170bb51d52 Added suggestive messages to manifest errors, issue #384
git-svn-id: https://duplicati.googlecode.com/svn/trunk@730 59da171f-624f-0410-aa54-27559c288bec
2011-03-16 20:11:20 +00:00
kenneth.skovhede@gmail.com 8eb1b26676 Added extra messages for status when uploading verification files
git-svn-id: https://duplicati.googlecode.com/svn/trunk@718 59da171f-624f-0410-aa54-27559c288bec
2011-03-11 20:12:53 +00:00
kenneth.skovhede@gmail.com c753e7c622 Changed the default filesize to be -1 to differentiate files with length = 0 from those with no reported length.
Now also stores the filename+size of signature/content files to ensure that the parsed filenames match the expected ones.
The filesize and filenames are used to verify that the remote file is complete, without downloading it.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@716 59da171f-624f-0410-aa54-27559c288bec
2011-03-11 18:42:20 +00:00
kenneth.skovhede@gmail.com b149736c81 Added an option to verify uploads by issuing a list after each put.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@715 59da171f-624f-0410-aa54-27559c288bec
2011-03-10 21:33:44 +00:00
kenneth.skovhede@gmail.com b834dab602 This commit upgrades the manifest version number to 3.
This commit includes an option to create an unencrypted verification file.
There is now a check to see if all volumes mentioned in the manifest exists,
before performing backup/restore operations.
This check is also performed on cleanup.
There is now a check that prevents auto-cleanup from removing more than
2 orphan files. 

If a delete-older-than or delete-all-but-n-full is interrupted, the leftover
files will not be auto-deleted but must be deleted with the cleanup command,
which allows the user to see what files are delete.

Update issue #360
Status: Fixed

There is now a complete verification chain, where the manifest hashes are verified backwards.


git-svn-id: https://duplicati.googlecode.com/svn/trunk@711 59da171f-624f-0410-aa54-27559c288bec
2011-03-10 18:26:38 +00:00
kenneth.skovhede@gmail.com 017d63ba63 Fixed some documentation errors and typos
git-svn-id: https://duplicati.googlecode.com/svn/trunk@661 59da171f-624f-0410-aa54-27559c288bec
2010-12-30 14:47:58 +00:00
kenneth.skovhede@gmail.com d024f621bf Fixed a potential problem that could occur if a folder is deleted after the file-list is generated.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@645 59da171f-624f-0410-aa54-27559c288bec
2010-12-27 16:33:26 +00:00
kenneth.skovhede@gmail.com 2375b8711e Minor modifications based on dicussion in group:
http://groups.google.com/group/duplicati/browse_thread/thread/f355e3af32034300

* Changed the text to indicate that the sub-page contains volumesize
* Added the options "alternate-destination-marker" and "alternate-target-paths" to the file backend
* Added the option "sorted-filelist"
* Now updates the display each second when performing a backup

git-svn-id: https://duplicati.googlecode.com/svn/trunk@636 59da171f-624f-0410-aa54-27559c288bec
2010-12-15 19:08:16 +00:00
kenneth.skovhede@gmail.com e528dc363e Minor spelling corrections
git-svn-id: https://duplicati.googlecode.com/svn/trunk@621 59da171f-624f-0410-aa54-27559c288bec
2010-12-07 21:09:54 +00:00
kenneth.skovhede@gmail.com 201df924ab Fixed some spelling errors and removed some unused strings.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@616 59da171f-624f-0410-aa54-27559c288bec
2010-12-05 13:15:54 +00:00
kenneth.skovhede@gmail.com 72b80f011a Added the hash algorithm name to the manifest
git-svn-id: https://duplicati.googlecode.com/svn/trunk@604 59da171f-624f-0410-aa54-27559c288bec
2010-11-26 16:53:46 +00:00
kenneth.skovhede@gmail.com 9b42de276f Update issue #219
Status: Fixed

Now allows 1% (max 1 hour) slack in the time difference.
Can be disabled with the --disable-time-tolerance flag.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@595 59da171f-624f-0410-aa54-27559c288bec
2010-11-21 17:53:00 +00:00
kenneth.skovhede@gmail.com 8581a4496b Update issue #247
Status: Fixed

The implementation is a mix of the the three mentioned methods (issue #247).
There is a commandline option called --open-file-policy, which can be set to 
"ignore", "snapshot" or "copy". 

The "ignore" setting does the same as previous version, simply exclude the file from the 
backup set.

If the setting is either "snapshot" or "copy", and the file it locked, it is opened in non-excusive read mode.
Once open, a in-memory signature file is generated. This is compared to the previous signature to detect changes,
just as the normal operation. If the file has not changed, the file is skipped as it would normally be.

If the file has changed and the policy is "snapshot", the file will be processed as normal,
but during the file read, a new signature is generated. This new signature is stored
in the signature archives. When writing the new signature, it is compared to the original signature.
If the file has changed during the backup operation, a warning is written to the output log.

If the policy was set to "copy", the modified file is copied to a temporary location,
while a new signature is generated. If the copy fails due to a file change, the file 
is omitted from the backup set. If the copy succeeds, the file is known to not have changed
during the first access and the copy, which gives some assurance that the file is not
actively being written, at the expense of a copy operation.

The default setting is "snapshot", because this is likely to work in most scenarios,
and potentially produces a broken file rather than guarantee a missing file (by "ignore").

Note that when reading an open file, there is always a chance that the file is being written,
so you may end up with a broken file in the backup. This is also true for the VSS and LVM snapshots,
except for VSS-aware applications.

The "copy" method is meant to minimize this risk, but there is no guarantee that the file is in an
acceptable state, just because it has not been written for any period.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@588 59da171f-624f-0410-aa54-27559c288bec
2010-11-20 13:57:12 +00:00
kenneth.skovhede@gmail.com dd44e684d1 Update issue #32
Status: Fixed

USN is now activated by default on windows, but requires Administrative privileges.
If it fails to activate, it is silently ignored, and normal filesystem enumeration is used.
Set --usn-policy to:
"on" to get a warning if it fails,
"required" to abort the backup if it fails
"off" to disable USN
"auto" to silently ignore a fail


git-svn-id: https://duplicati.googlecode.com/svn/trunk@584 59da171f-624f-0410-aa54-27559c288bec
2010-11-17 19:45:25 +00:00
kenneth.skovhede@gmail.com d372bd6630 Added a test-program to the snapshot library.
Added the --vss-exclude-writers option.

Update issue #260
Status: Fixed
I have now added a --vss-exclude-writers commandline option.
I had another look at the other supported options, and I consider this the most important.
I made the simplest possible version, so it only supports class guids, not component names
or writer instance ids.

If you need any of the other switches or the component names, please let me know.
I would also be interested in hearing that it actually works (I get no errors, but thats no proof).

You can specify multiple writers with a semicolon: --vss-exclude-writers="{d61d61c8-d73a-4eee-8cdd-f6f9786b7124};{0bada1de-01a9-4625-8278-69e735f39dd2}"
If you need the guids, you can get them with the following command in a command prompt:
vssadmin list writers

git-svn-id: https://duplicati.googlecode.com/svn/trunk@574 59da171f-624f-0410-aa54-27559c288bec
2010-11-02 21:02:58 +00:00
kenneth.skovhede@gmail.com b69935e0cc Update issue #264
Status: Fixed
Added a find-last-version command to the commandline version,
it takes the same input as a restore operation, so
use --file-to-restore to supply a list of files to search for.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@559 59da171f-624f-0410-aa54-27559c288bec
2010-10-23 13:10:54 +00:00
kenneth.skovhede@gmail.com 6cbe503d28 The logic for missing folders on the backends have changed.
Previously some backends autocreated a missing folder, and some threw an exception.

The new standard is that all backends throw the FolderMissingException on all access (except delete).
This means that the Test() and List() methods are now the same for all stock backends.
Third-party applications that use the backends should implement custom logic to auto-create the folders,
when the FolderMissingException is encountered.

Duplicati auto-creates missing folders, but this can be toggled through the new flag --disable-autocreate-folders.
In case the auto-create fails to detect a missing folder, there is now a "create-folder" action in the commandline version.

Update issue #102
Status: Fixed
The IBackend_v2 interface has the CreateFolder and Test methods.
The CreateFolder is exposed to the commandline interface with the action create-folder.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@558 59da171f-624f-0410-aa54-27559c288bec
2010-10-23 11:40:43 +00:00
kenneth.skovhede@gmail.com cf8e7c4890 Better support for restoring a backup with multiple source folders.
Added name support in GUI and commandline version.
When restoring from commandline, subfolders will now be named like the source folders, if only one source folder is given.
When restoring from GUI, the names will be suggested like in the commandline.
It is no longer required that the unused folders exists when restoring a multi-source backup from the GUI.
Added size tooltips to the restore GUI window with the list of backup chains.
Now correctly deletes old signature cache files, even if they use the old names.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@542 59da171f-624f-0410-aa54-27559c288bec
2010-10-12 22:22:29 +00:00
kenneth.skovhede@gmail.com 7dc0d3cee7 Fixed some issues with passwordless operations.
Update issue #235
I have now added a simple version of the collection-status command,
which shows Type, Time, Volume count and Size for each backup set,
with the incrementals listed under the full's they belong to.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@540 59da171f-624f-0410-aa54-27559c288bec
2010-10-09 16:46:52 +00:00
kenneth.skovhede@gmail.com 23ff55f957 Added better logging options to the GUI and Commandline
git-svn-id: https://duplicati.googlecode.com/svn/trunk@537 59da171f-624f-0410-aa54-27559c288bec
2010-10-09 15:43:03 +00:00
kenneth.skovhede@gmail.com f020aae238 Update issue #159
Status: Fixed
A restore now defaults to background and some filenames are also shown while restoring.
The "direct restore" option cannot run in the background as it requires the schedule to be stored in the database.
This can be fixed after version 2.0

git-svn-id: https://duplicati.googlecode.com/svn/trunk@525 59da171f-624f-0410-aa54-27559c288bec
2010-09-26 20:43:16 +00:00
kenneth.skovhede@gmail.com b81d63ea73 Fixed a bug with async uploads that caused some files to no be uploaded.
Fixed a protential race condition with warning messages and file counts (cosmetic only) when using async transfers.
Spelling correction, Seperator -> Separator.
Changed so a restore operation can also supply advanced options.
Changed the format of timestamps in filenames to follow the Duplicity convention, which removes the need for --time-separator and --use-short-filenames.
Moved the URL utility into Core, to avoid compilation errors with Monodevelop.
Reorganized the runner to better support the LiveControls on all operations rather than only for backup/restore.

Update issue #210
Status: Fixed
I have now changed the time format to follow the Duplicity naming convention.
This means that all filenames are now generated with the time set as "yyyyMMddTHHmmssZ".
This format is more portable across all platforms, and easily sortable/readable.
The drawback is that the Z indicates UTC time, so if one looks at the filenames, 
the times are not local. The motivation for this is to avoid trouble
with daylight savings time offsets.

There is full backwards compatibility as long as backups have not used more than
one character for --time-separator (only possible via commandline).
This new format means that the options --time-separator and --use-short-filenames
are now deprecated and removed from the user interface. It is possible to
access them from the advanced options page, along with the --use-old-filenames option.

If anyone needs these options for some reason, let me know, otherwise they will be removed
in a later version.



git-svn-id: https://duplicati.googlecode.com/svn/trunk@523 59da171f-624f-0410-aa54-27559c288bec
2010-09-25 12:02:14 +00:00
kenneth.skovhede@gmail.com 9b3169e33a Update issue #263
Status: Fixed
I have now added an option called --exclude-empty-folders
It excludes folders AFTER the filter has been applied, so if the folder is left empty due to the filter, the folder is not included either.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@520 59da171f-624f-0410-aa54-27559c288bec
2010-09-17 18:17:12 +00:00
kenneth.skovhede@gmail.com df085e4271 Update issue #221
Status: Fixed
Added the first generic module, a password request module.
The motivation for this is to allow the creation of custom passphrase modules.
A simple model would be to add a GUI input dialog. 
A more sophisticated version may read a passphrase to an encrypted file which contains the real passphrase or similar.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@519 59da171f-624f-0410-aa54-27559c288bec
2010-09-17 16:20:16 +00:00
kenneth.skovhede@gmail.com 3e054c2576 Added a number of error correction and detection messages to prevent the volume deletion problem created by the S3 backend bug.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@512 59da171f-624f-0410-aa54-27559c288bec
2010-09-12 21:50:09 +00:00
kenneth.skovhede@gmail.com 1aaf9c8f98 Added option to enable verbose error messages
git-svn-id: https://duplicati.googlecode.com/svn/trunk@508 59da171f-624f-0410-aa54-27559c288bec
2010-09-11 12:43:55 +00:00
kenneth.skovhede@gmail.com 8e16d51e00 Update issue #21
Status: Fixed

The backup can now proceed with a broken signature file.
A restore operation is not affected by broken signature files either,
although the restore will include previously deleted files,
if the signatures are damaged.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@492 59da171f-624f-0410-aa54-27559c288bec
2010-09-04 12:23:03 +00:00
kenneth.skovhede@gmail.com 76cac1ab86 Fixed a potential problem where the folder names where stored
in the local format (eg. using backslash). This could
create trouble if the backup was made on windows and restored
on linux.

Update issue #229
Status: Fixed

I have updated the code to store the correct time for the
files, as well as the folders. The folder timestamp
adds a slight overhead to the volumes, as Zip
archives have no folder entries, so the timestamps
for folders are kept in a separate file.

The time stored in the existing archives is the date the backup 
was made, not the last modified time, so it is not possible to 
restore the modification date for existing archives.
When restoring new archives, the correct date is set
for both files and folders.
When restoring older archives, the backup date is used
for files, and nothing is done for folders.

I also changed the internal storage to use UTC time format
for all timestamps to avoid problems with backup/restores on
machines with different timezones.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@484 59da171f-624f-0410-aa54-27559c288bec
2010-08-31 19:50:52 +00:00
kenneth.skovhede@gmail.com b079ece335 Update issue #90.
Status: Fixed

I have fixed a number of UI issues when using async uploads.
For one, the pause/stop features now work.

If the progress is paused, a upload progressbar will be displayed,
so the progress does not appear to hang.

When the backup is complete, the remaining uploads
are now done as normal, resulting in a normal UI display with progress.

I have also reserved some space on the progress bar for cleanup,
and inserted a status message indicating that the cleanup is in progress.

The async now works so well, that I think it should be on by default.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@482 59da171f-624f-0410-aa54-27559c288bec
2010-08-25 20:59:47 +00:00
kenneth.skovhede@gmail.com a89b532a40 Fixed a minor bug introduced by the configurable async volume folder.
Also modified the help text for the async folder location to clarify that it also works for synchronous uploads.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@478 59da171f-624f-0410-aa54-27559c288bec
2010-08-20 21:28:28 +00:00
kenneth.skovhede@gmail.com ebe68c9c70 Fixes issue #110.
Also fixed a bug with the "allow-full-removal" option.

Update issue 110
I have now added a limit to the number of generated volumes, and as described, it is 2 by default.
I have also added support for setting a custom folder where the volumes are placed in. They are placed in the temp folder by default.

I re-read the comments on this issue, and I can see that I misread the statements from Baris.Eris.
This limit does not prevent any volumes from being uploaded (you can use the --totalsize option for that),
it just pauses the volume generation when there are already two or more volumes waiting to be uploaded.
As soon as a volume is uploaded, the program continues. The purpose of this is not to limit the data being
uploaded, but rather to prevent spamming the disk with hundreds of volumes.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@476 59da171f-624f-0410-aa54-27559c288bec
2010-08-17 16:09:36 +00:00