Commit Graph
3969 Commits
Author SHA1 Message Date
kenneth.skovhede@gmail.com 0c69798513 Fixed a copy/paste error for the USN policy
git-svn-id: https://duplicati.googlecode.com/svn/trunk@603 59da171f-624f-0410-aa54-27559c288bec
2010-11-26 16:52:53 +00:00
kenneth.skovhede@gmail.com 6048453a28 Update issue #304
Oops!
Yes, that would explain why it wasn't applied either.
Thanks.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@600 59da171f-624f-0410-aa54-27559c288bec
2010-11-21 19:51:47 +00:00
kenneth.skovhede@gmail.com 86c0d55ed4 Fixed reporting the correct backup type
git-svn-id: https://duplicati.googlecode.com/svn/trunk@599 59da171f-624f-0410-aa54-27559c288bec
2010-11-21 19:44:35 +00:00
kenneth.skovhede@gmail.com db9fdaf0fb Fixed a missed rename Core -> Utility
git-svn-id: https://duplicati.googlecode.com/svn/trunk@597 59da171f-624f-0410-aa54-27559c288bec
2010-11-21 18:00:33 +00:00
kenneth.skovhede@gmail.com 9b42de276f Update issue #219
Status: Fixed

Now allows 1% (max 1 hour) slack in the time difference.
Can be disabled with the --disable-time-tolerance flag.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@595 59da171f-624f-0410-aa54-27559c288bec
2010-11-21 17:53:00 +00:00
kenneth.skovhede@gmail.com 93ed07b879 Update issue #304
Status: Fixed
Yes, nicely spotted, thanks for reporting.

It seems that the settings was actually saved and applied,
but just didn't show up, so a re-save would clear it.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@594 59da171f-624f-0410-aa54-27559c288bec
2010-11-21 12:11:21 +00:00
kenneth.skovhede@gmail.com e7dc268fad Renamed the Duplicati.Library.Core dll to Duplicati.Library.Utility as the "Core" name was misleading.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@591 59da171f-624f-0410-aa54-27559c288bec
2010-11-21 11:08:15 +00:00
kenneth.skovhede@gmail.com 3b34747b4f Update issue #301
I certainly don't mind fixing minor issues.
Spelling errors have a tendency to make the product look
incomplete, so I appreciate spelling error reports.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@590 59da171f-624f-0410-aa54-27559c288bec
2010-11-21 10:25:39 +00:00
kenneth.skovhede@gmail.com 958f57485d Updated some resx generated files
git-svn-id: https://duplicati.googlecode.com/svn/trunk@589 59da171f-624f-0410-aa54-27559c288bec
2010-11-20 16:36:17 +00:00
kenneth.skovhede@gmail.com 8581a4496b Update issue #247
Status: Fixed

The implementation is a mix of the the three mentioned methods (issue #247).
There is a commandline option called --open-file-policy, which can be set to 
"ignore", "snapshot" or "copy". 

The "ignore" setting does the same as previous version, simply exclude the file from the 
backup set.

If the setting is either "snapshot" or "copy", and the file it locked, it is opened in non-excusive read mode.
Once open, a in-memory signature file is generated. This is compared to the previous signature to detect changes,
just as the normal operation. If the file has not changed, the file is skipped as it would normally be.

If the file has changed and the policy is "snapshot", the file will be processed as normal,
but during the file read, a new signature is generated. This new signature is stored
in the signature archives. When writing the new signature, it is compared to the original signature.
If the file has changed during the backup operation, a warning is written to the output log.

If the policy was set to "copy", the modified file is copied to a temporary location,
while a new signature is generated. If the copy fails due to a file change, the file 
is omitted from the backup set. If the copy succeeds, the file is known to not have changed
during the first access and the copy, which gives some assurance that the file is not
actively being written, at the expense of a copy operation.

The default setting is "snapshot", because this is likely to work in most scenarios,
and potentially produces a broken file rather than guarantee a missing file (by "ignore").

Note that when reading an open file, there is always a chance that the file is being written,
so you may end up with a broken file in the backup. This is also true for the VSS and LVM snapshots,
except for VSS-aware applications.

The "copy" method is meant to minimize this risk, but there is no guarantee that the file is in an
acceptable state, just because it has not been written for any period.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@588 59da171f-624f-0410-aa54-27559c288bec
2010-11-20 13:57:12 +00:00
kenneth.skovhede@gmail.com 302c363565 Changed SharpRSync to output an .exe file, so it doubles as a windows version of rdiff
git-svn-id: https://duplicati.googlecode.com/svn/trunk@585 59da171f-624f-0410-aa54-27559c288bec
2010-11-17 19:49:36 +00:00
kenneth.skovhede@gmail.com dd44e684d1 Update issue #32
Status: Fixed

USN is now activated by default on windows, but requires Administrative privileges.
If it fails to activate, it is silently ignored, and normal filesystem enumeration is used.
Set --usn-policy to:
"on" to get a warning if it fails,
"required" to abort the backup if it fails
"off" to disable USN
"auto" to silently ignore a fail


git-svn-id: https://duplicati.googlecode.com/svn/trunk@584 59da171f-624f-0410-aa54-27559c288bec
2010-11-17 19:45:25 +00:00
kenneth.skovhede@gmail.com 8a3e280225 Fixed a restore issue with restoring volumes created prior to the multi-source split.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@577 59da171f-624f-0410-aa54-27559c288bec
2010-11-05 06:48:00 +00:00
kenneth.skovhede@gmail.com 7fcd66e569 Added a count for the number of files opened.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@576 59da171f-624f-0410-aa54-27559c288bec
2010-11-04 21:37:32 +00:00
kenneth.skovhede@gmail.com d372bd6630 Added a test-program to the snapshot library.
Added the --vss-exclude-writers option.

Update issue #260
Status: Fixed
I have now added a --vss-exclude-writers commandline option.
I had another look at the other supported options, and I consider this the most important.
I made the simplest possible version, so it only supports class guids, not component names
or writer instance ids.

If you need any of the other switches or the component names, please let me know.
I would also be interested in hearing that it actually works (I get no errors, but thats no proof).

You can specify multiple writers with a semicolon: --vss-exclude-writers="{d61d61c8-d73a-4eee-8cdd-f6f9786b7124};{0bada1de-01a9-4625-8278-69e735f39dd2}"
If you need the guids, you can get them with the following command in a command prompt:
vssadmin list writers

git-svn-id: https://duplicati.googlecode.com/svn/trunk@574 59da171f-624f-0410-aa54-27559c288bec
2010-11-02 21:02:58 +00:00
kenneth.skovhede@gmail.com 93ff6a62f8 Update issue #275
Status: Fixed
The logic was attempting to prevent a case where the backup was scheduled to run and "Run backup now" was checked.
In this special case, the "Run backup now" does nothing because the backup will run twice otherwise.
The logic was a bit flawed, so based on some various settings it would detect that it was scheduled to run,
while it was not.

Thanks to your fine description, I was able to reproduce easily and fix it.
With the regards to the other error message, I have reproduced it by doing the following without restarting:
1) create the backup
2) edit the backup
3) delete the backup

I will create a new issue for it, but the bug is deep in the database abstraction layer,
so it is pretty hard to debug.

Update issue #227
Status: Fixed
Now correctly removes the deleted task from the scheduler and updates the display.
I also managed to get a slight speedup on the display update.



git-svn-id: https://duplicati.googlecode.com/svn/trunk@572 59da171f-624f-0410-aa54-27559c288bec
2010-11-02 19:31:34 +00:00
kenneth.skovhede@gmail.com 7cddc6ae04 Fixed a bug with restore of multi-source backups, and some opened files that were not closed.
After a fix with source folder filters, the internal file "added_folders.txt"
contains the root folder entry, but not suffixed with a slash/backslash,
which caused an "index of of bounds" error when attempting to restore.

Update issue #295
Status: Fixed
I found 3 situations where an opened file was not closed.
Strange thing is that it should have been that way since the multivolume stuff was introduced.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@569 59da171f-624f-0410-aa54-27559c288bec
2010-10-29 20:54:12 +00:00
kenneth.skovhede@gmail.com 94631df620 Increased the size buffer a bit, because I saw one volume being too large.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@568 59da171f-624f-0410-aa54-27559c288bec
2010-10-29 20:50:37 +00:00
kenneth.skovhede@gmail.com 0eedae3760 Fixed an issue where a cleanup would go into an infinite loop.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@564 59da171f-624f-0410-aa54-27559c288bec
2010-10-27 21:09:11 +00:00
kenneth.skovhede@gmail.com b4b3ec526c Added CreateFolder to the list of passphrase-less operations.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@560 59da171f-624f-0410-aa54-27559c288bec
2010-10-23 13:11:31 +00:00
kenneth.skovhede@gmail.com b69935e0cc Update issue #264
Status: Fixed
Added a find-last-version command to the commandline version,
it takes the same input as a restore operation, so
use --file-to-restore to supply a list of files to search for.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@559 59da171f-624f-0410-aa54-27559c288bec
2010-10-23 13:10:54 +00:00
kenneth.skovhede@gmail.com 6cbe503d28 The logic for missing folders on the backends have changed.
Previously some backends autocreated a missing folder, and some threw an exception.

The new standard is that all backends throw the FolderMissingException on all access (except delete).
This means that the Test() and List() methods are now the same for all stock backends.
Third-party applications that use the backends should implement custom logic to auto-create the folders,
when the FolderMissingException is encountered.

Duplicati auto-creates missing folders, but this can be toggled through the new flag --disable-autocreate-folders.
In case the auto-create fails to detect a missing folder, there is now a "create-folder" action in the commandline version.

Update issue #102
Status: Fixed
The IBackend_v2 interface has the CreateFolder and Test methods.
The CreateFolder is exposed to the commandline interface with the action create-folder.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@558 59da171f-624f-0410-aa54-27559c288bec
2010-10-23 11:40:43 +00:00
kenneth.skovhede@gmail.com 739fa5ad1b Optimized the use of timestamps to prevent file content checking.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@556 59da171f-624f-0410-aa54-27559c288bec
2010-10-23 08:58:24 +00:00
kenneth.skovhede@gmail.com 5e4162e1a7 Fixed a bug with SharpRSync commandline unittest.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@549 59da171f-624f-0410-aa54-27559c288bec
2010-10-19 06:16:32 +00:00
kenneth.skovhede@gmail.com 8f41ee39a2 Update issue #283
I have now fixed the issue, and tested it on the file provided.
It seems to compress better now, although the file contains sporadic changes,
even if only a single line was added. The restore also works as expected,
and the update works on my unittest.

Could you please try the updated version and see if it works as expected for you as well?

With regards to the "no else statement" (comment 7), I think that you discovered another
bug, which I have also fixed. The else statement is there to ensure that the buffer is completely filled,
so long chains of unmatched data gets written with as few commands as possible. So, on the first entry,
the copy command is flushed and the force_buffer_refill is set, causing the buffer to refill.
The bug was that IF the buffer was already full, the stream would read 0 bytes, and return a count of 0.
This was then interpreted as if the stream was empty (it returns zero when empty). I have now fixed that
with a check for this special case.

I have also included an update to the ChecksumFileReader that splits the previous m_weakTable into two
separate arrays, as that gives a faster lookup, than using a custom comparer. I also added support for
very large files (files larger than blocksize * int.MaxValue, appx. 4TB).

git-svn-id: https://duplicati.googlecode.com/svn/trunk@548 59da171f-624f-0410-aa54-27559c288bec
2010-10-18 20:48:59 +00:00
kenneth.skovhede@gmail.com 0da110ca99 Fixed a race-condition where an abort at a specific time would cause a thread to crash.
Only happens if the backend is unmanaged ssh, and is pretty hard to hit.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@547 59da171f-624f-0410-aa54-27559c288bec
2010-10-15 16:52:03 +00:00
kenneth.skovhede@gmail.com cf8e7c4890 Better support for restoring a backup with multiple source folders.
Added name support in GUI and commandline version.
When restoring from commandline, subfolders will now be named like the source folders, if only one source folder is given.
When restoring from GUI, the names will be suggested like in the commandline.
It is no longer required that the unused folders exists when restoring a multi-source backup from the GUI.
Added size tooltips to the restore GUI window with the list of backup chains.
Now correctly deletes old signature cache files, even if they use the old names.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@542 59da171f-624f-0410-aa54-27559c288bec
2010-10-12 22:22:29 +00:00
kenneth.skovhede@gmail.com 7dc0d3cee7 Fixed some issues with passwordless operations.
Update issue #235
I have now added a simple version of the collection-status command,
which shows Type, Time, Volume count and Size for each backup set,
with the incrementals listed under the full's they belong to.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@540 59da171f-624f-0410-aa54-27559c288bec
2010-10-09 16:46:52 +00:00
kenneth.skovhede@gmail.com b20257d186 Now recognizes both old-style and new-style cache filenames (prefer new)
git-svn-id: https://duplicati.googlecode.com/svn/trunk@539 59da171f-624f-0410-aa54-27559c288bec
2010-10-09 16:11:11 +00:00
kenneth.skovhede@gmail.com d6ecac5f0e Fixed a few extra warnings
git-svn-id: https://duplicati.googlecode.com/svn/trunk@538 59da171f-624f-0410-aa54-27559c288bec
2010-10-09 15:48:05 +00:00
kenneth.skovhede@gmail.com 23ff55f957 Added better logging options to the GUI and Commandline
git-svn-id: https://duplicati.googlecode.com/svn/trunk@537 59da171f-624f-0410-aa54-27559c288bec
2010-10-09 15:43:03 +00:00
kenneth.skovhede@gmail.com c87363bd72 Update issue #174
Status: Fixed
The new strategy is to provide general assembly redirects.
These are generated during the build procedure and added to the output.
Using these redirects it is possible to load a new/old version of a backend 
(or other module) into Duplicati.

To ease testing, it is now also possible to place a dll for a backend in
a subfolder named "backends" and it will override the normal backend.
To remove the test backend, simply stop Duplicati and delete the "backends" folder.

The same works for compression, encryption, generic modules, and settingcontrols 
with the folders "compression", "encryption", "modules", and "settingcontrols" 
respectively.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@536 59da171f-624f-0410-aa54-27559c288bec
2010-10-09 15:15:16 +00:00
kenneth.skovhede@gmail.com c6e12ce122 Fixed a x86 build problem
git-svn-id: https://duplicati.googlecode.com/svn/trunk@535 59da171f-624f-0410-aa54-27559c288bec
2010-10-09 12:25:37 +00:00
kenneth.skovhede@gmail.com e23818903d Update issue #233
Status: Fixed
Removed the remaining warnings in the log

git-svn-id: https://duplicati.googlecode.com/svn/trunk@533 59da171f-624f-0410-aa54-27559c288bec
2010-10-03 12:20:04 +00:00
kenneth.skovhede@gmail.com 02915a5797 Fixed a problem with showing backup contents
git-svn-id: https://duplicati.googlecode.com/svn/trunk@530 59da171f-624f-0410-aa54-27559c288bec
2010-10-02 14:17:15 +00:00
kenneth.skovhede@gmail.com 994503ceed Duplicati now "inherits" the compression and encryption settings if not specified explicitly.
Since encryption (and compression) is detected after being encountered, the encryption module selection has been removed from the user interface when restoring.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@527 59da171f-624f-0410-aa54-27559c288bec
2010-09-30 12:39:52 +00:00
kenneth.skovhede@gmail.com f020aae238 Update issue #159
Status: Fixed
A restore now defaults to background and some filenames are also shown while restoring.
The "direct restore" option cannot run in the background as it requires the schedule to be stored in the database.
This can be fixed after version 2.0

git-svn-id: https://duplicati.googlecode.com/svn/trunk@525 59da171f-624f-0410-aa54-27559c288bec
2010-09-26 20:43:16 +00:00
kenneth.skovhede@gmail.com b81d63ea73 Fixed a bug with async uploads that caused some files to no be uploaded.
Fixed a protential race condition with warning messages and file counts (cosmetic only) when using async transfers.
Spelling correction, Seperator -> Separator.
Changed so a restore operation can also supply advanced options.
Changed the format of timestamps in filenames to follow the Duplicity convention, which removes the need for --time-separator and --use-short-filenames.
Moved the URL utility into Core, to avoid compilation errors with Monodevelop.
Reorganized the runner to better support the LiveControls on all operations rather than only for backup/restore.

Update issue #210
Status: Fixed
I have now changed the time format to follow the Duplicity naming convention.
This means that all filenames are now generated with the time set as "yyyyMMddTHHmmssZ".
This format is more portable across all platforms, and easily sortable/readable.
The drawback is that the Z indicates UTC time, so if one looks at the filenames, 
the times are not local. The motivation for this is to avoid trouble
with daylight savings time offsets.

There is full backwards compatibility as long as backups have not used more than
one character for --time-separator (only possible via commandline).
This new format means that the options --time-separator and --use-short-filenames
are now deprecated and removed from the user interface. It is possible to
access them from the advanced options page, along with the --use-old-filenames option.

If anyone needs these options for some reason, let me know, otherwise they will be removed
in a later version.



git-svn-id: https://duplicati.googlecode.com/svn/trunk@523 59da171f-624f-0410-aa54-27559c288bec
2010-09-25 12:02:14 +00:00
kenneth.skovhede@gmail.com 31eadfddd2 Fixed another bug with the S3 backend and multi request lists.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@522 59da171f-624f-0410-aa54-27559c288bec
2010-09-23 16:47:53 +00:00
kenneth.skovhede@gmail.com 9b3169e33a Update issue #263
Status: Fixed
I have now added an option called --exclude-empty-folders
It excludes folders AFTER the filter has been applied, so if the folder is left empty due to the filter, the folder is not included either.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@520 59da171f-624f-0410-aa54-27559c288bec
2010-09-17 18:17:12 +00:00
kenneth.skovhede@gmail.com df085e4271 Update issue #221
Status: Fixed
Added the first generic module, a password request module.
The motivation for this is to allow the creation of custom passphrase modules.
A simple model would be to add a GUI input dialog. 
A more sophisticated version may read a passphrase to an encrypted file which contains the real passphrase or similar.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@519 59da171f-624f-0410-aa54-27559c288bec
2010-09-17 16:20:16 +00:00
kenneth.skovhede@gmail.com ad118c4f66 Update issue #134
Status: Fixed
After selecting a stored AWS ID for S3, the password is masked and cannot be revealed.

git-svn-id: https://duplicati.googlecode.com/svn/trunk@518 59da171f-624f-0410-aa54-27559c288bec
2010-09-16 16:32:01 +00:00
kenneth.skovhede@gmail.com 04ba370246 Fixed a problem with VSS snapshots being bypassed, see issue #258
git-svn-id: https://duplicati.googlecode.com/svn/trunk@516 59da171f-624f-0410-aa54-27559c288bec
2010-09-16 16:12:55 +00:00
kenneth.skovhede@gmail.com 537be589ee Fixed a bug where empty manifests where reported
git-svn-id: https://duplicati.googlecode.com/svn/trunk@515 59da171f-624f-0410-aa54-27559c288bec
2010-09-16 16:12:12 +00:00
kenneth.skovhede@gmail.com ef49ae4f45 Extended the error messages generated by --debug-output
git-svn-id: https://duplicati.googlecode.com/svn/trunk@514 59da171f-624f-0410-aa54-27559c288bec
2010-09-16 16:11:39 +00:00
kenneth.skovhede@gmail.com 3e054c2576 Added a number of error correction and detection messages to prevent the volume deletion problem created by the S3 backend bug.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@512 59da171f-624f-0410-aa54-27559c288bec
2010-09-12 21:50:09 +00:00
kenneth.skovhede@gmail.com 62242bb04b Fixed a critical bug with the S3 backend that would cause deletion of backup volumes.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@511 59da171f-624f-0410-aa54-27559c288bec
2010-09-12 21:46:24 +00:00
kenneth.skovhede@gmail.com ce803069c6 Fixed a critical bug in the improved SharpRSync code.
git-svn-id: https://duplicati.googlecode.com/svn/trunk@510 59da171f-624f-0410-aa54-27559c288bec
2010-09-12 21:44:59 +00:00
kenneth.skovhede@gmail.com 7247da1c8a Fixed a minor error so the --debug-output option actually works :)
git-svn-id: https://duplicati.googlecode.com/svn/trunk@509 59da171f-624f-0410-aa54-27559c288bec
2010-09-11 13:52:30 +00:00
kenneth.skovhede@gmail.com 1aaf9c8f98 Added option to enable verbose error messages
git-svn-id: https://duplicati.googlecode.com/svn/trunk@508 59da171f-624f-0410-aa54-27559c288bec
2010-09-11 12:43:55 +00:00