Commit Graph
64 Commits
Author SHA1 Message Date
Kenneth Skovhede 9e48de8e01 Merge branch 'master' of github.com:duplicati/duplicati 2018-03-22 08:32:48 +01:00
Kenneth Skovhede e9d477889f Fixed the order of arguments for throttling downloads.
This fixes part of #2890
2018-03-22 08:32:33 +01:00
Kenneth Hsu c00c6fd19b Make fields containing lock objects readonly.
If one of these fields is accidentally reassigned, it's possible for
threads to be oblivious to an existing lock.  By making the fields
readonly, we will be notified at compile-time if we inadvertently
redefine one of these fields.
2018-03-17 19:59:23 -07:00
Kenneth Skovhede 842fd96543 Implemented a new logging system that is more transparent and allows a more granular way of picking log messages.
Added ID's to each log message and each exception to allow later introduction of a Knowledgebase service that explains each error in more detail.
2018-03-15 09:12:34 +01:00
Kenneth Skovhede bd863016fa Added support for returning multiple DNS names for cache invalidation.
Updated most backends to return the actual DNS names for cache invalidation.
2018-02-26 11:37:10 +01:00
Rune Henriksen fc77b476fc changed from NYI to null returns. Added check to skip DNS check if no DNSName is provided 2018-02-21 22:38:01 +01:00
Rune Henriksen 0ba28da948 Added if statement to specifically verify that it's a NameResolutionFailure and not just a WebException 2018-02-20 20:34:09 +01:00
Rune Henriksen ecc586c0f8 added code to attempt to resolve DNS issues on connection failure and implemented DNSName method in WebDav backend handler 2018-02-18 01:30:05 +01:00
vnau 62a7901aca Compression modules refactored to work with streams instead of filenames;
Added unit test to check compression reversibility
2017-12-25 04:12:19 +07:00
Kenneth Hsu 5fb1958ceb Remove redundant calls to ToString. 2017-11-26 15:44:34 -08:00
Kenneth Skovhede 8bbe04f623 Fixed a case where entering an invalid value for the --number-of-retries or --retry-delay options would crash the uploader thread and bring down the server.
This fixes #2834
2017-10-30 16:12:44 +01:00
Tyler Gill 38883285ee Change IBackend.List() to return IEnumerable instead of List
By changing to IEnumerable, it is possible to iterate only a portion of the list, which is useful when not all entries are needed (e.g., when testing a connection).
All existing backends have been updated, and any which were able to be changed to yield return results in a straightforward way now do.
Many backends had a try/catch in the List() method. Due to the fact that yield returns can't be placed within a try/catch block, these have been refactored to either scope the try/catch to the parts that (should) be the only places throwing exceptions, so that exceptions are still caught and handled.
Note that lazy evaluation may cause some changes in behavior - exceptions that were previously thrown at the point of invokation of List() may now be thrown while it is being enumerated.
I believe this will not be problematic though, as the only well-known exception seems to be FolderMissingException, which should be thrown by Test(), but TestList() attempts to enumerate the list to force this exception.
Any places that require the legacy behavior can get it by simply converting the lazy enumerable to a List()
2017-09-25 23:17:45 -06:00
Kenneth Skovhede 6d401fbd8d Changed all hash algorithms to use the Cng version.
This fixes #2621
2017-09-20 09:58:43 +02:00
Kenneth Skovhede 37527b51ba Fixed removing temporary files downloaded for testing purposes. 2017-09-19 11:20:26 +02:00
Tyler Gill 83a1dcfb64 Replace all instances of InvariantCultureIgnoreCase with OrdinalIgnoreCase in string comparisons.
InvariantCulture is useful when comparing / sorting human language strings in a culturely correct way. It handles things like accented letters in a way that makes sense to humans (e.g., 'a' should be sorted next to 'á', rather than after 'z').
Ordinal looks just at the raw code points of the characters. As such, it is recommended for use in cases when comparing system strings (file paths, command line parameters, config settings, etc.). Since it doesn't need to use the culture specific sorting rules, this method can often be faster.

For more information, see https://stackoverflow.com/questions/492799/difference-between-invariantculture-and-ordinal-string-comparison (and other related questions)
2017-09-18 23:55:08 -06:00
Kenneth Skovhede 4a6bf3deba Added "DeleteGraceTime" to all files deleted from the backend mananger.
This should fix a number of cases where the backup returns a consistency error because the deletion and the backend check happens before the backend is in sync.
2017-09-18 11:53:50 +02:00
Kenneth Skovhede 11f7660939 Implemented logic to report if the backend is blocking the operation. 2017-09-04 12:15:47 +02:00
Kenneth Skovhede da0de9983b Implemented the live throttle control.
This fixes #1730
This fixes #1261
2017-06-20 13:00:52 +02:00
Kenneth Skovhede 33ea12b7fe Added some readonly flags to signal non-changing variables 2017-03-03 20:50:36 +01:00
Kenneth Skovhede 9894facd51 Improved the logic around the abort functionality to avoid hanging while performing a retry delay 2017-02-14 10:28:59 +01:00
Kenneth Skovhede a029890409 Implemented better default error messsages 2017-01-09 11:35:38 +01:00
Kenneth Skovhede 4bf4871427 Added commandline operation to purge select files from filesets.
This fixes #1009.
This paves the way for #1337.
2016-12-29 22:41:13 +01:00
AndersGron b008a54302 Fix use of null object
Fix use of null object
2016-10-16 22:02:55 +02:00
Kenneth Skovhede 0c68daff6c Fixed all whitespace to be 4 spaces instead of tabs 2016-09-15 11:39:27 +02:00
Kenneth Skovhede dd1c5841f4 Added fix to prevent full backend url from being reported in the error message 2016-04-18 12:03:51 +02:00
FootStark eeefe39e9b Fix wrong stream closed 2016-03-23 14:51:58 +01:00
Kenneth Skovhede eea33a7649 Enabled streaming and multithreading in encryption by default 2016-03-19 22:27:46 +01:00
FootStark f8c7b0ce2c Renamed option for beta
Renamed option 'enable-piped-downstreams' --> 'enable-piped-streaming'
to generalize for uploads
2016-03-17 19:53:51 +01:00
FootStark 7656e891ce Prepocessor for schema, Optimized RemoveRemoteVolume
Added a preprocessor for schema supporting sqlite_version-dependent
Statements
RemoveRemoteVolume deletes volumes in batch.
2016-03-16 00:49:28 +01:00
Kenneth Skovhede d3fcffb845 Bugfix for an error message 2016-03-10 21:51:45 +01:00
FootStark fbeff5e46d final bugfixing and a little cleanup 2016-03-02 23:01:38 +01:00
FootStark fa76c3e0e0 Added experimental download piping
Incorporates Hash-calculation into stream stack for classic download mode (better performance)
Offers new experimental download mode where hashing and decryption are piped to different threads.
2016-02-28 21:39:36 +01:00
FootStark 454b6e2bf3 Fix double Hash computation on download 2016-02-18 19:42:45 +01:00
Kenneth Skovhede 9bfc39120a Improved handling the compaction process with errors, such that deletes are marked and commited to the database before actually being deleted, causing fewer issues when resuming the operation afterwards. 2015-11-17 21:32:55 +01:00
Kenneth Skovhede 70892e8e64 Improved handling for cases where a delete request returns a FileNotFound exception 2015-11-17 12:36:00 +01:00
Kenneth Skovhede a6be47bad6 Improved all HTTP based backends by attempting to LIST the remote backend if the DELETE command returns 404. 2015-09-16 21:20:21 +02:00
Kenneth Skovhede a0cc06896f Added auto-guessing logic to the backend manager so it can guess if the user forgot to specify encryption module.
This fixes #1447.
2015-09-16 21:19:26 +02:00
Kenneth Skovhede 16c791f0b5 Removed all resx files, now using Duplicati.Library.Localization exclusively 2015-01-20 21:07:24 +01:00
Kenneth Skovhede 667e0554de Added transfer speeds to the profiling output 2015-01-05 11:12:41 +01:00
Kenneth Skovhede 6923ff5688 Corrected a problem with the --throttle-upload and --throttle-download options.
This fixes #1084.
2015-01-05 11:12:20 +01:00
Kenneth Skovhede 9ada3548e0 Imporved order and time when the file size and hash is recorded for uploads. 2014-12-30 17:15:58 +01:00
Kenneth Skovhede 1cb9d49996 Updated BackendManager to handle failures with delete by checking if the file was actually deleted. 2014-11-15 15:01:01 +01:00
Malte Neumann 4a57eed9b5 Fixed a problem with canceled backups
Was an backup canceled, a restart doesn't work. The problem was that a non existing file caused an failure. This fix handles this situation for the ssh and googledocs backend.
2014-11-14 14:41:36 +01:00
Kenneth Skovhede 4b8bef62fa Implemented handling for verify for volumes that have no locally recorded hash or filesize 2014-08-19 20:23:32 +02:00
Kenneth Skovhede bd53090ae7 Implemented the pause/resume/stop/start methods throughout the calls to allow for interactive control over the tasks 2014-05-15 12:47:16 +02:00
Kenneth Skovhede 84ed9d57cc Implemented faster fail when the connection dies 2014-04-02 11:00:19 +02:00
Kenneth Skovhede 141a4029a9 Improved speed of backup verification 2014-03-10 14:16:27 +01:00
Kenneth Skovhede d6158223e7 Improved error messages when disposing the backend manager due to other errors 2013-08-31 15:29:26 +02:00
Kenneth Skovhede 031b6d74e7 Prevent folder auto-create after an upload has succeeded 2013-08-31 15:29:07 +02:00
Kenneth Skovhede 0ead31c9e6 Updated backend manager to encrypt dblock files on the scanning thread, so the network can work at constant full speed. 2013-08-31 14:30:58 +02:00