Commit Graph
4937 Commits
Author SHA1 Message Date
Kenneth Hsu 93bc478d37 Issue warning when backup is cancelled by user.
Previously, a yellow warning icon would be displayed but the logs did
not contain any details regarding the cause of the warning.

This concerns issue #3982.
2019-11-10 11:20:11 -08:00
Fish 3cf01b7297 Advance the progress bar when files are skipped. Fixes #3407.
According to the current implementation, the progress bar does not advance
when files are skipped by FilePreFilterProcess. This causes users'
confusion since the web frontend will get stuck at a certain stage for a
long time. This commit addresses this issue.
2019-11-03 21:34:21 -07:00
warwickmmandGitHub 136a3baec2 Merge pull request #3975 from tygill/feature/fileset-temp-disk
Store fileset in a temp file instead of a memory stream
2019-11-01 20:43:37 -07:00
Tyler Gill e14be62c2b Make the temp file the default and only bevavior - fileset volume no longer uses memory stream 2019-11-01 19:27:49 -06:00
Kenneth SkovhedeandGitHub 59ddeec459 Merge pull request #3969 from duplicati/feature/fix_macos_launcher
Ported `run-with-mono.sh` bash script to Objective C version
2019-10-31 14:50:55 +01:00
Kenneth Skovhede fc93134550 Added support for forcing the passphrase input to be read from stdin instead of attempting to use a TTY first 2019-10-31 11:48:35 +01:00
Tyler Gill bc0686794a Cache to disk 2019-10-30 17:30:47 -06:00
Kenneth SkovhedeandGitHub 8015171be3 Merge pull request #3960 from warwickmm/bugfix/invalid_datetime_offset
Avoid possible invalid DateTimeOffset values
2019-10-27 20:42:53 +01:00
warwickmmandGitHub f23bcdcac9 Merge pull request #3958 from tygill/feature/buffer-reads-httpclient
Support BufferRequests in HttpClient based backends
2019-10-26 09:53:58 -07:00
Kenneth Hsu 6c36a4bc93 Avoid possible invalid DateTimeOffset values.
When creating a new backup, a value of DateTime.MinValue can be provided
to the NormalizeDateTimeToEpochSeconds method.  If DateTimeOffset is
used, it will convert the provided DateTime to the UTC equivalent, which
may result in a value outside of the allowable bounds.

This reverts the changes from pull request #3919.
This fixes issue #3955.
2019-10-23 19:49:36 -07:00
Kenneth SkovhedeandGitHub 6e0b4bbb13 Merge pull request #3956 from duplicati/feature/aftp-update
Feature/aftp update
2019-10-23 08:49:46 +02:00
Tyler Gill 7012c49b8f Support BufferRequests in HttpClient based backends 2019-10-22 15:55:11 -06:00
Kenneth Skovhede b7a88c12a9 Changed filesize reading to use await when reading the filesize 2019-10-22 22:52:14 +02:00
Kenneth Skovhede f40746d86d Removed the threadsafe flag from aftp as it cause issues and is not required for Duplicati's use (backends are not assumed to be threadsafe).
Removed the polling code that checks the file size, as the problem should now be fixed with the removal of the threadsafe flag.
2019-10-22 10:54:13 +02:00
Kenneth SkovhedeandGitHub 99d0cb3c57 Merge pull request #3953 from warwickmm/make_fields_readonly
Mark fields that don't need to be reassigned as readonly
2019-10-21 08:36:17 +02:00
Kenneth Skovhede 11f80e3812 Added --aftp-upload-delay option to the aFTP backend. 2019-10-21 08:29:34 +02:00
Kenneth Skovhede a32c31e6bc Fixed the AFTP backend ignoring the --disable-upload-verify option 2019-10-21 08:13:52 +02:00
Kenneth Skovhede f575532cef Updated grammar in the test file text 2019-10-21 08:10:32 +02:00
Kenneth Hsu 2aa76881a5 Mark fields that don't need to be reassigned as readonly.
This makes it explicit at compile-time that these fields should not be
reassigned outside the constructor.
2019-10-19 13:59:22 -07:00
Kenneth Hsu afab61a05b Use pattern matching to simplify casts. 2019-10-19 10:15:38 -07:00
Kenneth SkovhedeandGitHub e0d5a7d43e Merge pull request #3929 from warwickmm/bugfix/purge_with_simple_filter
Fix purge operation with simple filters and case-sensitive filesystems
2019-10-19 14:27:18 +02:00
Kenneth SkovhedeandGitHub 4bb0c507a2 Merge pull request #3930 from warwickmm/dispose_volume_writers
Ensure that instances of VolumeWriterBase are disposed
2019-10-19 14:24:55 +02:00
Kenneth SkovhedeandGitHub 579f9911d5 Merge pull request #3938 from warwickmm/bugfix/wrong_dblock_in_dindex
Ensure that dindex references correct dblock file after renames
2019-10-19 14:19:11 +02:00
Kenneth SkovhedeandGitHub 880459d1b7 Merge pull request #3925 from warwickmm/bugfix/missing_filelist
Ensure that filelist is always included in dlist files
2019-10-19 14:08:27 +02:00
Kenneth SkovhedeandGitHub d680641d8d Merge pull request #3926 from warwickmm/bugfix/invalid_regex
Fix invalid regex pattern
2019-10-19 14:05:20 +02:00
Kenneth SkovhedeandGitHub fb0e6cb298 Merge pull request #3940 from warwickmm/fix_xml_documentation
Fix internal XML documentation for restore-symlink-metadata
2019-10-19 13:55:16 +02:00
Kenneth Hsu 14464d45a4 Fix incorrect Google Cloud Storage protocol in documentation.
This fixes issue #3941.
2019-10-07 19:40:53 -07:00
Kenneth Hsu 7296b96f04 Fix internal XML documentation for restore-symlink-metadata.
The previous documentation appears to have been a copy/paste error.
2019-10-06 09:55:33 -07:00
warwickmmandGitHub 25b714561e Merge pull request #3939 from drwtsn32x/roll-back-pr3846
Fix restore from backup set containing only a single file
2019-10-05 13:49:07 -07:00
drwtsn32x dc87ca1873 remove namespace reference 2019-10-05 11:39:05 -07:00
drwtsn32x 176558d68d roll back pr 3846 2019-10-05 11:34:49 -07:00
Kenneth Hsu 1c492647ae Rename method parameter for consistency. 2019-10-05 11:25:22 -07:00
Kenneth Hsu 0cdc5b9159 Ensure that dindex contains correct dblock file after renames.
When support for parallel uploads was implemented, we overlooked a case
where a failed put of a dblock file is retried with a different
filename.  In this case, an instance of TemporaryIndexVolume was created
in the DataBlockProcessor or SpillCollectorProcess prior to the
attempted put.  The put would fail, and then retried with a different
filename.  While the Remotevolume table in the database would reflect
the new filename, the TemporaryIndexVolume still contained a reference
to the old dblock filename.  This would cause issues in direct restores,
etc., when the referenced dblock file could not be found.

Now, the TemporaryIndexVolume is only created after the dblock put has
completed.

This addresses issue #3932.
2019-10-05 10:46:39 -07:00
Kenneth Hsu 614ccaf79d Convert duplicated static methods into instance method. 2019-10-04 21:37:33 -07:00
warwickmmandGitHub 3b0525e2f8 Merge pull request #3928 from drwtsn32x/improve-purge-logging
Add progress logging for purge operation.
2019-09-29 13:24:13 -07:00
Kenneth Hsu 2f29df5c7e Fix incorrect comment. 2019-09-29 09:52:35 -07:00
Kenneth Hsu 9333517950 Fix query used by purge operation for case-sensitive fileystems.
The table we are inserting into should contain the files that are to be
deleted, not the files that are to be kept.

This fixes issue #3927.
2019-09-29 09:52:35 -07:00
drwtsn32x 64a3c16030 Add X of Y logging for purge operation 2019-09-29 09:42:47 -07:00
Kenneth Hsu b6123cc156 Ensure that IndexVolumeWriter is disposed. 2019-09-28 10:33:34 -07:00
Kenneth Hsu 54992d5beb Ensure that BlockVolumeWriter is disposed. 2019-09-28 10:31:37 -07:00
Kenneth Hsu bc975dd090 Ensure that IndexVolumeWriter is disposed. 2019-09-28 10:30:13 -07:00
Kenneth Hsu 9e465c602d Fix invalid regex pattern.
This was introduced as part of revision b8199ad1c4 ("Fixed handling of
multi-byte characters in both HttpServer and Duplicati") to resolve
issues #1063 and #1085.  However, the regex pattern was invalid.  This
reverts the pattern to the previous value, which seems more appropriate
since most non-standard encodings are of the form %uxxxx where xxxx is a
4 byte hex string representing a UTF-16 code.

This fixes issue #3737.
2019-09-28 10:05:34 -07:00
Kenneth Hsu 8d7c6c6e21 Ensure that filelist is always written to dlist files.
This fixes a regression introduced around revisions e0899a2a91 ("add
method to add the filelist file") and 3b5af1cf01 ("add method to add
filelist file"), where the filelist was not written by all usages of the
FilesetVolumeWriter.  Previously, one would have to invoke
AddFilelistFile with each usage.  Now, we simply do so when the
FilesetVolumeWriter is closed.

We also modified the UploadSyntheticFilelist so that the usage of the
FilesetVolumeWriter is contained in a using statement, which will ensure
that it is disposed.

This fixes issue #3924.
2019-09-27 20:35:06 -07:00
warwickmmandGitHub 044412274b Merge pull request #3922 from BlueBlock/handle-remotevolume-delete-for-old-data
Remove deleted Remotevolume records stored in old tick format
2019-09-23 20:53:13 -07:00
BlueBlock cd4b653771 fix sql and comment 2019-09-23 05:22:06 -04:00
Kenneth SkovhedeandGitHub 025d4e8b4a Updated symlink text as suggested
https://forum.duplicati.com/t/symlink-follow/8082/3
2019-09-23 09:14:18 +02:00
BlueBlock 75335414d5 add comment 2019-09-21 10:31:07 -04:00
BlueBlock 8377a2bfb2 fix deleting old remotevolume records that use the old datetime method 2019-09-21 10:27:57 -04:00
Kyle Stanfield 7dffbaf800 Changed NormalizeDateTimeToEpochSeconds to use ToUnixTimeSeconds 2019-09-20 19:08:26 -07:00
Kenneth Skovhede f1cf209e86 Revert "Updated AWS core library to 3.3.103.41 and AWS S3 library to 3.3.104.29"
This reverts commit 21a3add369.
2019-09-20 12:59:34 +02:00