Commit Graph
3969 Commits
Author SHA1 Message Date
Kenneth Hsu 2aa76881a5 Mark fields that don't need to be reassigned as readonly.
This makes it explicit at compile-time that these fields should not be
reassigned outside the constructor.
2019-10-19 13:59:22 -07:00
Kenneth Hsu afab61a05b Use pattern matching to simplify casts. 2019-10-19 10:15:38 -07:00
Kenneth SkovhedeandGitHub e0d5a7d43e Merge pull request #3929 from warwickmm/bugfix/purge_with_simple_filter
Fix purge operation with simple filters and case-sensitive filesystems
2019-10-19 14:27:18 +02:00
Kenneth SkovhedeandGitHub 4bb0c507a2 Merge pull request #3930 from warwickmm/dispose_volume_writers
Ensure that instances of VolumeWriterBase are disposed
2019-10-19 14:24:55 +02:00
Kenneth SkovhedeandGitHub 579f9911d5 Merge pull request #3938 from warwickmm/bugfix/wrong_dblock_in_dindex
Ensure that dindex references correct dblock file after renames
2019-10-19 14:19:11 +02:00
Kenneth SkovhedeandGitHub 880459d1b7 Merge pull request #3925 from warwickmm/bugfix/missing_filelist
Ensure that filelist is always included in dlist files
2019-10-19 14:08:27 +02:00
Kenneth SkovhedeandGitHub d680641d8d Merge pull request #3926 from warwickmm/bugfix/invalid_regex
Fix invalid regex pattern
2019-10-19 14:05:20 +02:00
Kenneth SkovhedeandGitHub fb0e6cb298 Merge pull request #3940 from warwickmm/fix_xml_documentation
Fix internal XML documentation for restore-symlink-metadata
2019-10-19 13:55:16 +02:00
Kenneth Hsu 14464d45a4 Fix incorrect Google Cloud Storage protocol in documentation.
This fixes issue #3941.
2019-10-07 19:40:53 -07:00
Kenneth Hsu 7296b96f04 Fix internal XML documentation for restore-symlink-metadata.
The previous documentation appears to have been a copy/paste error.
2019-10-06 09:55:33 -07:00
warwickmmandGitHub 25b714561e Merge pull request #3939 from drwtsn32x/roll-back-pr3846
Fix restore from backup set containing only a single file
2019-10-05 13:49:07 -07:00
drwtsn32x dc87ca1873 remove namespace reference 2019-10-05 11:39:05 -07:00
drwtsn32x 176558d68d roll back pr 3846 2019-10-05 11:34:49 -07:00
Kenneth Hsu 1c492647ae Rename method parameter for consistency. 2019-10-05 11:25:22 -07:00
Kenneth Hsu 0cdc5b9159 Ensure that dindex contains correct dblock file after renames.
When support for parallel uploads was implemented, we overlooked a case
where a failed put of a dblock file is retried with a different
filename.  In this case, an instance of TemporaryIndexVolume was created
in the DataBlockProcessor or SpillCollectorProcess prior to the
attempted put.  The put would fail, and then retried with a different
filename.  While the Remotevolume table in the database would reflect
the new filename, the TemporaryIndexVolume still contained a reference
to the old dblock filename.  This would cause issues in direct restores,
etc., when the referenced dblock file could not be found.

Now, the TemporaryIndexVolume is only created after the dblock put has
completed.

This addresses issue #3932.
2019-10-05 10:46:39 -07:00
Kenneth Hsu 614ccaf79d Convert duplicated static methods into instance method. 2019-10-04 21:37:33 -07:00
warwickmmandGitHub 3b0525e2f8 Merge pull request #3928 from drwtsn32x/improve-purge-logging
Add progress logging for purge operation.
2019-09-29 13:24:13 -07:00
Kenneth Hsu 2f29df5c7e Fix incorrect comment. 2019-09-29 09:52:35 -07:00
Kenneth Hsu 9333517950 Fix query used by purge operation for case-sensitive fileystems.
The table we are inserting into should contain the files that are to be
deleted, not the files that are to be kept.

This fixes issue #3927.
2019-09-29 09:52:35 -07:00
drwtsn32x 64a3c16030 Add X of Y logging for purge operation 2019-09-29 09:42:47 -07:00
Kenneth Hsu b6123cc156 Ensure that IndexVolumeWriter is disposed. 2019-09-28 10:33:34 -07:00
Kenneth Hsu 54992d5beb Ensure that BlockVolumeWriter is disposed. 2019-09-28 10:31:37 -07:00
Kenneth Hsu bc975dd090 Ensure that IndexVolumeWriter is disposed. 2019-09-28 10:30:13 -07:00
Kenneth Hsu 9e465c602d Fix invalid regex pattern.
This was introduced as part of revision b8199ad1c4 ("Fixed handling of
multi-byte characters in both HttpServer and Duplicati") to resolve
issues #1063 and #1085.  However, the regex pattern was invalid.  This
reverts the pattern to the previous value, which seems more appropriate
since most non-standard encodings are of the form %uxxxx where xxxx is a
4 byte hex string representing a UTF-16 code.

This fixes issue #3737.
2019-09-28 10:05:34 -07:00
Kenneth Hsu 8d7c6c6e21 Ensure that filelist is always written to dlist files.
This fixes a regression introduced around revisions e0899a2a91 ("add
method to add the filelist file") and 3b5af1cf01 ("add method to add
filelist file"), where the filelist was not written by all usages of the
FilesetVolumeWriter.  Previously, one would have to invoke
AddFilelistFile with each usage.  Now, we simply do so when the
FilesetVolumeWriter is closed.

We also modified the UploadSyntheticFilelist so that the usage of the
FilesetVolumeWriter is contained in a using statement, which will ensure
that it is disposed.

This fixes issue #3924.
2019-09-27 20:35:06 -07:00
warwickmmandGitHub 044412274b Merge pull request #3922 from BlueBlock/handle-remotevolume-delete-for-old-data
Remove deleted Remotevolume records stored in old tick format
2019-09-23 20:53:13 -07:00
BlueBlock cd4b653771 fix sql and comment 2019-09-23 05:22:06 -04:00
Kenneth SkovhedeandGitHub 025d4e8b4a Updated symlink text as suggested
https://forum.duplicati.com/t/symlink-follow/8082/3
2019-09-23 09:14:18 +02:00
BlueBlock 75335414d5 add comment 2019-09-21 10:31:07 -04:00
BlueBlock 8377a2bfb2 fix deleting old remotevolume records that use the old datetime method 2019-09-21 10:27:57 -04:00
Kyle Stanfield 7dffbaf800 Changed NormalizeDateTimeToEpochSeconds to use ToUnixTimeSeconds 2019-09-20 19:08:26 -07:00
Kenneth Skovhede f1cf209e86 Revert "Updated AWS core library to 3.3.103.41 and AWS S3 library to 3.3.104.29"
This reverts commit 21a3add369.
2019-09-20 12:59:34 +02:00
Kenneth SkovhedeandGitHub 86fe0265e9 Merge pull request #3915 from duplicati/feature/update-aws-sdk
Updated AWS core library to 3.3.103.41 and AWS S3 library to 3.3.104.29
2019-09-20 12:31:32 +02:00
Kenneth SkovhedeandGitHub 077a7df3c0 Merge pull request #3912 from warwickmm/fix_deprecation_message
Fix incorrect deprecation message for disable-filepath-cache option
2019-09-20 12:27:15 +02:00
Kenneth SkovhedeandGitHub f9865368bc Merge pull request #3908 from warwickmm/remove_unused_property
Remove unused FileReadBufferSize property
2019-09-20 12:26:53 +02:00
Kenneth SkovhedeandGitHub c12cce1f53 Merge pull request #3914 from duplicati/feature/update-cocol-1.7.1
Updated CoCoL to version 1.7.1 to fix a busy CPU issue
2019-09-20 12:26:26 +02:00
Kenneth Skovhede 21a3add369 Updated AWS core library to 3.3.103.41 and AWS S3 library to 3.3.104.29 2019-09-20 11:42:17 +02:00
Kenneth Skovhede a1d7edbc6e Updated CoCoL to version 1.7.1 to fix a busy CPU issue 2019-09-20 11:40:22 +02:00
warwickmmandGitHub 9de6dfcfe1 Merge pull request #3911 from duplicati/feature/disable-linux-pipe-escape
Fixed incorrect escaping of pipe characters
2019-09-19 20:14:30 -07:00
Kenneth Hsu abd62129bb Fix incorrect deprecation message. 2019-09-19 14:10:32 -07:00
Kenneth Hsu 7090501c0b Deprecate command-line argument for file-read-buffer-size.
The reference to the Options.FileReadBufferSize property was removed in
revision 20f7b42945.
2019-09-19 14:01:52 -07:00
Kenneth SkovhedeandGitHub 472c15346b Merge pull request #3906 from warwickmm/test/stop_after_current_file
Add tests for stopping after current file
2019-09-19 22:16:44 +02:00
Kenneth SkovhedeandGitHub d5b77ebb61 Fixed incorrect escaping of pipe characters 2019-09-19 22:09:50 +02:00
Kenneth Hsu 8f2b38ac50 Remove unused GetFilesetID method.
The last reference was removed in revision cbc18970d5 ("Re-applied the
path-storage fix as the merge failed somehow").
2019-09-18 11:38:29 -07:00
Kenneth Hsu 89191a6caf Remove unused FileReadBufferSize property.
The last reference was removed in revision 20f7b42945.
2019-09-18 11:28:09 -07:00
warwickmmandGitHub ff7131d2f2 Merge pull request #3905 from duplicati/feature/update_s3_providers
Update list of S3 providers
2019-09-17 13:23:00 -07:00
Kenneth Skovhede d8ef349c3e Changed lookup to use dictionary lookup instead of looping over the keys. 2019-09-17 22:01:33 +02:00
Kenneth Hsu 5e9dd9a7b8 Expose BackupType to test classes. 2019-09-17 12:46:23 -07:00
Kenneth Skovhede b04b00f92a Changed hostnames from s3-region.amazonaws.com to s3.region.amazonaws.com as specified in the documentation:
https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region
2019-09-17 11:17:58 +02:00
Kenneth Skovhede ccc4bb78b4 Rewrote S3 to use dictionaries with inline specifiers, instead of arrays with key-value pairs. 2019-09-17 11:16:09 +02:00