Commit Graph
3969 Commits
Author SHA1 Message Date
Max a22a7a7d24 remove of FasterHashing component 2018-09-09 14:42:40 +02:00
Max 30fab22340 unsinged whole solution 2018-09-09 14:21:55 +02:00
Max b11f4d7cdd Merge branch 'master' into netstandard 2018-09-09 12:24:31 +02:00
Mikael MelloandGitHub 072f98ffe8 Fix wrong file size being added to the total 2018-09-08 11:21:46 -03:00
Kenneth Skovhede b4a031f6a8 Added consistency check to the test/verify command 2018-09-08 11:54:29 +02:00
Kenneth Skovhede fd87bf6de5 Fixed a missing GetMetadataHashAndSizeForFile method and added transactions to GetFileHash 2018-09-07 14:46:32 +02:00
Kenneth Skovhede a8cb4af389 Merge branch 'master' into feature/fix_path_storage2
# Conflicts:
#	Duplicati/Library/Main/Database/LocalBackupDatabase.cs
#	Duplicati/Library/Main/Operation/Backup/BackupDatabase.cs
#	Duplicati/Library/Main/Operation/Backup/MetadataPreProcess.cs
2018-09-07 09:44:23 +02:00
Mikael Mello 8de67896b2 Fix actual string to have dashes replaced
Last commit was on the wrong string
2018-09-06 12:17:40 -03:00
Mikael Mello 4ae5083170 Fix localizations with sub-code not working 2018-09-06 11:50:53 -03:00
Mikael Mello d9445f7aaf Fix progress bar not updating size and number of files processed 2018-09-05 17:18:44 -03:00
Kenneth Skovhede e0eaf33514 Merge branch 'master' of github.com:duplicati/duplicati 2018-09-05 11:21:08 +02:00
Kenneth Skovhede 809ba9a856 Changed the default query to be v==2, as multiple users reported this to be fastest.
The previous default query is now v==4.

Added an additional v==3, and a `LIMIT 1` clause to v==4 as suggested here:
https://forum.duplicati.com/t/release-2-0-3-10-canary-2018-08-30/4497/25
2018-09-05 10:12:28 +02:00
Rune HenriksenandGitHub 72fc8e4134 Merge pull request #3354 from warwickmm/bugfix/ordinal_filename_comparison
Use ordinal sort rules to compare path names
2018-09-05 08:09:21 +02:00
Kenneth Hsu 51cfb3d4c5 Fix reference to renamed method.
This was renamed in revision 6c38651f ("Rename methods to clarify their
synchronous behavior").
2018-09-04 17:39:03 -07:00
Rune HenriksenandGitHub b8e53cc839 Merge branch 'master' into remove_unnecessary_async 2018-09-04 21:27:11 +02:00
Rune HenriksenandGitHub 866b72ac8b Merge pull request #3355 from ravisorg/patch-1
Added some missing image formats
2018-09-04 21:21:37 +02:00
Rune HenriksenandGitHub ce618ea888 Added comment to clarify odd naming convention
Added a comment to clarify that the Canon RAW image format is actually not RAW since it's basically just TIFF and lossless Jpeg compression in a different wrapper.

https://github.com/lclevy/libcraw2/blob/master/docs/cr2_lossless.pdf
https://github.com/lclevy/libcraw2/blob/master/docs/cr2_poster.pdf
2018-09-04 20:25:29 +02:00
ravisorgandGitHub b8f9041764 Added some missing image formats
NEF, ARW, and HEIC
2018-08-31 12:49:44 -04:00
Kenneth Hsu b45c41026e Use ordinal file path comparisons.
This addresses issue #3342.
2018-08-30 21:52:02 -07:00
Kenneth SkovhedeandGitHub 258c5a6fa2 Merge pull request #3346 from mikaelmello/patch-1
Fix typo on comments of Log class
2018-08-29 11:27:56 +02:00
Kenneth SkovhedeandGitHub 05059e3859 Merge pull request #3329 from warwickmm/refactor/remove_unused_utilities
Remove unused members from Utility class
2018-08-29 11:27:33 +02:00
Kenneth Hsu eea479e056 Fix URL for Google Cloud Storage backend.
This fixes an issue where Google Cloud Storage users encountered the
following exception:

System.Net.WebException: The remote server returned an error: (404) Not Found.

The refactoring in revision 18de687530 ("Updated Put and Createfolder
using WebApi") omitted the "/o" in the endpoint for object uploads.

This addresses issue #3328.
2018-08-24 22:31:05 -07:00
Mikael MelloandGitHub c218bfe594 Fix typo on comments of Log class 2018-08-23 11:35:36 -03:00
Kenneth Skovhede 22ab344e67 Merge branch 'feature/improved-exit-code-handling' 2018-08-15 12:11:21 +02:00
Kenneth Skovhede 416ab41ee6 Merge branch 'feature/disable-filelist-consistency-checks' 2018-08-15 08:17:23 +02:00
Kenneth Skovhede 666528cdac Merge branch 'feature/fix-vss-mapping-issue' 2018-08-15 08:17:07 +02:00
Kenneth Skovhede ca1872ce57 Added an option to disable filelist consistency checks as it was reported to slow backups with a large number of filesets.
This addresses #3194
2018-08-14 15:21:54 +02:00
Kenneth Skovhede a5cfeff912 Removed the one-element cache to avoid potential race conditions.
Rewrote the path mapping to use simpler operations.
This is a potential fix for #3307
2018-08-14 14:42:51 +02:00
Kenneth Skovhede 5e130fa4b7 Converted exceptions while adding an unmodified file to the database to a log message to avoid stopping the backup when this errors out. 2018-08-14 11:42:38 +02:00
Kenneth Skovhede 494fccd931 Added support for multiple exit codes, and added a unittest to verify that the exit codes are handled correctly 2018-08-14 11:09:16 +02:00
Kenneth Skovhede c00e6fdf31 Merge branch 'experiment/try-faster-file-lookup-query' 2018-08-13 14:54:24 +02:00
Kenneth Skovhede d0026d8028 Reworked the file-path query, and enabled experimentally changing it by setting the environment variable TEST_QUERY_VERSION=1 or TEST_QUERY_VERSION=2.
Added check to the unittests to catch cases where it scans too many files.
2018-08-13 13:23:59 +02:00
Kenneth Skovhede 7b840bacb5 Merge branch 'feature/fix-check-filetime-only' 2018-08-12 22:38:22 +02:00
Kenneth Skovhede c4b564358c Spelling fixes 2018-08-12 22:33:21 +02:00
Kenneth Skovhede 4d1bea86a6 Attempt at making a leaner version of getting the previous file's information 2018-08-11 14:39:03 +02:00
Kenneth Skovhede 5507496352 Fixed the query to correctly extract metadata for a file, using the Metadataset indirection 2018-08-11 14:37:23 +02:00
Kenneth Skovhede 52cb9fb1f9 Removed the deprecated --store-metadata option.
Rewrote the logic for pre-filtering files based on timestamps/metadata to be more verbose and well documented.
Fixed an issue where `--check-filetime-only` also checked the file size, which was not present due to the reduced query used to grab only the lastmodified information.
Fixed a problem where the check for existing metadata was wrong and produced a warning.

This fixes #3204
This handles some of #3194
2018-08-11 11:48:19 +02:00
Kenneth Skovhede 1de08c1917 Merge branch 'feature/improve_size_multiplier_handling' 2018-08-09 09:14:49 +02:00
Kenneth Skovhede 2ec203cabe Removed Task types and the TaskReader property from serialized results, as they have no usable serialized format 2018-08-08 11:59:20 +02:00
Kenneth Skovhede 07815c1751 Added warning to unqualified size options 2018-08-08 11:58:35 +02:00
Kenneth SkovhedeandGitHub 64201ae706 Merge pull request #3314 from mnaiman/log_sql_variables
Log sql variables
2018-08-07 23:32:27 +02:00
Kenneth Skovhede 5a3adc390c Merge branch 'feature/fix_file_counter' 2018-08-07 23:31:19 +02:00
Kenneth Skovhede 61060e05b8 Merge branch 'master' into feature/fix_path_storage2
# Conflicts:
#	Duplicati/Library/Main/Database/LocalBackupDatabase.cs
2018-08-07 22:44:41 +02:00
Kenneth Skovhede e17048f74d Merge branch 'feature/reduce_database_call_overheads' 2018-08-07 22:38:07 +02:00
Kenneth Skovhede 20f859bb1d Merge branch 'feature/disable_automatic_dblock_recreate'
# Conflicts:
#	Duplicati/Library/Main/Strings.cs
2018-08-07 22:37:06 +02:00
Kenneth Skovhede 3831962c82 Fixed an infinite recursion issue 2018-08-07 13:35:30 +02:00
Kenneth Skovhede 5d6c612acc The file counter crashed prematurely, because the logging context was disposed when leaving the scope.
Fixed this by awaiting the task inside the counter process, instead of returning the task.
Improved the logging system by allowing the log scopes to be created and detached from the parent.
This fixes #3305
2018-08-07 13:05:09 +02:00
Kenneth Skovhede 6255a9e0db Disabled automatic recreate of dblock files, as it rarely works.
Added an option to re-activate dblock recreation.
This partially addresses #2335
2018-08-07 11:14:28 +02:00
Kenneth Skovhede b55893ec02 Rewrote the SingleRunner class to use a single mutex instead of the overly complex bag-of-tasks method.
This simplifies things and speeds up database query queuing, at the expense of not guaranteeing that the same thread will access the database, but just guaranteeing single threaded database access.
2018-08-07 09:52:18 +02:00
Kenneth Skovhede e9d7c47602 Disabled logging block and file database access to reduce overhead in these queries.
Added an option to explicitly re-enable logging of the database queries (`--profile-all-database-queries`)
2018-08-07 09:40:43 +02:00