Commit Graph
2357 Commits
Author SHA1 Message Date
Kenneth Hsu 0d23302220 Use ordinal case-insensitive comparison instead of ToLower. 2018-09-19 15:21:59 -07:00
Kenneth SkovhedeandGitHub 01c3e52f68 Merge pull request #3368 from LacunaSoftware/progressBar
Fix progress bar not updating size and number of files processed
2018-09-15 00:27:05 +02:00
Max a22a7a7d24 remove of FasterHashing component 2018-09-09 14:42:40 +02:00
Max 30fab22340 unsinged whole solution 2018-09-09 14:21:55 +02:00
Max b11f4d7cdd Merge branch 'master' into netstandard 2018-09-09 12:24:31 +02:00
Mikael MelloandGitHub 072f98ffe8 Fix wrong file size being added to the total 2018-09-08 11:21:46 -03:00
Kenneth Skovhede b4a031f6a8 Added consistency check to the test/verify command 2018-09-08 11:54:29 +02:00
Kenneth Skovhede fd87bf6de5 Fixed a missing GetMetadataHashAndSizeForFile method and added transactions to GetFileHash 2018-09-07 14:46:32 +02:00
Kenneth Skovhede a8cb4af389 Merge branch 'master' into feature/fix_path_storage2
# Conflicts:
#	Duplicati/Library/Main/Database/LocalBackupDatabase.cs
#	Duplicati/Library/Main/Operation/Backup/BackupDatabase.cs
#	Duplicati/Library/Main/Operation/Backup/MetadataPreProcess.cs
2018-09-07 09:44:23 +02:00
Mikael Mello d9445f7aaf Fix progress bar not updating size and number of files processed 2018-09-05 17:18:44 -03:00
Kenneth Skovhede e0eaf33514 Merge branch 'master' of github.com:duplicati/duplicati 2018-09-05 11:21:08 +02:00
Kenneth Skovhede 809ba9a856 Changed the default query to be v==2, as multiple users reported this to be fastest.
The previous default query is now v==4.

Added an additional v==3, and a `LIMIT 1` clause to v==4 as suggested here:
https://forum.duplicati.com/t/release-2-0-3-10-canary-2018-08-30/4497/25
2018-09-05 10:12:28 +02:00
Kenneth Hsu 51cfb3d4c5 Fix reference to renamed method.
This was renamed in revision 6c38651f ("Rename methods to clarify their
synchronous behavior").
2018-09-04 17:39:03 -07:00
Rune HenriksenandGitHub b8e53cc839 Merge branch 'master' into remove_unnecessary_async 2018-09-04 21:27:11 +02:00
Rune HenriksenandGitHub 866b72ac8b Merge pull request #3355 from ravisorg/patch-1
Added some missing image formats
2018-09-04 21:21:37 +02:00
Rune HenriksenandGitHub ce618ea888 Added comment to clarify odd naming convention
Added a comment to clarify that the Canon RAW image format is actually not RAW since it's basically just TIFF and lossless Jpeg compression in a different wrapper.

https://github.com/lclevy/libcraw2/blob/master/docs/cr2_lossless.pdf
https://github.com/lclevy/libcraw2/blob/master/docs/cr2_poster.pdf
2018-09-04 20:25:29 +02:00
ravisorgandGitHub b8f9041764 Added some missing image formats
NEF, ARW, and HEIC
2018-08-31 12:49:44 -04:00
Kenneth Skovhede 22ab344e67 Merge branch 'feature/improved-exit-code-handling' 2018-08-15 12:11:21 +02:00
Kenneth Skovhede 416ab41ee6 Merge branch 'feature/disable-filelist-consistency-checks' 2018-08-15 08:17:23 +02:00
Kenneth Skovhede ca1872ce57 Added an option to disable filelist consistency checks as it was reported to slow backups with a large number of filesets.
This addresses #3194
2018-08-14 15:21:54 +02:00
Kenneth Skovhede 5e130fa4b7 Converted exceptions while adding an unmodified file to the database to a log message to avoid stopping the backup when this errors out. 2018-08-14 11:42:38 +02:00
Kenneth Skovhede 494fccd931 Added support for multiple exit codes, and added a unittest to verify that the exit codes are handled correctly 2018-08-14 11:09:16 +02:00
Kenneth Skovhede d0026d8028 Reworked the file-path query, and enabled experimentally changing it by setting the environment variable TEST_QUERY_VERSION=1 or TEST_QUERY_VERSION=2.
Added check to the unittests to catch cases where it scans too many files.
2018-08-13 13:23:59 +02:00
Kenneth Skovhede 4d1bea86a6 Attempt at making a leaner version of getting the previous file's information 2018-08-11 14:39:03 +02:00
Kenneth Skovhede 5507496352 Fixed the query to correctly extract metadata for a file, using the Metadataset indirection 2018-08-11 14:37:23 +02:00
Kenneth Skovhede 52cb9fb1f9 Removed the deprecated --store-metadata option.
Rewrote the logic for pre-filtering files based on timestamps/metadata to be more verbose and well documented.
Fixed an issue where `--check-filetime-only` also checked the file size, which was not present due to the reduced query used to grab only the lastmodified information.
Fixed a problem where the check for existing metadata was wrong and produced a warning.

This fixes #3204
This handles some of #3194
2018-08-11 11:48:19 +02:00
Kenneth Skovhede 1de08c1917 Merge branch 'feature/improve_size_multiplier_handling' 2018-08-09 09:14:49 +02:00
Kenneth Skovhede 07815c1751 Added warning to unqualified size options 2018-08-08 11:58:35 +02:00
Kenneth SkovhedeandGitHub 64201ae706 Merge pull request #3314 from mnaiman/log_sql_variables
Log sql variables
2018-08-07 23:32:27 +02:00
Kenneth Skovhede 5a3adc390c Merge branch 'feature/fix_file_counter' 2018-08-07 23:31:19 +02:00
Kenneth Skovhede 61060e05b8 Merge branch 'master' into feature/fix_path_storage2
# Conflicts:
#	Duplicati/Library/Main/Database/LocalBackupDatabase.cs
2018-08-07 22:44:41 +02:00
Kenneth Skovhede e17048f74d Merge branch 'feature/reduce_database_call_overheads' 2018-08-07 22:38:07 +02:00
Kenneth Skovhede 20f859bb1d Merge branch 'feature/disable_automatic_dblock_recreate'
# Conflicts:
#	Duplicati/Library/Main/Strings.cs
2018-08-07 22:37:06 +02:00
Kenneth Skovhede 3831962c82 Fixed an infinite recursion issue 2018-08-07 13:35:30 +02:00
Kenneth Skovhede 5d6c612acc The file counter crashed prematurely, because the logging context was disposed when leaving the scope.
Fixed this by awaiting the task inside the counter process, instead of returning the task.
Improved the logging system by allowing the log scopes to be created and detached from the parent.
This fixes #3305
2018-08-07 13:05:09 +02:00
Kenneth Skovhede 6255a9e0db Disabled automatic recreate of dblock files, as it rarely works.
Added an option to re-activate dblock recreation.
This partially addresses #2335
2018-08-07 11:14:28 +02:00
Kenneth Skovhede b55893ec02 Rewrote the SingleRunner class to use a single mutex instead of the overly complex bag-of-tasks method.
This simplifies things and speeds up database query queuing, at the expense of not guaranteeing that the same thread will access the database, but just guaranteeing single threaded database access.
2018-08-07 09:52:18 +02:00
Kenneth Skovhede e9d7c47602 Disabled logging block and file database access to reduce overhead in these queries.
Added an option to explicitly re-enable logging of the database queries (`--profile-all-database-queries`)
2018-08-07 09:40:43 +02:00
Kenneth SkovhedeandGitHub 5b539083a9 Merge pull request #3318 from mnaiman/fix_missingremotefiles
Fix missingremotefiles
2018-08-02 09:45:42 +02:00
Kenneth SkovhedeandGitHub 3fb9e6d2cf Merge pull request #3312 from mnaiman/debug_metadata
Debug metadata
2018-07-24 16:43:37 +02:00
Max123456 ae038a1bac fixed - purge did not commit transaction of missing files set as deleted in database
list-broken-files better logging
2018-07-09 20:38:41 +02:00
Max123456 2213420582 sets.Length was always = 0 2018-07-09 19:01:59 +02:00
Max123456 99bb089b8b log variables even in release 2018-07-06 19:44:05 +02:00
Max123456 af5e2119c0 typo 2018-07-06 19:41:25 +02:00
Max123456 a9f61d1b0d change of params order 2018-07-06 18:04:47 +02:00
Max123456 6e0af52838 better metadata warning info 2018-07-06 17:59:59 +02:00
Kenneth Hsu 590fc151cd Rename parameter so that it does not duplicate method name. 2018-07-04 15:43:37 -07:00
Kenneth Hsu 1a2ee3a5ef Simplify return type of synchronous methods.
Since these methods no longer have the async modifier, they do not need
to return a Task, and do not need to be awaited.
2018-07-04 15:35:14 -07:00
Kenneth Hsu 6c38651f19 Rename methods to clarify their synchronous behavior.
Since these methods no longer have the async modifier, we should not
include 'Async' in their names.
2018-07-04 15:35:14 -07:00
Kenneth Hsu 5e3f15ada4 Remove async modifier from methods that lack await.
A method marked async that does not use await will run synchronously.
By removing the async modifiers, we make it more explicit that these are
synchronous methods.  This also addresses some compiler warnings, and
avoids the creation of the state machine used to handle asynchronous
operations.
2018-07-04 15:35:09 -07:00