Commit Graph
1403 Commits
Author SHA1 Message Date
Rune HenriksenandGitHub be7edb580d Merge pull request #3410 from warwickmm/simplify_enumerating_collections
Simplify enumeration of collections
2018-10-07 19:06:28 +02:00
Kenneth Hsu b824c86c7e Avoid unnecessary enumeration of collections.
This improves performance by using Any() to avoid unnecessary
enumeration of collections.
2018-10-06 16:20:18 -07:00
Kenneth Hsu 0c1ac9c489 Replace chained LINQ calls with call to overload with predicate.
This simplifies the code by reducing the number of enumerators created
while also making the code slightly more readable.
2018-10-06 16:20:18 -07:00
Kenneth Hsu d72128ec83 Remove unused method parameters. 2018-10-06 15:09:43 -07:00
Kenneth Hsu 183ae4ede2 Remove additional unused variables. 2018-09-29 12:49:22 -07:00
Kenneth Hsu 8902da39f2 Undo removal of method parameters.
This should be done on a separate branch for a different pull request.
2018-09-29 10:44:05 -07:00
Kenneth Hsu 93304f0506 Add comment regarding removed code. 2018-09-29 10:44:05 -07:00
Kenneth Hsu 9ce1e807c7 Remove unused variables and fields. 2018-09-29 10:41:27 -07:00
Kenneth Hsu f4f676a1de Remove unnecessary variable assignment.
These variables are assigned values that are never read by any
subsequent instruction.
2018-09-28 20:13:45 -07:00
Kenneth SkovhedeandGitHub 772d15bfd7 Merge pull request #3390 from warwickmm/configure_await_false
Allow tasks to complete on any thread when context is irrelevant
2018-09-28 22:15:51 +02:00
Kenneth Hsu 1c8bb276b4 Allow tasks to complete on any thread when context is irrelevant.
When the code following the await can be executed on any thread, it's
recommended to use ConfigureAwait(false) to avoid unnecessary context
switching and potential deadlocks.
2018-09-19 16:57:17 -07:00
Kenneth Hsu 0d23302220 Use ordinal case-insensitive comparison instead of ToLower. 2018-09-19 15:21:59 -07:00
Kenneth SkovhedeandGitHub 01c3e52f68 Merge pull request #3368 from LacunaSoftware/progressBar
Fix progress bar not updating size and number of files processed
2018-09-15 00:27:05 +02:00
Mikael MelloandGitHub 072f98ffe8 Fix wrong file size being added to the total 2018-09-08 11:21:46 -03:00
Kenneth Skovhede b4a031f6a8 Added consistency check to the test/verify command 2018-09-08 11:54:29 +02:00
Mikael Mello d9445f7aaf Fix progress bar not updating size and number of files processed 2018-09-05 17:18:44 -03:00
Kenneth Skovhede e0eaf33514 Merge branch 'master' of github.com:duplicati/duplicati 2018-09-05 11:21:08 +02:00
Kenneth Skovhede 809ba9a856 Changed the default query to be v==2, as multiple users reported this to be fastest.
The previous default query is now v==4.

Added an additional v==3, and a `LIMIT 1` clause to v==4 as suggested here:
https://forum.duplicati.com/t/release-2-0-3-10-canary-2018-08-30/4497/25
2018-09-05 10:12:28 +02:00
Kenneth Hsu 51cfb3d4c5 Fix reference to renamed method.
This was renamed in revision 6c38651f ("Rename methods to clarify their
synchronous behavior").
2018-09-04 17:39:03 -07:00
Rune HenriksenandGitHub b8e53cc839 Merge branch 'master' into remove_unnecessary_async 2018-09-04 21:27:11 +02:00
Rune HenriksenandGitHub 866b72ac8b Merge pull request #3355 from ravisorg/patch-1
Added some missing image formats
2018-09-04 21:21:37 +02:00
Rune HenriksenandGitHub ce618ea888 Added comment to clarify odd naming convention
Added a comment to clarify that the Canon RAW image format is actually not RAW since it's basically just TIFF and lossless Jpeg compression in a different wrapper.

https://github.com/lclevy/libcraw2/blob/master/docs/cr2_lossless.pdf
https://github.com/lclevy/libcraw2/blob/master/docs/cr2_poster.pdf
2018-09-04 20:25:29 +02:00
ravisorgandGitHub b8f9041764 Added some missing image formats
NEF, ARW, and HEIC
2018-08-31 12:49:44 -04:00
Kenneth Skovhede 22ab344e67 Merge branch 'feature/improved-exit-code-handling' 2018-08-15 12:11:21 +02:00
Kenneth Skovhede 416ab41ee6 Merge branch 'feature/disable-filelist-consistency-checks' 2018-08-15 08:17:23 +02:00
Kenneth Skovhede ca1872ce57 Added an option to disable filelist consistency checks as it was reported to slow backups with a large number of filesets.
This addresses #3194
2018-08-14 15:21:54 +02:00
Kenneth Skovhede 5e130fa4b7 Converted exceptions while adding an unmodified file to the database to a log message to avoid stopping the backup when this errors out. 2018-08-14 11:42:38 +02:00
Kenneth Skovhede 494fccd931 Added support for multiple exit codes, and added a unittest to verify that the exit codes are handled correctly 2018-08-14 11:09:16 +02:00
Kenneth Skovhede d0026d8028 Reworked the file-path query, and enabled experimentally changing it by setting the environment variable TEST_QUERY_VERSION=1 or TEST_QUERY_VERSION=2.
Added check to the unittests to catch cases where it scans too many files.
2018-08-13 13:23:59 +02:00
Kenneth Skovhede 4d1bea86a6 Attempt at making a leaner version of getting the previous file's information 2018-08-11 14:39:03 +02:00
Kenneth Skovhede 5507496352 Fixed the query to correctly extract metadata for a file, using the Metadataset indirection 2018-08-11 14:37:23 +02:00
Kenneth Skovhede 52cb9fb1f9 Removed the deprecated --store-metadata option.
Rewrote the logic for pre-filtering files based on timestamps/metadata to be more verbose and well documented.
Fixed an issue where `--check-filetime-only` also checked the file size, which was not present due to the reduced query used to grab only the lastmodified information.
Fixed a problem where the check for existing metadata was wrong and produced a warning.

This fixes #3204
This handles some of #3194
2018-08-11 11:48:19 +02:00
Kenneth Skovhede 1de08c1917 Merge branch 'feature/improve_size_multiplier_handling' 2018-08-09 09:14:49 +02:00
Kenneth Skovhede 07815c1751 Added warning to unqualified size options 2018-08-08 11:58:35 +02:00
Kenneth SkovhedeandGitHub 64201ae706 Merge pull request #3314 from mnaiman/log_sql_variables
Log sql variables
2018-08-07 23:32:27 +02:00
Kenneth Skovhede 5a3adc390c Merge branch 'feature/fix_file_counter' 2018-08-07 23:31:19 +02:00
Kenneth Skovhede e17048f74d Merge branch 'feature/reduce_database_call_overheads' 2018-08-07 22:38:07 +02:00
Kenneth Skovhede 20f859bb1d Merge branch 'feature/disable_automatic_dblock_recreate'
# Conflicts:
#	Duplicati/Library/Main/Strings.cs
2018-08-07 22:37:06 +02:00
Kenneth Skovhede 3831962c82 Fixed an infinite recursion issue 2018-08-07 13:35:30 +02:00
Kenneth Skovhede 5d6c612acc The file counter crashed prematurely, because the logging context was disposed when leaving the scope.
Fixed this by awaiting the task inside the counter process, instead of returning the task.
Improved the logging system by allowing the log scopes to be created and detached from the parent.
This fixes #3305
2018-08-07 13:05:09 +02:00
Kenneth Skovhede 6255a9e0db Disabled automatic recreate of dblock files, as it rarely works.
Added an option to re-activate dblock recreation.
This partially addresses #2335
2018-08-07 11:14:28 +02:00
Kenneth Skovhede b55893ec02 Rewrote the SingleRunner class to use a single mutex instead of the overly complex bag-of-tasks method.
This simplifies things and speeds up database query queuing, at the expense of not guaranteeing that the same thread will access the database, but just guaranteeing single threaded database access.
2018-08-07 09:52:18 +02:00
Kenneth Skovhede e9d7c47602 Disabled logging block and file database access to reduce overhead in these queries.
Added an option to explicitly re-enable logging of the database queries (`--profile-all-database-queries`)
2018-08-07 09:40:43 +02:00
Kenneth SkovhedeandGitHub 5b539083a9 Merge pull request #3318 from mnaiman/fix_missingremotefiles
Fix missingremotefiles
2018-08-02 09:45:42 +02:00
Kenneth SkovhedeandGitHub 3fb9e6d2cf Merge pull request #3312 from mnaiman/debug_metadata
Debug metadata
2018-07-24 16:43:37 +02:00
Max123456 ae038a1bac fixed - purge did not commit transaction of missing files set as deleted in database
list-broken-files better logging
2018-07-09 20:38:41 +02:00
Max123456 2213420582 sets.Length was always = 0 2018-07-09 19:01:59 +02:00
Max123456 99bb089b8b log variables even in release 2018-07-06 19:44:05 +02:00
Max123456 af5e2119c0 typo 2018-07-06 19:41:25 +02:00
Max123456 a9f61d1b0d change of params order 2018-07-06 18:04:47 +02:00