Commit Graph
1863 Commits
Author SHA1 Message Date
Kenneth SkovhedeandGitHub 07da5662ff Merge pull request #5105 from Jojo-1000/fix-backend-requests-retired
Catch RetiredException in BackupHandler to avoid StopNow race condition
2024-03-04 13:33:58 +01:00
Kenneth SkovhedeandGitHub cbb2b6f295 Merge pull request #5096 from Jojo-1000/fix-invalid-file
Check that the database exists before writing error logs
2024-03-04 13:27:20 +01:00
Kenneth Skovhede d16d702975 More fixes for stray using directives 2024-02-28 20:42:33 +01:00
Kenneth Skovhede 40dd3c6816 Updated all license mentions to MIT 2024-02-28 15:45:30 +01:00
Jojo-1000 929e61f6b4 Catch RetiredException in BackupHandler to avoid StopNow race condition. 2024-02-22 18:48:44 +01:00
Jojo-1000 a0f9785f5c Check that the database exists before writing error logs.
Closes #5091

Fixes that any fatal error in test-filters created an INVALID! file in the current working dir.
2024-02-09 17:10:05 +01:00
gpatel-frandGitHub 396f7dfebe don't report backup as failed if all tests problems are 'extra' (#5074)
these problems don't block database rebuilding so it's not
a good thing to fail the backup.
Also fix erroneous message for ListAndIndexes
2023-12-23 14:25:28 +01:00
gpatel-frandGitHub e2c77b5310 do a vacuum of bug report database (#5069) 2023-12-13 09:27:51 +01:00
gpatel-frandGitHub b08b59228c report all filesets in error in VerifyConsistency (#5052)
only reporting the first one could incite to deleting
it while many filesets can be impacted by a file error
2023-12-12 18:25:14 +01:00
gpatel-frandGitHub 79b87566dd set default log level to Dryrun if dryrun option is set (#5059) 2023-12-11 14:42:45 +01:00
gpatel-frandGitHub 0de4cb7968 allow full-remote-verification to target only list and index files (#5037)
The option is turned into an enum with values True, False, ListIndexes
True and False are for compatibility with the existing backups.
ListIndexes is equivalent to True but don't handle block volumes.
This is to make more workable a strategy of full remote testing
after each backup.
2023-12-10 00:24:07 +01:00
gpatel-frandGitHub af4fd5af05 change error reporting for full backup remote verification (#5004)
Before the change, it could happen that when the postbackup test
was finding problems in the backend, the job would be reported
as having completed successfully, the found problems being displayed
only in the complete log. After the change, an error is logged
that cause the job to be failed.
To repro, the following procedure can be used in a test backup:
change a hash for a block in the block table database and run a backup having set
--full-remote-verification and --full-block-verification to true and
--backup-test-percentage to 100.
2023-12-10 00:23:16 +01:00
gpatel-frandGitHub ec9d49d684 Experiment/rebuildfaster (#5043)
* experimental faster db rebuild (#4955)

* try run update db query for every block file only when needed
add repair-force-block-use option
more appropriate naming for some routines
more tracing
more comments
2023-11-05 18:19:08 +01:00
gpatel-frandGitHub 43dea88b4f enable to perform tests without checking file list (#5054)
following the option --disable-filelist-consistency-checks
2023-11-04 14:25:59 +01:00
Janandgpatel-fr b894a197a9 Fix missing file error caused by interrupted compact.
Before the dindex files are deleted on the remote, update the state in the database to Deleting. Previously, only dblock files were handled this way.
Patch by warwickmm
Closes #4129
2023-09-21 22:56:52 +02:00
Janandgpatel-fr 71eb03130a Improve result reporting for interrupted/failed backups (Fix #4829)
Direct import of PR#4978
Update web UI for new result reports.
For operations with fatal errors, write logs to same operation ID.
Test that Interrupted flag is correct in RunScriptTests.
Update backup log display for new result reporting.
Hide file statistics for fatal errors and change fatal icon.
2023-09-21 20:01:17 +02:00
gpatel-fr cf17f488d1 update Newtonsoft lib to 13.02 2023-03-24 23:17:11 +01:00
dgasawayandGitHub 0ba4da94a6 Add a few more compressed, audio, and video exclusions
Supporting information:
https://wiki.xiph.org/MIME_Types_and_File_Extensions
https://en.wikipedia.org/wiki/Opus_(audio_format)
https://en.wikipedia.org/wiki/Zstd
https://en.wikipedia.org/wiki/MPEG-2#Filename_extensions
2022-09-06 14:52:51 -07:00
Kenneth SkovhedeandGitHub 1935e3f642 Merge pull request #4601 from warwickmm/fix_patch_with_local_blocks
Fix implementation of Options.PatchWithLocalBlocks
2022-06-14 22:12:54 +02:00
martengooz 7f9daa6041 Add additional compression exclusions 2022-06-12 17:16:35 +02:00
albertony c490009f20 Delay creation of database directory until we know it is needed.
This avoids creating directory %LocalAppData%\Duplicati when it would just be left
empty, and it makes running portable mode (e.g. debug builds) stealthier.
2022-04-01 21:18:19 +02:00
tariandeath d44496f6d4 Add semicolons 2022-02-27 13:29:58 -07:00
JEDandGitHub 662bad4526 Add newline 2022-02-27 00:13:37 -07:00
tariandeath f6ebcd6262 Fix typo 2022-02-26 20:45:00 -07:00
tariandeath 8b24536d4e Add Upgraded Version to binary 2022-02-26 20:39:14 -07:00
tariandeath 396119aa40 Add indexes to improve backup query performance. 2022-02-26 20:24:14 -07:00
Kenneth SkovhedeandGitHub f0dfe67c89 Merge pull request #4660 from warwickmm/download_error_log_filename
Always log filename if error occurs during retrieval
2022-02-23 22:07:16 +01:00
Riccardo Paolo Bestetti 528478fda4 Implement exponential backoff for backend errors 2022-01-20 23:22:08 +01:00
Kenneth Hsu 6a84e9f972 Always log filename if error occurs during retrieval.
This fixes #4658.
2022-01-08 12:06:33 -08:00
Kenneth Hsu 712588f1d6 Fix implementation of PatchWithLocalBlocks.
Previously, this would return true as long as the key was present in the
Dictionary, regardless of what the value parsed to.
2021-09-03 16:23:28 -07:00
Kenneth SkovhedeandGitHub 6dcbccab28 Merge pull request #4520 from warwickmm/remote_list_verification_exception
Create custom Exception for remote list verification failures
2021-08-11 10:32:18 +02:00
warwickmmandGitHub 184dfeae78 Merge pull request #4492 from TopperDEL/storj-dcs-update
Add Storj DCS backend and deprecated Tardigrade DCS backend.

Storj renamed their "Tardigrade Decentralized Cloud Storage" product to "Storj DCS".  This adds a new Storj DCS backend and deprecates the old Tardigrade one.  A warning is issued to inform Tardigrade users to modify their configurations to use the new backend.

This also adds a passphrase verification field to ensure that the user has provided the correct encryption passphrase.
2021-07-20 08:28:54 -07:00
TopperDEL fc55b16992 fix: More info in deprecation-warning 2021-07-16 08:34:01 +02:00
TopperDEL 5d36791aa5 feat: Inform user about deprecated Tardigrade-Backend with a warning 2021-07-15 17:37:22 +02:00
Kenneth Hsu e90eb3b2a3 Create custom Exception for remote list verification failures.
Previously, we would catch any Exception thrown by VerifyRemoteList and
perform an auto-cleanup (if specified in the options).  However, we
should only perform the auto-cleanup if VerifyRemoteList detected an
issue with the uploaded files.  Otherwise, an unrelated exception can
cause the database repair to be performed unnecessarily.  In the case of
a connection issue, this can leave the database in a corrupted state.

This fixes #4516.
2021-05-20 13:42:41 -07:00
warwickmmandGitHub 7b4f475762 Merge pull request #4502 from samuel-w/master
Make file extension compression hints case-insensitive.
2021-05-09 14:29:59 -07:00
samuel-wandGitHub fa79b406a2 Improve comment 2021-05-09 15:16:31 -05:00
samuel-w d05d83cf4b Add comment 2021-05-08 15:51:10 -05:00
samuel-w bfa24581c1 Add Disk Archive files to compression hints 2021-05-08 01:45:07 -05:00
samuel-w d5c83d2af3 Compare file extensions case insensitively.
Fixes https://github.com/duplicati/duplicati/issues/4493
2021-05-08 01:14:08 -05:00
aureliandevel baf489e8a9 Fix column name typo 2021-03-20 13:26:53 +11:00
Kenneth SkovhedeandGitHub 90a8c34c06 Merge pull request #4398 from warwickmm/bugfix/repair_missing_blocklists
Fix bug in repairing multiple missing blocklist hashes
2021-03-06 14:23:20 +01:00
Kenneth Hsu bacc50513e Provide explicit column names when creating temp table.
If we do not use an AS clause, the name of the column in the result set
is unspecified and may change depending on the version of SQLite.

https://www.sqlite.org/c3ref/column_name.html

This fixes #4403.
2020-12-29 19:58:06 -08:00
Kenneth Hsu 534b71e409 Fix bug with repairing multiple missing blocklist hashes.
If there is more than one missing blocklist hash, we must reset the
offset index before copying hashes from the next blocklist into the
buffer.

This fixes #4397.
2020-12-26 21:37:52 -08:00
Kenneth SkovhedeandGitHub e070af3dd1 Merge pull request #4386 from warwickmm/catch_symlink_read_error
Catch and log exceptions encountered when getting symlink target
2020-12-19 15:02:09 +01:00
Kenneth SkovhedeandGitHub ca073a2d0c Merge pull request #4380 from warwickmm/fix_purge_broken_files_dry_run
Fix error encountered during dry-run of purge-broken-files
2020-12-19 14:44:21 +01:00
Kenneth SkovhedeandGitHub 8002d3d225 Merge pull request #4376 from warwickmm/fix_indentation
Fix incorrect or misleading indentations
2020-12-19 14:43:31 +01:00
Kenneth SkovhedeandGitHub ebc30c7f02 Merge pull request #4366 from warwickmm/improve_missing_source_message
Fix misleading error message about missing source path
2020-12-19 14:40:35 +01:00
Kenneth SkovhedeandGitHub 5af8e1c38b Merge pull request #4367 from warwickmm/fix_variable_name
Fix typo in variable name
2020-12-19 14:39:15 +01:00
Kenneth Hsu a39a24beae Catch and log exceptions encountered when getting symlink target.
Since the GetSymlinkTarget method can throw an exception, we should log
the failure case and avoid further processing of the symlink target.

This concerns #2171, which describes issues with symlinks created using
Windows Subsystem for Linux.
2020-12-06 10:08:46 -08:00