Commit Graph
10566 Commits
Author SHA1 Message Date
marceloduplicatiandGitHub 03b7fac65c Merge pull request #5889 from marceloduplicati/feature/unified-help-arguments
Help Command unification
2025-01-30 10:23:10 -03:00
Kenneth SkovhedeandGitHub 3db8e03262 Merge pull request #5891 from duplicati/feature/add-support-for-cors
Added support for CORS
2025-01-30 10:53:27 +01:00
Kenneth Skovhede fac866a5cd Merge remote-tracking branch 'origin/master' into feature/add-support-for-cors 2025-01-30 08:39:15 +01:00
Kenneth SkovhedeandGitHub 9d8c19fd4b Merge pull request #5926 from duplicati/feature/dispose-backends-in-backendmanager
Implemented correct shutdown of backend manager handler
2025-01-30 08:38:29 +01:00
Kenneth SkovhedeandGitHub 6de9378b4d Merge pull request #5869 from duplicati/feature/more-wix-exe
Better `wix.exe` support
2025-01-29 22:45:23 +01:00
Kenneth SkovhedeandGitHub 10078a4983 Merge pull request #5928 from stavros-k/docker-tag
add docker tag $version-$channel
2025-01-29 21:36:52 +01:00
Stavros Kois 8b37599c39 add docker tag $version-$channel
Signed-off-by: Stavros Kois <s.kois@outlook.com>
2025-01-29 20:38:50 +02:00
Kenneth Skovhede b1e23da40c Implemented correct shutdown of backend manager handler 2025-01-29 11:04:13 +01:00
Kenneth SkovhedeandGitHub 32d4c76c13 Merge pull request #5913 from duplicati/feature/more-visible-warnings
Added UI warning for unencrypted database
2025-01-28 08:57:08 +01:00
Kenneth SkovhedeandGitHub 610f3b47d1 Update reporting module (#5910)
* Updated reporting values.

The reporter module can now emit the following extra values:
- operating-system
- installation-type
- destination-type
- next-scheduled-run

When running from the built-in scheduler, it will automatically set `--next-scheduled-run` so it is applied to the reporting data.

* Implemented an improved machine name reader.
This fixes #5907

* Added a guard against sending too much of the destination url as the destination.

* Fixed reading Windows Machine name

* Removed extra Windows logic as it has no effect
2025-01-28 08:56:42 +01:00
Kenneth SkovhedeandGitHub f7b7555e87 Fixes for tests (#5918)
* Two small test fixes

* Ignore exceptions when comitting an empty transaction

* Attempt to fix FTP connection issue

* Unified test by having a single download function.
Added DNS probing call to attempt fixing sporadic DNS errors.

* Fixed argument order

* Avoid creating temp file during tests, if not needed
2025-01-28 08:55:28 +01:00
Kenneth SkovhedeandGitHub d99f74ed94 Rewrite the backend manager. (#5896)
* Rewrite the backend manager.

This creates a new more logic backend manager that handles all backend operations.

For each top-level operation, there is now a single backend manager instance that is passed to sub-commands.

The internals of the backend manager are now rewritten to use async logic instead of threading.

The design uses a single task runner that dispatches operations and honors concurrent settings and limits from one place.

The logic for each operation has been moved into a separate files/classes to make it easier to understand each operation.

This fixes #5804

* Fixed a few issues with not awaiting tasks

* Fixed not creating empty databases

* Fixed an issue with hashes not being recorded on download

* Reworked the download logic to avoid attempting to decrypt the file if it has been modified.

* Review fixes

* Renamed db collector to better reflect the purpose.

* Review fixes
2025-01-28 08:54:50 +01:00
marceloduplicatiandGitHub a27dce7668 Merge pull request #5920 from duplicati/feature/ci-ftp-fix
Fixing the port range allocated for FTP tests
2025-01-27 14:51:45 -03:00
Marcelo C. 16627af766 Fixing the port range allocated for FTP tests 2025-01-27 14:06:50 -03:00
Kenneth Skovhede 91dd04177d Moved warning emit call as the server may not be fully configured yet 2025-01-27 12:59:51 +01:00
Kenneth Skovhede bee1f141ea Added UI warning for unencrypted database 2025-01-27 08:52:06 +01:00
Kenneth SkovhedeandGitHub 642967a534 Remove SHA1 Windows Hashes (#5903)
Since sha1 validation ended in 2020, there is no longer a reason to apply the SHA1 hash to files.
The verification is now only using the supported SHA256 hash.
2025-01-25 12:42:35 +01:00
Kenneth SkovhedeandGitHub 6a8edd75dc Added additional folders to MacOS. (#5899)
This adds the common "Movies" and "Public" folders to the list of special folders for MacOS (and Linux, if applicable)
2025-01-25 12:42:16 +01:00
Kenneth SkovhedeandGitHub 64aa628af9 Renaming "folders" to "items" (#5905) 2025-01-25 12:39:55 +01:00
Kenneth SkovhedeandGitHub b8e46a202d This fixes the attributes of special folders not emitted to the UI (#5906) 2025-01-25 12:39:22 +01:00
Kenneth SkovhedeandGitHub b6981d8668 This fixes errors with the Minio backend not re-throwing exceptions (#5897)
* This fixes errors with the Minio backend not re-throwing exceptions

* Throwing the correct exception ...
2025-01-22 23:29:27 +01:00
Kenneth SkovhedeandGitHub 6c493186a7 Changed MissingFileDetected message to Warning (#5893)
* Changed `MissingFileDetected` message to `Warning`

* Updated tests to match errors/warning counts
2025-01-22 21:18:33 +01:00
Kenneth SkovhedeandGitHub 997891525a Updated license-updater to update csproj files (#5898)
* Updated license-updater to update csproj files

* License updates
2025-01-22 21:04:19 +01:00
marceloduplicatiandGitHub 295d522cc9 Merge pull request #5890 from marceloduplicati/feature/add-timing-to-backendtester
Added timers to backend testing tool (in uploads)
v2.1.0.3_beta_2025-01-22
2025-01-21 12:46:40 -03:00
Marcelo C. cee1b8428d Centralizing the check on Helper function. 2025-01-21 12:45:53 -03:00
Carl-Johannes JohnsenandGitHub 298c26b6ff Merge pull request #5886 from carljohnsen/bugfix/restore-fileprocessor-read
Bugfix/restore fileprocessor read
2025-01-20 10:34:49 +01:00
Kenneth Skovhede 04205d5084 Added support for CORS 2025-01-18 11:03:52 +01:00
Marcelo C. 2e502ea7be Help Command unification
All CLI tools and executables now accept a unified set of help command variants:

"help", "/help","--help", "usage", "/usage", "--usage", "/h", "-h"

Affected executables:

Duplicati.Agent
Duplicati.CommandLine
Duplicati.CommandLine.AutoUpdater
Duplicati.CommandLine.BackendTester
Duplicati.CommandLine.BackendTool
Duplicati.CommandLine.ConfigurationImporter
Duplicati.CommandLine.SecretTool
Duplicati.CommandLine.Snapshots
Duplicati.GUI.TrayIcon
Duplicati.Server
Duplicati.Service
Duplicati.WindowsService

Note that SharpAesCrypt command is not included in this because the parameter parsing is part of the SharpAesCrypt code base.
2025-01-17 14:00:14 -03:00
marceloduplicatiandGitHub 2836e904fd Fix encoding on export backup configuration filename (#5888)
Fix for issue:
https://github.com/duplicati/duplicati/issues/5884
2025-01-17 15:14:01 +01:00
Kenneth SkovhedeandGitHub aa75334f35 Release/canary 2.1.0.107 (#5887)
* Bump ngclient to latest

* Version bump to v2.1.0.107-2.1.0.107_canary_2025-01-17

You can download this build from:

Binaries: https://updates.duplicati.com/canary/?version=2.1.0.107

Signature file: https://updates.duplicati.com/canary/duplicati-2.1.0.107_canary_2025-01-17.signatures.zip
2025-01-17 15:13:17 +01:00
Marcelo C. adc4bfa650 Added timers to backend testing tool
Also changed logic around test result, ensuring it fails when any unexpected behavior happens.
2025-01-17 09:45:49 -03:00
Carl Johnsen 628684a2f7 Added the correct PR number to the new test 2025-01-17 12:34:52 +01:00
Carl Johnsen 35bf86799b Added a unit test for restore of a partial file 2025-01-17 12:29:11 +01:00
Carl Johnsen fe7cb13fde Fixed issue with stream not being open in the correct mode during restore 2025-01-17 12:27:05 +01:00
Carl Johnsen 0861bc0a73 Added FileOpenReadWrite function 2025-01-17 12:26:03 +01:00
Kenneth SkovhedeandGitHub 045c6b9147 Feature/adjust pcloud exception (#5883)
* Fixed pCloud exception type

Changed pCloud exception to `FileMissingException` (was `FileNotFoundException`)

* Fixed a label in tests
v2.1.0.107_canary_2025-01-17
2025-01-16 22:21:16 +01:00
Kenneth Skovhede eac8cf62eb Fixed length issue for wix 2025-01-16 21:24:18 +01:00
marceloduplicatiandGitHub 08f231dd74 Fixes to timeouts on WebDav (#5878)
* Removing timeout from Webdav

The timeout will be controlled externally by the TimeoutObservingStream and or the cancellation token.

Timeout for List set to default of 10 minutes

Since filesystems may take quite sometime to list large number of files, the timeout was set to a high value.

Previous timeout of 30 seconds was triggering in a case reported by user.

Timeout for CreateFolder and DeleteAsync was kept to default of 30 seconds.

Minor formmating/refactoring was done.

* Removing timeout from Webdav

The timeout will be controlled externally by the TimeoutObservingStream and or the cancellation token.

Timeout for List set to default of 10 minutes

Since filesystems may take quite sometime to list large number of files, the timeout was set to a high value.

Previous timeout of 30 seconds was triggering in a case reported by user.

Timeout for CreateFolder and DeleteAsync was kept to default of 30 seconds.

Minor formating/refactoring was done.

* Fixes to Integrated Authentication

This is a fix to the webdav when using integrated authentication, the hint for the underlying issue was found on an old [thread] (https://github.com/dotnet/wcf/issues/2923). By setting up a vm environment with Windows 2022 Server+IIS/Webdav it was possible to reproduce the [issue](https://github.com/duplicati/duplicati/issues/5872) and fix it.

Change to validation script is to avoid the requirement of filling the username when integrated authentication is true.
2025-01-16 16:29:40 +01:00
marceloduplicatiandGitHub 5e477e7e87 Migrate from HttpWebClient to HttpClient with async/await + Refactoring (#5875)
Modernize HTTP client implementation across backend services by:
- Replace legacy HttpWebClient with modern HttpClient
- Implement proper async/await patterns throughout the codebase
- Add cancellation token support for improved request handling
- Refactor related code for better maintainability

This change is part of our broader initiative to modernize the codebase
and improve its resilience through proper asynchronous operations.
2025-01-16 16:29:16 +01:00
Kenneth SkovhedeandGitHub edd69bfd59 Improve cancel robustness 2 (#5882)
* Attempt to avoid comitting transaction without any queries being made

* Guard internal logic
2025-01-16 16:01:54 +01:00
Kenneth SkovhedeandGitHub 58bf21306a Improve S3 logic for permission tests (#5879) 2025-01-16 14:28:20 +01:00
Kenneth SkovhedeandGitHub 32a6588209 Added warning for volume size (#5877)
This adds a warning text if the user selects a very large or very small value for the `dblock-size`.

Currently "large" is over 2GiB and "small" is less than 5MiB
2025-01-16 14:27:40 +01:00
Kenneth SkovhedeandGitHub 52a73c3418 Fixed issue 5845 (#5880)
* Fixed issue 5845

This commit introduces the test that makes the error.

* Fixed query cleaning up duplicates, in the case that where a block has multiple valid source candidates.

* Reduced number of replicas for the test
2025-01-16 14:27:15 +01:00
Kenneth SkovhedeandGitHub a49af70af0 Checking if the UI channel is disposed. (#5874) 2025-01-16 13:26:12 +01:00
Kenneth Skovhede 22840d49d9 Created a more robust identifier generator 2025-01-16 09:56:54 +01:00
Kenneth Skovhede 54dde6e221 Support different namespaces for WiX v4 2025-01-16 09:51:44 +01:00
Kenneth Skovhede 4716738014 Fixed an issue with the fileId 2025-01-16 09:30:57 +01:00
Kenneth Skovhede 76bced0fb7 More wix.exe fixing 2025-01-14 20:00:15 +01:00
Kenneth SkovhedeandGitHub 15856fd46f Fixed 2 compile warnings (#5873) 2025-01-14 19:42:50 +01:00
Kenneth Skovhede fb1d15fb9d Avoid optimize after vacuum 2025-01-14 19:42:03 +01:00