Commit Graph
10886 Commits
Author SHA1 Message Date
Kenneth SkovhedeandGitHub f7b7555e87 Fixes for tests (#5918)
* Two small test fixes

* Ignore exceptions when comitting an empty transaction

* Attempt to fix FTP connection issue

* Unified test by having a single download function.
Added DNS probing call to attempt fixing sporadic DNS errors.

* Fixed argument order

* Avoid creating temp file during tests, if not needed
2025-01-28 08:55:28 +01:00
Kenneth SkovhedeandGitHub d99f74ed94 Rewrite the backend manager. (#5896)
* Rewrite the backend manager.

This creates a new more logic backend manager that handles all backend operations.

For each top-level operation, there is now a single backend manager instance that is passed to sub-commands.

The internals of the backend manager are now rewritten to use async logic instead of threading.

The design uses a single task runner that dispatches operations and honors concurrent settings and limits from one place.

The logic for each operation has been moved into a separate files/classes to make it easier to understand each operation.

This fixes #5804

* Fixed a few issues with not awaiting tasks

* Fixed not creating empty databases

* Fixed an issue with hashes not being recorded on download

* Reworked the download logic to avoid attempting to decrypt the file if it has been modified.

* Review fixes

* Renamed db collector to better reflect the purpose.

* Review fixes
2025-01-28 08:54:50 +01:00
Kenneth Skovhede 8c105c9e92 Added help links based on review feedback 2025-01-27 23:17:43 +01:00
Kenneth Skovhede 7a78f72f19 Updated warning message based on review 2025-01-27 23:17:23 +01:00
Kenneth Skovhede 27f0bb4ea0 Unified code to find the data folder.
The `machineid.txt` and `installation.txt` files are now default located in same folder where the database is default located.
2025-01-27 22:51:45 +01:00
Kenneth Skovhede a819f34b37 Improved logging for WindowsServer 2025-01-27 22:49:29 +01:00
Carl Johnsen 6993969dde Implement dry run option in the Remote Synchronization Tool 2025-01-27 21:26:06 +01:00
Carl Johnsen b025c9af01 Added passing all of the commandline options to the inner run method 2025-01-27 21:25:18 +01:00
marceloduplicatiandGitHub a27dce7668 Merge pull request #5920 from duplicati/feature/ci-ftp-fix
Fixing the port range allocated for FTP tests
2025-01-27 14:51:45 -03:00
Marcelo C. 16627af766 Fixing the port range allocated for FTP tests 2025-01-27 14:06:50 -03:00
Kenneth Skovhede c1d89e32e9 Guard against name clashes for Windows folder 2025-01-27 13:09:35 +01:00
Kenneth Skovhede db3d74e34c Moved warning emit call as the server may not be fully configured yet 2025-01-27 13:00:10 +01:00
Kenneth Skovhede 91dd04177d Moved warning emit call as the server may not be fully configured yet 2025-01-27 12:59:51 +01:00
Kenneth Skovhede 805d3b1c31 Added special handling of Linux to avoid storing data in the root of the filesystem 2025-01-27 11:51:03 +01:00
Kenneth Skovhede c05b00ae0b Implemented support for avoiding storing data in the Windows folder 2025-01-27 11:49:17 +01:00
Kenneth Skovhede 97d62163c5 Renamed methods for database path to better distinguish what they do 2025-01-27 11:46:24 +01:00
Carl Johnsen c0f4146ba7 Changed the rsync unit test to use the test folders and generate test data 2025-01-27 10:06:49 +01:00
Carl Johnsen 3c62fb7e39 Preliminary rsync tool test implemented. 2025-01-27 09:53:48 +01:00
Kenneth Skovhede bee1f141ea Added UI warning for unencrypted database 2025-01-27 08:52:06 +01:00
Carl Johnsen 42d54a47f7 Formatting 2025-01-27 08:37:32 +01:00
Carl Johnsen 4e5282ccfd After a rename, the original file should be deleted. 2025-01-27 08:35:48 +01:00
Carl Johnsen 54736ff449 Remove redundant System. 2025-01-27 08:34:58 +01:00
Carl Johnsen 0e291bbeab Reuse memorystream when applicable 2025-01-27 08:34:41 +01:00
Carl Johnsen 71376b156f Changed to use async when available 2025-01-27 08:30:12 +01:00
Kenneth SkovhedeandGitHub 642967a534 Remove SHA1 Windows Hashes (#5903)
Since sha1 validation ended in 2020, there is no longer a reason to apply the SHA1 hash to files.
The verification is now only using the supported SHA256 hash.
2025-01-25 12:42:35 +01:00
Kenneth SkovhedeandGitHub 6a8edd75dc Added additional folders to MacOS. (#5899)
This adds the common "Movies" and "Public" folders to the list of special folders for MacOS (and Linux, if applicable)
2025-01-25 12:42:16 +01:00
Kenneth SkovhedeandGitHub 64aa628af9 Renaming "folders" to "items" (#5905) 2025-01-25 12:39:55 +01:00
Kenneth SkovhedeandGitHub b8e46a202d This fixes the attributes of special folders not emitted to the UI (#5906) 2025-01-25 12:39:22 +01:00
Kenneth SkovhedeandGitHub b6981d8668 This fixes errors with the Minio backend not re-throwing exceptions (#5897)
* This fixes errors with the Minio backend not re-throwing exceptions

* Throwing the correct exception ...
2025-01-22 23:29:27 +01:00
Kenneth SkovhedeandGitHub 6c493186a7 Changed MissingFileDetected message to Warning (#5893)
* Changed `MissingFileDetected` message to `Warning`

* Updated tests to match errors/warning counts
2025-01-22 21:18:33 +01:00
Kenneth SkovhedeandGitHub 997891525a Updated license-updater to update csproj files (#5898)
* Updated license-updater to update csproj files

* License updates
2025-01-22 21:04:19 +01:00
Carl Johnsen f64d090fda Added preliminary commandline argument parsing to remote synchronization 2025-01-22 09:37:28 +01:00
Carl Johnsen af69436a1e Added preliminary unittest for the remote synchronization tool 2025-01-22 06:10:43 +01:00
marceloduplicatiandGitHub 295d522cc9 Merge pull request #5890 from marceloduplicati/feature/add-timing-to-backendtester
Added timers to backend testing tool (in uploads)
v2.1.0.3_beta_2025-01-22
2025-01-21 12:46:40 -03:00
Marcelo C. cee1b8428d Centralizing the check on Helper function. 2025-01-21 12:45:53 -03:00
Carl Johnsen a2b13b1805 Add copyright notice and licensing to the remote synchronization tool 2025-01-21 15:22:04 +01:00
Carl Johnsen 3b2836ce7a Merge remote-tracking branch 'upstream/master' into feature/rsync_tool 2025-01-21 15:21:01 +01:00
Carl Johnsen ce3583c388 Add additional TODO comments for future enhancements 2025-01-21 15:18:32 +01:00
Carl Johnsen d97e9073f4 Add rename functionality to remote synchronization tool 2025-01-21 15:16:59 +01:00
Carl Johnsen 3d93c4885b Implement file deletion functionality in remote synchronization tool 2025-01-21 15:16:42 +01:00
Carl Johnsen 7b64f0da92 Added functions for verifying the file list 2025-01-21 15:14:50 +01:00
Carl-Johannes JohnsenandGitHub 298c26b6ff Merge pull request #5886 from carljohnsen/bugfix/restore-fileprocessor-read
Bugfix/restore fileprocessor read
2025-01-20 10:34:49 +01:00
Carl Johnsen fcb41ebec9 Added TODO comments in the rsync tool 2025-01-20 07:58:39 +01:00
Carl Johnsen 85833a2ff5 Added a copy function to the rsync tool 2025-01-20 07:58:21 +01:00
Kenneth Skovhede 04205d5084 Added support for CORS 2025-01-18 11:03:52 +01:00
Marcelo C. 2e502ea7be Help Command unification
All CLI tools and executables now accept a unified set of help command variants:

"help", "/help","--help", "usage", "/usage", "--usage", "/h", "-h"

Affected executables:

Duplicati.Agent
Duplicati.CommandLine
Duplicati.CommandLine.AutoUpdater
Duplicati.CommandLine.BackendTester
Duplicati.CommandLine.BackendTool
Duplicati.CommandLine.ConfigurationImporter
Duplicati.CommandLine.SecretTool
Duplicati.CommandLine.Snapshots
Duplicati.GUI.TrayIcon
Duplicati.Server
Duplicati.Service
Duplicati.WindowsService

Note that SharpAesCrypt command is not included in this because the parameter parsing is part of the SharpAesCrypt code base.
2025-01-17 14:00:14 -03:00
marceloduplicatiandGitHub 2836e904fd Fix encoding on export backup configuration filename (#5888)
Fix for issue:
https://github.com/duplicati/duplicati/issues/5884
2025-01-17 15:14:01 +01:00
Kenneth SkovhedeandGitHub aa75334f35 Release/canary 2.1.0.107 (#5887)
* Bump ngclient to latest

* Version bump to v2.1.0.107-2.1.0.107_canary_2025-01-17

You can download this build from:

Binaries: https://updates.duplicati.com/canary/?version=2.1.0.107

Signature file: https://updates.duplicati.com/canary/duplicati-2.1.0.107_canary_2025-01-17.signatures.zip
2025-01-17 15:13:17 +01:00
Marcelo C. adc4bfa650 Added timers to backend testing tool
Also changed logic around test result, ensuring it fails when any unexpected behavior happens.
2025-01-17 09:45:49 -03:00
Carl Johnsen 628684a2f7 Added the correct PR number to the new test 2025-01-17 12:34:52 +01:00