Commit Graph
120 Commits
Author SHA1 Message Date
Carl Johnsen bd493638af Merge branch 'master' into performance/mssqlite-async 2025-06-02 10:39:33 +02:00
Kenneth Skovhede fb08a0b174 Fixed an issue with retry downloads causing errors 2025-05-28 12:49:29 +02:00
Kenneth Skovhede 55d821add1 Added support for disabling API extensions from the commandline
Also added extension that signals if websocket is supported.

Also removed the option to disable visual captcha as it is no longer used.
2025-05-28 12:47:42 +02:00
Kenneth Skovhede c8b9fb5c73 Websocket subscriptions
This PR adds the ability to subscribe to messages over a websocket.

To prevent polling data, the server can now push messages through the websocket, so the client can instantly update when new data is available.

The change is backwards compatible, still serving the status updates over the socket. If the client is providing the authentication token, it is auto-subscried to the legacy status message.

If the client is using the new authentication message, it needs to subscribe to get the status updates (and any other services it needs).

The event system has been extended to support new, and more accurate, events. This is the first step towards removing the general status update and the long-poll mechanism.

This also re-introduces the blocking marker, so the client can know if the operation is halted due to too many pending transfers.

Some endpoints have been moved to service implementations, to allow serving the exact same data from both endpoints and websocket.

This PR also updates the way the progress is handled, so that all transfers are returned to the client, and the transfer speeds for each transfer is calculated based on a small sample buffer, so the values are more accurate even if the program is paused during transfers.
2025-05-27 12:13:07 +02:00
Carl Johnsen ee40767412 Merge branch 'master' into performance/mssqlite-async 2025-05-27 12:04:50 +02:00
Carl Johnsen a4e608d7c4 Updated transaction propagation logic, as all commands must have a transaction 2025-05-27 06:23:49 +02:00
Kenneth Skovhede 9723b78279 Fixed nullability issues 2025-05-24 13:54:59 +02:00
Kenneth Skovhede d34b20d38a Remove Sia backend
The Sia backend implementation is based on the previous version of Sia and will no longer work after the hard fork later this year.
2025-05-22 15:28:59 +02:00
Carl Johnsen a37f0dda31 Merge branch 'master' into performance/mssqlite-async 2025-05-22 14:09:17 +02:00
Carl Johnsen b399adf534 BeginTransactionSafe() was a legacy helper method that called BeginTransaction() directly 2025-05-22 13:27:36 +02:00
Carl Johnsen 37039f467e Removed whitespace 2025-05-22 13:26:55 +02:00
Kenneth Skovhede ef631a1199 Added feature to suppress warnings
This PR adds the option to suppress warnings by their log id. Warning IDs that are supplied to `--suppress-warnings` will be converted to information messages before being logged.

If a specific warning is disabled, such as `CompressionReadErrorFallback`, this will then no longer count as a warning for the job, and the log file will see the warning as an information message.

This PR also adds two simpler filter options that makes it possible to filter log messages by supplying the log IDs. This can already be achieved with log filters, but the ID filter is a bit simpler to apply, as you only need to know the ID.

Finally, this PR also adds common logging for errors in the categories:
- Permission denied, id = `PermissionDenied`
- File locked, id = `FileLocked`
- Path not found, id = `PathNotFound`
- Path too long, id = `PathTooLong`

These new log ids makes it simpler to ignore warnings about locked or inaccesible files.
2025-05-20 14:26:10 +02:00
Carl-Johannes JohnsenandGitHub 3de03e51de Merge pull request #6258 from carljohnsen/cleanup/remove-legacy-dependencies 2025-05-16 18:01:27 +02:00
Kenneth Skovhede 6750779982 Register remote control for TrayIcon
This adds the option to register for remote control on the TrayIcon or Server via commandline arguments.

This fixes #6255
2025-05-16 11:42:50 +02:00
Carl Johnsen 388e849324 Converted tabs to spaces 2025-05-16 10:25:08 +02:00
Carl Johnsen 8be97bcefd Whitespace changes 2025-05-16 10:22:51 +02:00
Carl Johnsen 58db4c9753 Restructured ItemGroups 2025-05-16 10:15:31 +02:00
Kenneth Skovhede 236d6e6086 Fixed an outdated string 2025-05-12 15:26:04 +02:00
Kenneth Skovhede 5630c5e34a Fixed default config no longer loading 2025-05-12 15:11:46 +02:00
Kenneth Skovhede c9f985ecdd Final removal of FIXMEGlobal 2025-05-05 16:13:46 +02:00
Kenneth Skovhede 0bc335598a Removed the LogWriteHandler from FIXMEGlobal 2025-05-05 13:41:28 +02:00
Kenneth Skovhede 467c6eb44c One more removal from FIXMEGlobal 2025-05-04 12:21:06 +02:00
Kenneth Skovhede 1947b93a73 One more FIXMEGlobal fix 2025-05-04 12:17:44 +02:00
Kenneth Skovhede 71e926beea One more FIXMEGlobal property removed 2025-05-04 12:13:15 +02:00
Kenneth Skovhede eaf6fe5f26 One more FIXMEGlobal removal 2025-05-03 16:25:24 +02:00
Kenneth Skovhede d788f44ef3 One more removed property 2025-05-03 16:03:37 +02:00
Kenneth Skovhede 16acb282c9 More FIXMEGlobal cleanup 2025-05-03 15:54:23 +02:00
Kenneth Skovhede 072f89c747 Remove WorkerThread class
This removes the WorkerThread class and many of the complications around it.

Instead of having a generic worker, there is now the `QueueRunnerService` which takes on all the resposibilities for handling queued tasks.

This is one step towards removing `FIXMEGlobal`
2025-05-03 15:01:09 +02:00
Kenneth Skovhede 4ecb85d2de Added task metadata
This adds the task start and finish time.

The tracking of completed tasks has been moved to a separate service to reduce the use of FIXMEGlobal.
2025-05-02 15:11:34 +02:00
Kenneth Skovhede ab6ef6c60b Fixed minor issues with the listing method 2025-04-30 16:11:46 +02:00
Kenneth Skovhede 2f0a5af416 Implemented a new API for the new list operations.
The new API avoids using HTTP status codes and verbs.

Added new structure for having a similar response envelope and pagination support for V2 calls.

Added extensions to the systemInfo call so the client knows if the V2 methods are available.
2025-04-29 14:41:51 +02:00
Kenneth Skovhede 385581a16c Fixed minor issue with clearing metadata 2025-04-25 17:32:52 +02:00
Kenneth SkovhedeandGitHub af9465d8e3 Merge pull request #6187 from duplicati/feature/fix-throttle-speeds
Fixed throttle support
2025-04-25 15:36:44 +02:00
Kenneth Skovhede ba298df915 Added an upgrade command to the database tool 2025-04-25 12:30:03 +02:00
Kenneth Skovhede a0ecc5e05d Added a database downgrade tool 2025-04-24 16:36:14 +02:00
Kenneth Skovhede f393c00030 Fixed throttle support
This moves the throttle support to the StreamUtil throttled stream, which allows multiple streams to share a throttle value, such that the throttle setting is applied to the entire communication from Duplicati, and not for each connection.

This also cleans up a bit in the progress reporting, where the backend manager now keeps track of the "active" transfer and only emits progress on that. Once it finishes, a new transfer is promoted a "active".
2025-04-22 22:54:48 +02:00
Kenneth Skovhede c3c9105d26 Fixed an issue where schedules would be invisible in the UI but still work. 2025-04-17 18:03:14 +02:00
Kenneth Skovhede 055ec31d76 Introduced a PackageRef project to force updated packages to be used throughout the solution. 2025-04-16 16:38:21 +02:00
Kenneth Skovhede eaed3b7ca9 Updated the caching package 2025-04-16 16:01:44 +02:00
Kenneth Skovhede faede65d8d Changed transactions to use a wrapper that ensures a transaction is allocated. 2025-04-14 12:04:00 +02:00
Kenneth Skovhede f0f68dfebf Fix locale-sensitive time parsing
On some locales, odd strings would parse as valid full dates, causing relative dates to be incorrectly calculated.

This commit fixes the issues and revisits the DST aware calculations with more tests.
2025-04-08 23:38:36 +02:00
Kenneth SkovhedeandGitHub cfc322c629 Merge pull request #6122 from duplicati/feature/remove-positional-sql-arguments
Remove positional arguments from SQL queries
2025-04-04 11:49:36 +02:00
Kenneth Skovhede 8703f2c014 Fixed a bug with settings after sql queries were updated 2025-04-03 17:05:13 +02:00
Kenneth Skovhede 0b735d79ff More cleanup and a few bug fixes 2025-04-03 16:38:51 +02:00
Kenneth Skovhede 451c8168fc Added Connection 2025-04-03 13:59:07 +02:00
Kenneth Skovhede d12b57cb71 Add support for pre-authenticated headers
This adds support for providing a custom defined token instead of using the JWT tokens.

The intended use is for deployments where the authentication is provide by a different layer (a proxy service).
2025-03-28 13:47:27 +01:00
Kenneth Skovhede 2b06faaf4f Added simple sorting support to backend 2025-03-26 15:58:06 +01:00
Kenneth SkovhedeandGitHub 4f81771681 Merge pull request #6085 from duplicati/feature/report-current-update-channel-in-reports
Added metadata to reports to report current update channel
2025-03-25 16:36:50 +01:00
Kenneth Skovhede b754caccc3 Added metadata to reports to report current update channel 2025-03-25 12:34:54 +01:00
Kenneth Skovhede 1a38df7709 Cleaned up some callbacks to not use events with async methods.
Implemented argument validation for the TrayIcon and server startup.
2025-03-25 11:14:03 +01:00