Carl Johnsen
66df6afc34
Changed the downloader to move the download waiting to the decrypter
2024-11-13 14:31:37 +01:00
Carl Johnsen
d0639ee0ae
Fixed bug that would leave the restore database in a locked state
2024-11-13 14:30:35 +01:00
Carl Johnsen
569e927e13
Added an explicit wait for backend to complete after running the restore
2024-11-13 14:27:46 +01:00
Carl Johnsen
c5eaf409c9
Added preliminary scaling parameters
2024-11-13 14:27:19 +01:00
Carl Johnsen
284755c6b1
Rather than uncompressing everything, only decompress the requested block.
2024-11-12 13:47:25 +01:00
Carl Johnsen
09e04e76d0
Now the restore chain also forwards the block id
2024-11-12 13:45:32 +01:00
Kenneth Skovhede
81c0b2209e
Fixed a warning when using S3
2024-11-11 21:20:21 +01:00
Carl Johnsen
b686cd4934
Changed from ConcurrentDictionary to MemoryCache, to utilize their cache eviction logic.
2024-11-11 13:02:24 +01:00
Carl Johnsen
48302bf395
Fixed bug where the block lists may not be aligned when decompressing.
2024-11-11 13:01:00 +01:00
Kenneth Skovhede
3bac3dbae3
Added package type ids when sending usage reports to track individual package type usage.
...
Added package type id to download checker header for future use.
2024-11-09 23:00:20 +01:00
Kenneth Skovhede and GitHub
e9163e611a
Merge pull request #5659 from marceloduplicati/feature/send-script-messages-tolog
...
Add feature to send messages to Log/Report from script
2024-11-09 07:47:12 +01:00
Carl Johnsen
afa2e9bf07
Added more progress keeping and running the original verification step.
2024-11-08 16:05:57 +01:00
Carl Johnsen
6f354e6d08
Added some progress tracking and removed some debug printing
2024-11-08 15:24:56 +01:00
Carl Johnsen
459664d33b
Added restore channel buffer sizes as a variable
2024-11-08 14:38:24 +01:00
Carl Johnsen
ec738f4063
Added handling of retired exception to close down the process network
2024-11-08 14:35:44 +01:00
Carl Johnsen
78aa077c2b
Handled empty files, where the block volume ID is -1
2024-11-08 13:26:29 +01:00
Carl Johnsen
4d7c8e2455
Volumes in flight should be a concurrent collection, as it's accessed through multiple Tasks
2024-11-08 13:01:05 +01:00
Kenneth Skovhede
6ffbc94477
Merge commit '448dd1a99eb4e6f0c5c84fc610dfe2f48e10d69d' into feature/update-avalonia
2024-11-08 10:58:10 +01:00
Kenneth Skovhede and GitHub
c96d2e0b7c
Merge pull request #5655 from marceloduplicati/feature/warnings-cleanup-lowimpactwarnings
...
Further progress on removal of build warnings.
2024-11-08 10:54:57 +01:00
Kenneth Skovhede and GitHub
3b38cdb9ca
Merge pull request #5653 from marceloduplicati/feature/fix-telegram-notification
...
Fix to telegram notification
2024-11-08 10:54:20 +01:00
Kenneth Skovhede and GitHub
d88342101f
Merge pull request #5657 from duplicati/feature/fix-loading-slowness
...
Feature/fix loading slowness
2024-11-08 10:53:34 +01:00
Marcelo Ceccon
671c88eeff
Add feature to send messages to Log/Report from script
...
This works by parsing the stdout stream, line by line, looking for lines that start with the prefixes LOG:WARN, LOG:ERROR, LOG:INFO and forwarding them to the Log/Report.
In a script that could be used with a simple echo "LOG:WARN Some warning" or even if its an executable application, if it outputs to sdtout lines with the prefix, it will of course also be captured.
2024-11-08 10:49:58 +01:00
Kenneth Skovhede
be0ac25eef
Bumped Avalonia to match latest Tmds package
2024-11-08 10:47:55 +01:00
Carl Johnsen
997472127a
FileProcessor now writes to disk - the initial circle is complete!
2024-11-08 10:43:19 +01:00
Carl Johnsen
f6839160f2
Channels now send the volume / block id around alongside the volume / block
2024-11-08 10:42:54 +01:00
Carl Johnsen
153ef7ed6c
Added decompressor initial process
2024-11-08 10:42:11 +01:00
Kenneth Skovhede
1b07fadd88
Moved systemInfo into a service with cache so it can preload
2024-11-08 10:07:03 +01:00
Carl Johnsen
d4a073cc8d
Fixed typo
2024-11-08 10:06:00 +01:00
Kenneth Skovhede
2c63c0d9e8
Fixed loading slowness, caused by AmazonSecretManagerConfig performing network queries on property access.
2024-11-08 10:05:55 +01:00
Carl Johnsen
cb5b973883
Added a TODO in BlockManager
2024-11-08 09:59:39 +01:00
Carl Johnsen
bd52be6f6b
Added dummy decrypter process
2024-11-08 09:55:17 +01:00
Carl Johnsen
5955cbc036
Modified the VolumeDownloader so that it works
2024-11-08 09:13:54 +01:00
Carl Johnsen
2ecb25483e
Moved backend initialization to the outside of the restore process network
2024-11-08 09:13:26 +01:00
Carl Johnsen
50aa530883
db wasn't properly set in the BlockManager's internal cache
2024-11-08 08:45:20 +01:00
Carl Johnsen
a6f6cb7f39
CoCoL did not like the array of ChannerMarkers
2024-11-08 08:45:00 +01:00
Carl Johnsen
82669da2d2
Channel arrays weren't instantiated correctly
2024-11-08 08:02:36 +01:00
Carl Johnsen
b41b43f430
Now the volume ID is found alongside the block ID
2024-11-08 08:02:17 +01:00
Carl Johnsen
adf9d4acf4
Added the draft block manager
2024-11-08 07:20:18 +01:00
Carl Johnsen
50c6fb434c
Got the list of block IDs per file
2024-11-08 05:56:48 +01:00
Carl Johnsen
bc9c7beb97
Using simplified collection creation expression
2024-11-08 03:56:39 +01:00
Carl Johnsen
60fa5fe031
Started the draft FileProcessor process
2024-11-08 03:55:46 +01:00
Carl Johnsen
494c1d9f3e
Moved local restore database creation outside of the filelister - the other processes might need this as well.
2024-11-08 03:55:15 +01:00
Carl Johnsen
027d777fe0
First draft of the Restore.FileLister process
2024-11-08 03:31:30 +01:00
Carl Johnsen
69fd383c71
Started the rework of RestoreHandler's Run()
2024-11-08 03:31:04 +01:00
Marcelo Ceccon
d4d9c47824
Further progress on removal of build warnings.
...
None of these changes have impact on code execution, they are mainly part of the effort to remove all build warnings.
The removal of Thread.ResetAbort leaves a TODO for us to integrate CancelationToken when it gets propagated down here on future changes.
2024-11-07 18:02:15 +01:00
Marcelo Ceccon
706e490f79
Upgrading AWS SDK to latest
...
This also resolves a series of warnings produced by unequalized versions between AWSSDK.Core and AWSSDK.S3 references.
The decision to not upgrade Minio (which is rather dated) is because starting at 4.0.0 several calls were made obsolete including the constructor. A specific feature branch will be opened to integrate the new version and run CI tests.
2024-11-07 17:33:44 +01:00
Marcelo Ceccon
28414dd744
Fix to telegram notification
...
Fixes the Telegram notification to use the correct API URL and to send the message in chunks if it is too long.
Will add this to the documentation.
First create your telegram bot by messaging the @BotFather
For more information https://core.telegram.org/bots
Once you have created your bot you will have a bot token.
Now on the bot channel, send one message, “Hello”. This is important because the bot cannot initiate a conversation, it can only respond, so therefore that is the only way to obtain the chatId which needs to be configured on Duplicati.
Now on a browser or curl, access:
https://api.telegram.org/botYOURBOTTOKEN/getUpdates
Look for the property
"chat":{"id”:111122233,
One way to get that with curl is:
BOT_TOKEN="YOURBOTTOKEN" curl -s "https://api.telegram.org/bot$BOT_TOKEN/getUpdates " | grep -o '"id":[0-9]*' | head -1 | cut -d':' -f2
2024-11-07 14:57:23 +01:00
Kenneth Skovhede
5e97c0e466
Added a similar fix to the usagereporter exit
2024-11-07 14:04:30 +01:00
Carl Johnsen
b5745a3be0
Added initial volume downloader process
2024-11-07 10:04:52 +01:00
Kenneth Skovhede and GitHub
108a7c3634
Merge pull request #5645 from duplicati/feature/cpu-intensity-help-update
...
Added possible values to `cpu-intensity` for better documentation
2024-11-07 08:55:34 +01:00
Carl Johnsen