 Carl Johnsen
|
46b05b94ef
|
Limit file name conflict attempts to 100 and log an error if exceeded
|
2025-01-06 16:01:53 +01:00 |
|
|
Carl Johnsen
|
6f263ad874
|
Added a note about potential memory consumption of restores FileProcessor
|
2025-01-06 16:00:11 +01:00 |
|
|
Carl Johnsen
|
284b14b72f
|
Merge branch 'master' into bugfix/restore-overwrite
|
2025-01-06 14:43:03 +01:00 |
|
|
Carl Johnsen
|
88846251b1
|
Restoring a symlink that already exists triggers an overwrite of the file, which should count towards number of files restored.
|
2025-01-06 08:14:32 +01:00 |
|
|
Carl Johnsen
|
1bea0f3696
|
Restored empty files should count towards the restoration file count.
|
2025-01-05 12:46:08 +01:00 |
|
|
Carl Johnsen
|
4cd565d592
|
Added handling of already restored timestamp-retargeted files
|
2025-01-05 12:09:38 +01:00 |
|
|
Carl Johnsen
|
b759b4564d
|
Added docstrings to new functions
|
2025-01-05 12:09:04 +01:00 |
|
|
Carl Johnsen
|
eb64320a49
|
Changed the reporting of restored files to match the legacy restore's reporting.
|
2025-01-05 11:51:52 +01:00 |
|
|
Carl Johnsen
|
637bfcefc8
|
Forgot to check whether the file exists
|
2025-01-05 11:25:19 +01:00 |
|
|
Carl Johnsen
|
eba477c271
|
Added handling of the 'overwrite' option in the new restore flow
|
2025-01-05 10:44:08 +01:00 |
|
|
Carl Johnsen
|
f76bf90e68
|
Added additional dry run logging
|
2025-01-05 10:43:23 +01:00 |
|
|
Carl Johnsen
|
8e92754efd
|
VerifyLocalBlocks now keeps track of internally verified blocks for logging
|
2025-01-05 10:43:01 +01:00 |
|
|
Carl Johnsen
|
be99f03bac
|
VerifyLocalBlocks wasn't respecting dry run properly
|
2025-01-05 10:41:33 +01:00 |
|
|
Carl Johnsen
|
a14d29da93
|
Modified VerifyTargetBlocks to also return the blocks that were verified.
|
2025-01-05 10:40:14 +01:00 |
|
|
Carl Johnsen
|
a7507fb765
|
Simplified variable assignment
|
2025-01-05 10:35:50 +01:00 |
|
|
Carl Johnsen
|
83d1617984
|
Fixed the IO calls to also work on Windows
|
2025-01-03 23:27:35 +01:00 |
|
|
Carl Johnsen
|
52018db0bb
|
Added handling and warning throwing for when the folder for restored files aren't created properly
|
2025-01-03 20:48:58 +01:00 |
|
|
Carl Johnsen
|
2d6e1d7ff7
|
Changed the new restore version to use explicit CoCoL channels
|
2024-12-10 04:10:34 +01:00 |
|
|
Carl Johnsen
|
ab7fcb2e4a
|
Opening a filestream doesn't work as expected on windows (caught in ProblematicPathTests) - changed to SystemIO.IO_OS.FileOpen*
|
2024-12-05 08:48:54 +01:00 |
|
|
Carl Johnsen
|
0e36c4393a
|
Added progress printing during restore
|
2024-12-03 10:35:33 +01:00 |
|
|
Carl Johnsen
|
76240550ed
|
Add preallocation option for restored files and update related documentation
|
2024-12-03 09:10:36 +01:00 |
|
|
Carl Johnsen
|
6ba956dfcd
|
Moved all database operations to the LocalRestoreDatabase.
Also changed the old changes, so that the functions related to the legacy restore remains untouched.
|
2024-12-03 08:35:14 +01:00 |
|
|
Carl Johnsen
|
6c66fee921
|
Cleanup FileProcessor and rework docstrings
|
2024-12-02 20:27:21 +01:00 |
|
|
Carl Johnsen
|
b6ed72bd6c
|
Reworked the restore CSP network
|
2024-12-02 15:09:23 +01:00 |
|
|
Carl Johnsen
|
3156d43adc
|
BlockVolumeReaders are expensive to create - cache them instead.
|
2024-12-02 10:55:45 +01:00 |
|
|
Carl Johnsen
|
cdf0c28fd8
|
Added internal profiling as an option. Currently only implemented in the restore process.
|
2024-11-29 05:49:03 +01:00 |
|
|
Carl Johnsen
|
87747b5580
|
The metadata SQL query is now prepared in the fileprocessor
|
2024-11-29 05:46:17 +01:00 |
|
|
Carl Johnsen
|
6aa202fbea
|
Already present files were incorrectly truncated
|
2024-11-29 03:38:53 +01:00 |
|
|
Carl Johnsen
|
deb98e3322
|
CreateDirectoryStructure wouldn't always create the target folders, if the file database doesn't list the folder. Empty files should create the directory, if it doesn't exist.
|
2024-11-28 10:43:51 +01:00 |
|
|
Carl Johnsen
|
9bcda7d6cf
|
Symlinks are now handled correctly
|
2024-11-28 09:22:09 +01:00 |
|
|
Carl Johnsen
|
1ecb6e7c35
|
Fixed the metadata block query so that it finds the correct blocks
|
2024-11-27 11:28:27 +01:00 |
|
|
Carl Johnsen
|
4128ea3ff3
|
Empty files can also not have a data block associated
|
2024-11-27 11:27:55 +01:00 |
|
|
Carl Johnsen
|
7aa9db533e
|
Added preliminary metadata restoration
|
2024-11-26 20:01:19 +01:00 |
|
|
Carl Johnsen
|
164b2a212c
|
Already restored blocks are now tracked according to the cache tracking strategy as well
|
2024-11-25 17:32:56 +01:00 |
|
|
Carl Johnsen
|
823b896da1
|
Removed redundant TODOs
|
2024-11-25 15:23:59 +01:00 |
|
|
Carl Johnsen
|
7c79535572
|
VolumeDownloader now deletes temporary volumes from both cache and disk when they are no longer needed during restore.
|
2024-11-25 15:16:03 +01:00 |
|
|
Carl Johnsen
|
27c4f93af2
|
The FileProcessor bursts as much as possible by default
|
2024-11-25 08:53:27 +01:00 |
|
|
Carl Johnsen
|
0cd9374bed
|
Added comments and docstrings
|
2024-11-22 15:26:04 +01:00 |
|
|
Carl Johnsen
|
890fa2ce52
|
Add copyright notices
|
2024-11-22 11:47:07 +01:00 |
|
|
Carl Johnsen
|
7094786e23
|
Removed unnessecarily complex nested ternary statements.
|
2024-11-22 11:26:01 +01:00 |
|
|
Carl Johnsen
|
c798910658
|
If the target file already exists and is verified, do nothing more
|
2024-11-22 11:25:35 +01:00 |
|
|
Carl Johnsen
|
cacc5d18a0
|
Added tracking of errors of local files during restoration
|
2024-11-21 15:14:29 +01:00 |
|
|
Carl Johnsen
|
916d35e928
|
Added logic for utilizing the original data when restoring, if it matches the hashes in the database.
|
2024-11-21 10:39:48 +01:00 |
|
|
Carl Johnsen
|
b9a4b8c934
|
Moved local file verification to its own function
|
2024-11-21 07:19:13 +01:00 |
|
|
Carl Johnsen
|
d109bf5db1
|
The FileProcessor now verifies whether the target file has already been restored.
|
2024-11-20 16:33:33 +01:00 |
|
|
Carl Johnsen
|
9955647768
|
Changed the bursting strategy of the FileProcessor to fill up the pipeline, and then issue a new request after every response
|
2024-11-19 11:34:10 +01:00 |
|
|
Carl Johnsen
|
4d368f5a17
|
Changed the FileProcessor to use prepared statements
|
2024-11-19 10:33:50 +01:00 |
|
|
Carl Johnsen
|
75bda5f6c7
|
Added dryrun logic and logging to the restore processes
|
2024-11-15 19:02:30 +01:00 |
|
|
Carl Johnsen
|
339e06ce9c
|
Added logging and error handling to FileProcessor
|
2024-11-15 14:50:52 +01:00 |
|
|
Carl Johnsen
|
b7aa1a3856
|
Added on-the-fly file hash verification
|
2024-11-15 13:50:45 +01:00 |
|