Commit Graph
8782 Commits
Author SHA1 Message Date
Kenneth Hsu dce5943864 Create index in memory by default but allow option to use files.
Performance is greatly improved if we can create the index in memory.
We preserve the ability to create the index using files for recovery in
low resource environments.
2020-01-23 20:41:17 -08:00
Kenneth Hsu 3c778025f4 Salvage file-based index for recovery in low memory situations.
We will plan to default to the in-memory index, but allow one to use the
file-based index if the memory requirements are too high.
2020-01-23 20:31:43 -08:00
thomas.friedelandKenneth Hsu 8848ad4a74 use SortedDict to sort index in memory 2020-01-23 20:07:29 -08:00
Kenneth Skovhede 50f979235e Version bump to v2.0.5.101-2.0.5.101_canary_2020-01-23
You can download this build from:

Binaries: https://updates.duplicati.com/canary/duplicati-2.0.5.101_canary_2020-01-23.zip

Signature file: https://updates.duplicati.com/canary/duplicati-2.0.5.101_canary_2020-01-23.zip.sig

ASCII signature file: https://updates.duplicati.com/canary/duplicati-2.0.5.101_canary_2020-01-23.zip.sig.asc

MD5: bef58029bfd633cae6a3f8b7f08ad640

SHA1: 8f4eda17aeb1f59523e9b61f3a306dc6324354a8

SHA256: 76ccb40820a6e96a9899e1f515810c9d8c4508ad4fc0509426efd39199744ead
v2.0.5.101-2.0.5.101_canary_2020-01-23
2020-01-23 14:09:07 +01:00
Kenneth SkovhedeandGitHub a64671a0c6 Merge pull request #4018 from warwickmm/refactor/fileset_removal
Refactor fileset deletion code and add tests
2020-01-23 13:52:43 +01:00
Kenneth SkovhedeandGitHub cb6af50a63 Merge pull request #4053 from warwickmm/test/recovery_tool
Add test for restoring files using RecoveryTool
2020-01-23 13:32:14 +01:00
Kenneth SkovhedeandGitHub 0f2493ad72 Merge pull request #4058 from dnrce/docker-multiarch
Build true multi-arch Docker images and add arm64
2020-01-23 13:31:14 +01:00
Kenneth Hsu 30ea3c05da Fix typo in comment. 2020-01-22 17:44:12 -08:00
warwickmmandGitHub e1937f21b8 Merge pull request #4054 from seantempleton/compactblocklist
Write blocklists when compacting files
2020-01-22 17:22:55 -08:00
Kenneth Hsu ec7d6dcc9f Merge remote-tracking branch 'upstream/master' into test/recovery_tool 2020-01-21 20:30:02 -08:00
Kenneth Hsu 35ea890f96 Merge remote-tracking branch 'upstream/master' into refactor/fileset_removal 2020-01-21 20:23:49 -08:00
warwickmmandGitHub 837a787cbf Merge pull request #4047 from warwickmm/bugfix/repair_missing_dindex
Fix bug when performing repair with missing dindex files
2020-01-21 19:46:36 -08:00
Dan Rice dae4e21750 Build docker images for arm64v8 2020-01-20 13:17:59 -05:00
Dan Rice b6720241b3 Build true multi-arch Docker images 2020-01-20 13:17:23 -05:00
Dan Rice 85f2431e7d Fix indentation of Docker README lists (address Codacy complaint) 2020-01-20 13:01:18 -05:00
Kenneth Skovhede 657b8ceda4 Merge branch 'master' of github.com:duplicati/duplicati 2020-01-20 15:55:48 +01:00
Kenneth Skovhede 002f86fc6f Changed the Fedora RPM docker build configuration to use the full Mono install, instead of the packaged Mono version as it lacks some required support libraries. 2020-01-20 14:57:32 +01:00
Sean Templeton 04662bace1 Write blocklists when compacting files
The list folder was not being written to dindex files when performing a
compact operation. After the data blocks have been moved to a new volume
and the new volume data is finished being written to the new index file,
read the blocklists from the database and write them to the new index
file.
2020-01-19 21:57:08 -06:00
Kenneth Skovhede 4c3f78e3ea Changed installers to use the signing tool instead of using GPG directly, as that prevents input timeouts that cause missing GPG signatures in releases. 2020-01-19 12:33:11 +01:00
Kenneth Skovhede c4632a7b5a Changed build to check for aws cli and github-release. 2020-01-19 12:32:30 +01:00
Kenneth Hsu 6a6224a10a Reset current directory before removing test files.
The RecoveryTool sets the currenty directory during its operation.  We
must reset the current directory so that the test teardown methods do
not complain that paths are being used by other processes.
2020-01-18 14:44:05 -08:00
Kenneth Hsu 25d7cea6c7 Dispose of HashLookupHelper after use.
The HashLookupHelper contains an open FileStream that needs to be
closed.
2020-01-18 14:44:05 -08:00
warwickmmandGitHub 0f125a6113 Merge pull request #4052 from drwtsn32x/make-env-var-tests-case-insensitive
Make environment variable tests case-insensitive
2020-01-18 09:51:39 -08:00
Kenneth Hsu bfbae6fcaf Add test for restoring files using RecoveryTool. 2020-01-18 09:36:03 -08:00
Kenneth Skovhede 11acabdcb5 Version bump to v2.0.5.100-2.0.5.100_canary_2020-01-18
You can download this build from:

Binaries: https://updates.duplicati.com/canary/duplicati-2.0.5.100_canary_2020-01-18.zip

Signature file: https://updates.duplicati.com/canary/duplicati-2.0.5.100_canary_2020-01-18.zip.sig

ASCII signature file: https://updates.duplicati.com/canary/duplicati-2.0.5.100_canary_2020-01-18.zip.sig.asc

MD5: 911efe4e2ed63db6f01f3c71a4a52327

SHA1: 7ff5dec81bf2d11140a2e68aed7b19b224729b4a

SHA256: 8ab38e73a8ca72ee594239f33d3152cebf4b4bde2e72534e5374f9eaa141a155
v2.0.5.100-2.0.5.100_canary_2020-01-18
2020-01-18 13:41:32 +01:00
Kenneth Skovhede c6703a08a1 Preparing version number for canary builds 2020-01-18 13:01:29 +01:00
Kenneth Skovhede 94941a2821 Merge branch 'release/2.0.5.1_beta' 2020-01-18 13:00:51 +01:00
Kenneth Skovhede 082a14fc22 Version bump to v2.0.5.1-2.0.5.1_beta_2020-01-18
You can download this build from:

Binaries: https://updates.duplicati.com/beta/duplicati-2.0.5.1_beta_2020-01-18.zip

Signature file: https://updates.duplicati.com/beta/duplicati-2.0.5.1_beta_2020-01-18.zip.sig

ASCII signature file: https://updates.duplicati.com/beta/duplicati-2.0.5.1_beta_2020-01-18.zip.sig.asc

MD5: 304fcc8f230921e85feb9f4097a7651d

SHA1: 42fb1e994680b6d7aebf80d05c5e1c1bd8542d2d

SHA256: 168aa8b6162586a8a16489e4ac2beece5e14e678bb01c4afcf37fbfb708482f6
v2.0.5.1-2.0.5.1_beta_2020-01-18
2020-01-18 12:31:43 +01:00
drwtsn32x b1a0353792 make tests case insensitive 2020-01-14 03:57:25 -08:00
warwickmmandGitHub d6330a7b82 Merge pull request #4043 from warwickmm/test/stop_now
Add test for interrupting backup with "stop now"
2020-01-11 10:24:54 -08:00
Kenneth Hsu 1892ba8d0a Fix poorly named test file. 2020-01-10 20:12:01 -08:00
Kenneth Hsu adc3249b9f Assert that dindex files exist. 2020-01-09 21:32:33 -08:00
Kenneth Hsu 91db2466ec Add test for repairing with missing dindex files.
This concerns issue #4046.
2020-01-09 20:18:42 -08:00
Kenneth Hsu d50f86ab7d Fix issue with repairing missing dindex files.
Since we are keeping around a reference to the IndexVolumeWriter and
BlockVolumeWriter instances, we cannot wrap their usages in using
statements.

This fixes issue #4046.
2020-01-09 19:55:27 -08:00
Kenneth Hsu f63e703a66 Add test for interrupting backup with "stop now". 2020-01-06 10:00:35 -08:00
warwickmmandGitHub 52929e9eb2 Merge pull request #4042 from seantempleton/stopnowexceptions
Fix database corruptions that can occur with "stop now".

This was a source of the "Detected non-empty blocksets with no associated blocks!" exception.
2020-01-06 09:57:44 -08:00
warwickmmandGitHub df2c70e8d2 Merge pull request #4039 from drwtsn32x/filter-cleanup
Support additional Recycle Bin paths in default Windows filters
2020-01-06 09:51:18 -08:00
warwickmmandGitHub 1663148479 Merge pull request #4034 from warwickmm/test/no_local_db_list
Add test for listing filesets without local database
2020-01-06 09:20:40 -08:00
warwickmmandGitHub 29f785dfde Merge pull request #4033 from warwickmm/test/fileset_files
Add tests to verify fileset files after purge and repair operations
2020-01-06 09:20:19 -08:00
Sean Templeton 3b6306b556 Fix exceptions caused by Stop Now
The LocalDatabase class was deleting from the BlocklistHash table based on the volume id of blocks. The deletes for the Blockset and BlocksetEntry tables were using a union query which included the same query the BlocklistHash delete was using. Changed the BlocklistHash delete query to use the union as well to ensure that all three tables would use the same query to delete the necessary rows. This fixes the "Detected non-empty blocksets with no associated blocks!" error.

Moved a write call in the DataBlockProcessor to send a volume for upload after setting blockvolume to null. This prevents a null reference exception because otherwise it would be sent to the SpillCollector and it tries to add a block, but the volume has already been closed.

Added the ? operator to the RegistryUtility class to prevent a null reference exception while debugging. It was annoying catching it in the debugger.

Fixes #4037
2020-01-05 21:43:56 -06:00
Kenneth Skovhede 2ed49540ca Version bump to v2.0.5.0-2.0.5.0_experimental_2020-01-03
You can download this build from:

Binaries: https://updates.duplicati.com/experimental/duplicati-2.0.5.0_experimental_2020-01-03.zip

Signature file: https://updates.duplicati.com/experimental/duplicati-2.0.5.0_experimental_2020-01-03.zip.sig

ASCII signature file: https://updates.duplicati.com/experimental/duplicati-2.0.5.0_experimental_2020-01-03.zip.sig.asc

MD5: a3d74f8c4e5bb4d793445e4edc2e1af7

SHA1: 020a2183d07918aaa7362f087d107b89957433e1

SHA256: 1982345eda8f77f6f73cc547996c801e5674e54d3524b4bb7ef4752a6dd3d4e6
v2.0.5.0-2.0.5.0_experimental_2020-01-03
2020-01-03 11:14:50 +01:00
Kenneth Skovhede 35ff458ea1 Prepared version numbers for 2.0.5.0 release 2020-01-03 11:03:26 +01:00
drwtsn32x f4321ea115 fix typo 2020-01-01 16:50:34 -08:00
drwtsn32x c50d07ec40 fix typo 2020-01-01 16:49:40 -08:00
drwtsn32x e55d555558 Change case of recycle bins 2020-01-01 16:43:04 -08:00
drwtsn32x 559ab450a4 Improve Windows Temp filter 2020-01-01 16:40:10 -08:00
drwtsn32x 9cabdc51d0 Improve Windows Install filter 2020-01-01 16:25:22 -08:00
drwtsn32x 7e9eb58cdd remove Temp from SystemFiles 2020-01-01 16:18:42 -08:00
drwtsn32x e15b3a9278 add slash to 'usrclass' 2020-01-01 16:05:53 -08:00
drwtsn32x 54820bc192 remove duplicate 'ntuser' line 2020-01-01 16:02:57 -08:00