Commit Graph
245 Commits
Author SHA1 Message Date
Kenneth Skovhede f5a1bcd32c Reverted the SQL query to use the Timestamp sorting instead of explicit fileset.
This fixes #2244
2017-01-11 23:48:41 +01:00
Kenneth Skovhede d3a3d8c85f Fixed a mistake in the debugging code for issue 2140 2017-01-11 13:51:56 +01:00
Kenneth Skovhede a029890409 Implemented better default error messsages 2017-01-09 11:35:38 +01:00
Kenneth Skovhede 9a849a2b58 Improved support for cross-os restores.
This fixes #1302
This fixes #1983
2017-01-06 23:01:54 +01:00
Kenneth Skovhede 8571475938 Merge branch 'feature/debug_listing_for_1400' 2017-01-06 10:03:03 +01:00
Kenneth Skovhede 684bd867ed Merge branch 'feature/debug_listing_for_2140' 2017-01-05 22:16:32 +01:00
Kenneth Skovhede 1b4cb3b5df Merge branch 'feature/implement_remote_file_recovery' 2017-01-05 22:16:25 +01:00
Kenneth Skovhede 179290d521 Added more extensive listing to further pinpoint the source of the error in #1400 2017-01-05 22:15:59 +01:00
Kenneth Skovhede fd0d0d5529 Added tracing output to track down issue #1699, #2140 and #2178 2017-01-05 21:41:21 +01:00
Kenneth Skovhede 1108d51d7f Implemented a new new list-broken-files and purge-broken-files command for the commandline to assist with handling remote file loss. 2017-01-05 16:46:01 +01:00
Kenneth Skovhede 76aae5de7b Changed the logic for getting the last-modified timestamp from the database.
Now we only look at the timestamp from the previous fileset, instead of for the last time the file was seen.
This should improve lookup times, and thus the running time for backups with many files.

This change means that the following sequence of operations will react differently:

- backup
- delete file
- backup
- undelete file
- backup

Prior to this commit, the undeleted file would be seen with the original timestamp and thus can avoid being scanned for changes.
After this commit, the file will be treated as a new file, even if it has the previous timestamp and will thus be scanned for changes.

An additional switch has been introduced, --check-filetime-only that improves the lookup further by not looking at the metadata or filesize, and thus makes a much lighter call to the database, where fewer tables need to be touched.
2017-01-05 10:03:32 +01:00
Kenneth Skovhede 3b85a77673 Minor style fixes 2017-01-05 09:57:06 +01:00
Kenneth Skovhede 4bf4871427 Added commandline operation to purge select files from filesets.
This fixes #1009.
This paves the way for #1337.
2016-12-29 22:41:13 +01:00
Kenneth Skovhede 9a227ada6b Reworked the cleanup process to allow a dangling filelist, such that this dangling entry can be used as the basis for a synthetic filelist.
Also added an option to disable synthetic filelists.
This fixes #2038.
This fixes #2101
2016-12-24 11:42:26 +01:00
Kenneth Skovhede 3182a227b9 Added additional debug info for tracing the cause of issue #1400 2016-12-23 17:04:12 +01:00
Kenneth Skovhede d8972b0f2b Removed unused memory cache code 2016-12-16 17:30:39 +01:00
Kenneth Skovhede ace2f92856 Rewrote some of the pretty printing routine to make a better log output.
Cleaned up the output by removing some of the non-relevant items.
2016-12-02 11:54:20 +01:00
Kenneth Skovhede 32423d78b5 Added EndTime value in a few places.
This fixes #2127
2016-12-02 00:08:09 +01:00
tianqiaoxiangzhe b05c5b4efd defaultvalue is not used
defaultvalue is not used
2016-12-01 09:52:30 +08:00
Kenneth Skovhede 3a034c65ff Removed some extra dispose code 2016-10-17 15:32:30 +02:00
Kenneth Skovhede 309bf1648d Merge branch 'master' into feature/fix_for_different_blockhash_and_filehash_plus_multiblocks_metadata
# Conflicts:
#	Duplicati/Library/Main/Database/LocalDatabase.cs
#	Duplicati/Library/Main/Database/LocalRecreateDatabase.cs
#	Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
#	Duplicati/UnitTest/BorderTests.cs
2016-10-17 13:28:27 +02:00
Kenneth Skovhede d381c99ca5 Updated serialization of the ResultClasses to provide nicer output.
This fixes #1912
2016-09-28 20:20:16 +02:00
Kenneth Skovhede 0c68daff6c Fixed all whitespace to be 4 spaces instead of tabs 2016-09-15 11:39:27 +02:00
Kenneth Skovhede 490776ed73 Implemented a database flag to mark a database as partially recreated.
Fixed issue with error messages when attempting to recreate a partial database for restore as described in #1695.
2016-09-13 21:55:15 +02:00
Kenneth Skovhede 0f2549aa8f Merge pull request #1750 from FootStark/hotfix/LookupLastModified
Suggested fix for lookup of file's last backup entry
2016-05-09 23:03:34 +02:00
FootStark 568cc60856 Fixed lookup of a file's last entry during backup
- Fixed SQL to create temp table for lookup of last backup's file
entries
- Removed temp table by writing directly to internal lookup struct.
- Direct lookup of single file entries from DB
2016-05-06 00:14:03 +02:00
Kenneth Skovhede a350d942e6 Fixed a case where a specially crafted broken index file could prevent the database from being recreated correctly.
This fix also optimizes recreates where data is missing in index files and block files are downloaded.
2016-05-02 20:30:38 +02:00
Kenneth Skovhede 02423b5a46 Added additional logic for getting the backup path prefixes on multi-drive backups in Windows.
This fixes #1672.
This fixes #1527.
2016-04-19 10:04:22 +02:00
Kenneth Skovhede 742eab0913 Fixed multiple cases where connections and command instances were not disposed.
This should fix all cases of "File is locked" on windows.
2016-04-06 20:40:34 +02:00
Kenneth Skovhede 32d8c18257 Fixed repair consistency check 2016-04-05 14:00:12 +02:00
Kenneth Skovhede d101f91c94 Fixed support for metadata larger than blocksize. Now supports one full blocklist of metadata, appx 300mb with default settings.
Added correct handling of metadata hashes, such that a metadata blockset is now handled the same was as a regular file blockset.
The query that creates the filesets does not support more than a single blocklist of metadata, hence the limitiation.
2016-04-04 18:11:48 +02:00
Kenneth Skovhede 72b33bcf93 Extra fixes to support larger metadata (up to appx 300 mb with default blocksize) 2016-04-03 23:54:52 +02:00
Kenneth Skovhede e40bd7f02a Proposed version, not complete with handling large metadata chunks 2016-04-03 23:10:47 +02:00
Kenneth Skovhede b92f52331e Added a check to see if there are orphan file entries 2016-03-30 12:29:22 +02:00
Kenneth Skovhede a568b1e55e Fixed query and logic for issue reported in #1644 and #1583 2016-03-30 01:30:51 +02:00
Kenneth Skovhede 6aedcea7a6 Deleted extra left parenthesis 2016-03-27 16:07:03 +02:00
Kenneth Skovhede 4df9ec1224 Rewrote query for deleting filesets to support filesets with zero entries.
This should fix issue #1583
2016-03-27 15:28:49 +02:00
Kenneth Skovhede a6699e513d Fixed the repair to also support blocksize values that are not evenly divisible with the blockhash size 2016-03-27 12:50:40 +02:00
Kenneth Skovhede a811189e82 Merge pull request #1661 from FootStark/hotfix/RecreateDatabaseError
Hotfix/recreate database error
2016-03-26 17:51:43 +01:00
FootStark d715d494ec Quickfix to restore issue
Fixes blocksize-assumption of 10KB
2016-03-26 13:14:05 +01:00
Kenneth Skovhede c71058820c Cleanup logic for fixing databases with a registered duplicate remote volume 2016-03-24 16:31:07 +01:00
Kenneth Skovhede 6cd73c1d0a Likely fix for issue #1644 and #1583 2016-03-24 16:30:19 +01:00
Kenneth Skovhede 9fdae7f0c3 Added distinct clause to guard against index files with multiple copies of the same blocklisthash 2016-03-19 22:16:22 +01:00
Kenneth Skovhede 6b18217c0a Merge branch 'feature/improved_rebuild_queries'
# Conflicts:
#	Duplicati/Library/Main/Operation/RecreateDatabaseHandler.cs
#	Duplicati/Library/Main/Operation/RepairHandler.cs
2016-03-18 14:32:43 +01:00
Kenneth Skovhede 0530cb4d52 Added repair-in-progress check to avoid continuing work on a broken database 2016-03-18 13:26:12 +01:00
Kenneth Skovhede 4be7a45067 Fixed the query to correctly compute the size of the trailing blocklisthash block. 2016-03-18 13:24:10 +01:00
Kenneth Skovhede 0ebbef0b97 Implemented feature that does not delete extra index files if their content fits the database. 2016-03-17 21:51:42 +01:00
Kenneth Skovhede ade9db9dca Utility fixes 2016-03-17 21:43:09 +01:00
Kenneth Skovhede 9a58a93894 Fixed an cleaned the rebuild SQL that picks missing blocklist hashes 2016-03-17 21:17:22 +01:00
Kenneth Skovhede 40b96fbedf Bugfix, weird order of arguments 2016-03-17 21:13:48 +01:00