Commit Graph
3969 Commits
Author SHA1 Message Date
Daniel Gehriger 0b43c467c7 Merge remote-tracking branch 'upstream/master' into feature/usn 2018-04-25 17:19:13 +02:00
Kenneth Skovhede 83950e78c6 Merge branch 'feature/ignore_filenames_option' into feature/exclude_empty_folders
# Conflicts:
#	Duplicati/Library/Main/Operation/Backup/CountFilesHandler.cs
#	Duplicati/Library/Main/Operation/Backup/FileEnumerationProcess.cs
#	Duplicati/Library/Main/Operation/BackupHandler.cs
#	Duplicati/Library/Main/Operation/TestFilterHandler.cs
#	Duplicati/Library/Main/Options.cs
#	Duplicati/Library/Main/Strings.cs
2018-04-24 14:46:46 +02:00
Kenneth Skovhede c6be934747 Implemented empty folder exclusion flag 2018-04-24 13:11:03 +02:00
Kenneth Skovhede e51e1b9e5a Implemented option to use exclude filenames to mark folders for exclusion by placing a specially named file inside 2018-04-24 11:25:37 +02:00
Daniel Gehriger 7bf0a25912 Revert "Merge remote-tracking branch 'upstream/feature/fix_path_storage' into feature/usn"
This reverts commit 10d6b4c31c, reversing
changes made to 1af7f9e0ca.
2018-04-23 23:02:52 +02:00
Daniel Gehriger 10d6b4c31c Merge remote-tracking branch 'upstream/feature/fix_path_storage' into feature/usn 2018-04-23 22:57:32 +02:00
Kenneth Skovhede a8a32ea115 Added refactoring to improve the storage requirements for the local database, and speed up various queries.
This fixes #1283
2018-04-23 22:31:47 +02:00
Daniel Gehriger 1af7f9e0ca Merge remote-tracking branch 'upstream/master' into feature/usn 2018-04-23 22:28:27 +02:00
Daniel Gehriger 8ff7681b89 Enabling USN in conjunction with snapshots 2018-04-23 11:45:18 +02:00
Daniel Gehriger fd70a9e16c Recording previous journal data as default if change journal cannot be used 2018-04-23 10:57:44 +02:00
Kenneth Skovhede 914b17055c Merge branch 'master' into concurrent_processing 2018-04-23 09:57:49 +02:00
Daniel Gehriger 6ce298b4af Fixed USN in conjunction with snapshots on Windows 2018-04-22 23:37:45 +02:00
Daniel Gehriger a7d60d88d7 Fixed post-processing of modified file list obtain from USN 2018-04-22 23:03:15 +02:00
Daniel Gehriger 59af7c8057 Fixed case of Duplicati.Library.Utility.Utility.GetEntryAssembly() 2018-04-21 00:10:59 +02:00
Daniel Gehriger 8c1322273e Updated comment to retrigger AppVeyor 2018-04-20 23:51:26 +02:00
Daniel Gehriger b97d4e0dbb Correctly filtering list of changed files / folders using exclusion filter 2018-04-20 17:30:08 +02:00
Daniel Gehriger 96d1390412 Disabling USN for now when snapshots are used - this will be enabled shortly 2018-04-20 09:44:48 +02:00
Daniel Gehriger 8af63b1d5d Fixed some of the issues reported by codacy. The others are incorrect warnings. 2018-04-20 09:17:06 +02:00
Daniel Gehriger 2c1a0ddb4e Implemented backup based on changes recorded in NTFS USN journal 2018-04-19 22:59:28 +02:00
Tyler Gill c38654a314 Replace constant strings with cached readonly values. 2018-04-18 10:29:14 -06:00
Tyler Gill 10cfc28fb5 Use Utility.AppendDirSeparator to create SpecialFolder default filters. 2018-04-18 10:28:14 -06:00
Tyler Gill f2d7283be5 Fix folder path getter to not have an infinite recusion problem. 2018-04-16 13:07:12 -06:00
Tyler Gill 5185ee881d The way Duplicati matches folders against filters, the filter needs to either end with a wildcard or a slash in order to match.
However, the 'control_dir_v2', 'Windows.old', and the various Environment.SpecialFolders filters did not have trailing slashes, leading to these filters not actually applying when they should.
This change fix the few specific filters that need this specification, and adds a new utiltiy method to produce filters for SpecialFolders in a way that makes sure they end with a trailing slash.
2018-04-16 13:04:19 -06:00
Kenneth Skovhede e9f01b61bd Removed the messages/warnings/errors data from the output, so it only shows up in the log area, instead of showing up twice 2018-04-15 22:47:11 +02:00
Kenneth Skovhede 71a97c0623 Fixed an issue with test-filter that caused it to hang 2018-04-12 22:02:52 +02:00
Kenneth Skovhede da7f705def Merge branch 'master' into concurrent_processing
# Conflicts:
#	Duplicati/Library/Main/Operation/BackupHandler.cs
2018-04-12 22:02:31 +02:00
Kenneth Skovhede 64c8f72143 Added some code to ensure that files that are included by default are also reported in the log (and the test-filter command) 2018-04-12 20:56:15 +02:00
Kenneth Skovhede cdd3c7b63c Merge branch 'master' into concurrent_processing 2018-04-12 15:10:03 +02:00
Kenneth SkovhedeandGitHub b3d1f19177 Merge pull request #3169 from tygill/feature/filter-groups
Add filter groups to replace default filters
2018-04-12 15:09:10 +02:00
Kenneth Skovhede de84650eae Rewrote the logic for reporting JSON to avoid reporting JSON inside a text blob, but instead use an extra tag in the JSON.
The logic is currently that the template is scanned for potential values, and those that are found are reported in the extra tag for the JSON.
A bit clumsy, but allows the user to choose specific fields to include in the reported data.
2018-04-12 11:46:54 +02:00
Kenneth Skovhede 4e5f4a12bf Merge branch 'master' into feature/filters-for-sendmail
Integrated changes to support log-lines and to have a common shared module for reporters

# Conflicts:
#	Duplicati/Library/Modules/Builtin/Duplicati.Library.Modules.Builtin.csproj
#	Duplicati/Library/Modules/Builtin/RunScript.cs
#	Duplicati/Library/Modules/Builtin/SendHttpMessage.cs
#	Duplicati/Library/Modules/Builtin/SendJabberMessage.cs
#	Duplicati/Library/Modules/Builtin/SendMail.cs
2018-04-12 11:16:57 +02:00
Kenneth SkovhedeandGitHub 36332ed284 Merge pull request #3173 from StephenGregory/export-result-into-different-formats
Export result into different formats
2018-04-12 10:20:43 +02:00
Kenneth SkovhedeandGitHub 0a90c23403 Merge pull request #3172 from ltfish/fix/cache_envvar_filesystemcasesensitive
Cache IsFSCaseSensitive to speed up file counting.
This fixes #3167
2018-04-12 09:49:54 +02:00
Kenneth SkovhedeandGitHub 3b55cfb570 Merge pull request #3170 from epol/master
Solved some codacy warnings on OpenStackStorage
2018-04-12 09:47:43 +02:00
Stephen Gregory b53e62ddfc Ignore non-meaningful result properties when serializing to JSON 2018-04-11 22:42:03 -02:30
Stephen Gregory b7bda1d1c4 Add result serializers 2018-04-11 22:40:44 -02:30
Stephen Gregory 5a59930ed6 Clean up serializing result to custom Duplicati format 2018-04-11 22:40:44 -02:30
Stephen Gregory 637e5a4a48 Change method signature of ResultSerializer 2018-04-11 22:40:43 -02:30
Stephen Gregory 46170de84e Extract result serialization to file 2018-04-11 22:40:42 -02:30
Kenneth Skovhede 9eef035924 Fixed a case where the counter process would eat the output from the backup operation 2018-04-11 23:34:51 +02:00
Kenneth Skovhede 79f7b22e0f Merge branch 'master' into concurrent_processing
Changed a few things on the way, removing the log process

# Conflicts:
#	Duplicati/Library/Main/Controller.cs
#	Duplicati/Library/Main/Database/ExtensionMethods.cs
#	Duplicati/Library/Main/Database/LocalBackupDatabase.cs
#	Duplicati/Library/Main/Duplicati.Library.Main.csproj
#	Duplicati/Library/Main/Operation/BackupHandler.cs
#	Duplicati/Library/Main/Operation/FilelistProcessor.cs
#	Duplicati/Library/Main/Operation/PurgeBrokenFilesHandler.cs
#	Duplicati/Library/Main/Operation/TestFilterHandler.cs
#	Duplicati/Library/Main/Options.cs
#	Duplicati/Library/Main/ResultClasses.cs
#	Duplicati/UnitTest/BasicSetupHelper.cs
2018-04-11 23:02:47 +02:00
Enrico Polesel 904616aff5 Solved some codacy warnings on Duplicati/Library/Backend/OpenStack/OpenStackStorage.cs 2018-04-11 11:44:05 +02:00
Fish 03fe3729cf Cache IsFSCaseSensitive to speed up file counting.
"IsFSCaseSensitive" used to call GetEnvironmentVariable() every time it
was accessed, which unnecessarily slows down the file counting procedure.
Caching the value of this environment variable speeds up things quite a
bit.
2018-04-10 20:46:03 -07:00
Tyler Gill a3a98c644a Merge branch 'master' of https://github.com/duplicati/duplicati into feature/filter-groups 2018-04-10 10:48:46 -06:00
Tyler Gill e7e1ccdec2 Fix auth-id hiding in MS Graph backends. 2018-04-10 10:10:19 -06:00
Kenneth Skovhede 3361e27e77 Merge branch 'feature/fix_log_spam' 2018-04-10 13:44:26 +02:00
Kenneth Skovhede b1615bceef Removed the repeating log scope for now 2018-04-10 13:08:17 +02:00
Kenneth Skovhede 731ecfc47d Rewrote the report modules to use a shared base class with all the non-sending specific code.
Change the logic for how the log data is included. It is now added as log lines _after_ the normal messages.
Added support for limiting the number of log lines sent.
Added support for setting the log levels on the modules.
Added support for setting a log filter on the modules.
Added support for sending log data as JSON from the http module.
2018-04-10 12:58:06 +02:00
Kenneth Skovhede e0c3168f13 Merge branch 'feature/fix_log_spam' into feature/filters-for-sendmail 2018-04-09 14:31:50 +02:00
Kenneth Skovhede 917cc63cde Changed the repeating log scope to be better at detecting its own messages 2018-04-09 14:28:50 +02:00