Commit Graph
4937 Commits
Author SHA1 Message Date
Kenneth SkovhedeandGitHub 0a90c23403 Merge pull request #3172 from ltfish/fix/cache_envvar_filesystemcasesensitive
Cache IsFSCaseSensitive to speed up file counting.
This fixes #3167
2018-04-12 09:49:54 +02:00
Kenneth SkovhedeandGitHub 3b55cfb570 Merge pull request #3170 from epol/master
Solved some codacy warnings on OpenStackStorage
2018-04-12 09:47:43 +02:00
Stephen Gregory b53e62ddfc Ignore non-meaningful result properties when serializing to JSON 2018-04-11 22:42:03 -02:30
Stephen Gregory b7bda1d1c4 Add result serializers 2018-04-11 22:40:44 -02:30
Stephen Gregory 5a59930ed6 Clean up serializing result to custom Duplicati format 2018-04-11 22:40:44 -02:30
Stephen Gregory 637e5a4a48 Change method signature of ResultSerializer 2018-04-11 22:40:43 -02:30
Stephen Gregory 46170de84e Extract result serialization to file 2018-04-11 22:40:42 -02:30
Kenneth Skovhede 9eef035924 Fixed a case where the counter process would eat the output from the backup operation 2018-04-11 23:34:51 +02:00
Kenneth Skovhede 79f7b22e0f Merge branch 'master' into concurrent_processing
Changed a few things on the way, removing the log process

# Conflicts:
#	Duplicati/Library/Main/Controller.cs
#	Duplicati/Library/Main/Database/ExtensionMethods.cs
#	Duplicati/Library/Main/Database/LocalBackupDatabase.cs
#	Duplicati/Library/Main/Duplicati.Library.Main.csproj
#	Duplicati/Library/Main/Operation/BackupHandler.cs
#	Duplicati/Library/Main/Operation/FilelistProcessor.cs
#	Duplicati/Library/Main/Operation/PurgeBrokenFilesHandler.cs
#	Duplicati/Library/Main/Operation/TestFilterHandler.cs
#	Duplicati/Library/Main/Options.cs
#	Duplicati/Library/Main/ResultClasses.cs
#	Duplicati/UnitTest/BasicSetupHelper.cs
2018-04-11 23:02:47 +02:00
Enrico Polesel 904616aff5 Solved some codacy warnings on Duplicati/Library/Backend/OpenStack/OpenStackStorage.cs 2018-04-11 11:44:05 +02:00
Fish 03fe3729cf Cache IsFSCaseSensitive to speed up file counting.
"IsFSCaseSensitive" used to call GetEnvironmentVariable() every time it
was accessed, which unnecessarily slows down the file counting procedure.
Caching the value of this environment variable speeds up things quite a
bit.
2018-04-10 20:46:03 -07:00
Tyler Gill a3a98c644a Merge branch 'master' of https://github.com/duplicati/duplicati into feature/filter-groups 2018-04-10 10:48:46 -06:00
Tyler Gill e7e1ccdec2 Fix auth-id hiding in MS Graph backends. 2018-04-10 10:10:19 -06:00
Kenneth Skovhede 3361e27e77 Merge branch 'feature/fix_log_spam' 2018-04-10 13:44:26 +02:00
Kenneth Skovhede b1615bceef Removed the repeating log scope for now 2018-04-10 13:08:17 +02:00
Kenneth Skovhede 731ecfc47d Rewrote the report modules to use a shared base class with all the non-sending specific code.
Change the logic for how the log data is included. It is now added as log lines _after_ the normal messages.
Added support for limiting the number of log lines sent.
Added support for setting the log levels on the modules.
Added support for setting a log filter on the modules.
Added support for sending log data as JSON from the http module.
2018-04-10 12:58:06 +02:00
Kenneth Skovhede e0c3168f13 Merge branch 'feature/fix_log_spam' into feature/filters-for-sendmail 2018-04-09 14:31:50 +02:00
Kenneth Skovhede 917cc63cde Changed the repeating log scope to be better at detecting its own messages 2018-04-09 14:28:50 +02:00
Kenneth Skovhede 682159623c Split out the Tag and FilterTag properties to allow re-entering a log message without adding chaining strings to the message 2018-04-09 14:28:30 +02:00
Kenneth Skovhede 04c7218a08 Added some extra logging and error checking for the IO priority handler 2018-04-09 14:26:53 +02:00
Kenneth SkovhedeandGitHub 91efdcc4f7 Merge pull request #3154 from epol/master
Openstack keystone v3 support
2018-04-08 13:15:22 +02:00
Kenneth SkovhedeandGitHub 54536108db Merge pull request #3161 from warwickmm/abstract_constructor_access
Make constructors for abstract classes protected
2018-04-08 12:32:17 +02:00
Kenneth Hsu cb0a3ed2a1 Make constructors for abstract classes protected.
While this does not affect any behavior, it more accurately describes
the accessibility.  Since abstract classes can only be instantiated by
an instance of a derived type, the constructors should at most have
protected access.
2018-04-07 18:04:41 -07:00
Enrico Polesel e257cf569a Improved code quality for the PR 2018-04-06 10:13:15 +02:00
Bruceforce c3f94ec6cb rclone backend should honor advanced options (see #3142) 2018-04-05 17:43:19 +02:00
Enrico Polesel 6a8776f7f5 Openstack keystone v3 support
Added support for the new keystone v3 API, the old v2.0 APIs are still
available, the v3 can be selected with a version option.

Only password login is implemented here for API v3, so token login is
still missing.
2018-04-05 15:14:22 +02:00
Kenneth Skovhede bceed2ffbe Work on adding filters to send-mail 2018-04-02 11:20:46 +02:00
Max 987086358d upstream 2018-03-31 17:42:53 +02:00
Max 3aeb2abf79 Duplicati.Encryption 2018-03-31 17:36:00 +02:00
Kenneth Hsu c0c29e579d Make string comparison use ordinal (binary) sort rules.
This string comparison should not be culture-aware.
2018-03-28 20:49:47 -07:00
Kenneth SkovhedeandGitHub e0656a22d4 Merge pull request #3118 from tygill/feature/ms-graph-backends
Add new backends for OneDrive + OneDrive for Business, SharePoint, and Microsoft Groups based on the Microsoft Graph API
2018-03-27 14:32:01 +02:00
Kenneth SkovhedeandGitHub bce3267e25 Merge pull request #3120 from tygill/fix/log-level-help
Fix LogfilelogfiltersLong help parameter
2018-03-27 08:26:09 +02:00
Max f5672f69d9 upgrade .net to 4.6.2 2018-03-25 22:00:45 +02:00
Max cb3d830e8e dependencies corrections 2018-03-24 18:36:26 +01:00
Max d3d494b574 backends ported 2018-03-24 17:48:26 +01:00
Tyler Gill c9e8ee31ab When unwrapping TargetInvocationException, we should still put the inner exception in a new Exception.
Otherwise, the callstack in the exception is overwritten, hiding the original call stack where the exception actually occurred.
2018-03-23 15:10:05 -06:00
Tyler Gill f93f9dcc5a Add new utility class, OAuthHttpClient.
This class extends HttpClient and uses an OAuthHttpMessageHandler under the covers to automatically authenticate requests.
Additionally, it automatically respects the global HttpContextSettings for overall timeout, read/write timeout, and SSL certificate validation.
(BufferRequests isn't currently handled, as HttpClient doesn't seem to easily expose that flag, and as of .NET 4.5, seems to not buffer by default.)
2018-03-23 15:07:51 -06:00
Tyler Gill 407bead9f9 Change some fragment settings.
Default retry delay is now 1000ms, and fragment sizes must be at least the multiple size (320 KiB)
2018-03-23 15:04:23 -06:00
Tyler Gill 5a4d170165 Update strings for Microsoft Group backend. 2018-03-23 15:03:04 -06:00
Tyler Gill 81a1bf9024 Clean up names of default filter groups.
Rename 'DefaultExclude' to 'DefaultExcludes' (and the same for 'DefaultInclude').
Rename 'TemporaryFolders' to 'TemporaryFiles' to align with other groups ('CacheFiles', 'SystemFiles', etc.)
Added some more shorter aliases for groups, 'Sys', 'Tmp', etc.
2018-03-23 10:29:12 -06:00
Tyler Gill 448577f5ff Handle cases where the SharePoint path is given with an 'https' prefix in the UI. 2018-03-22 16:15:09 -06:00
Tyler Gill 7491da2add Add entry for --group-email so it isn't treated as an unknown property. 2018-03-22 16:14:42 -06:00
Tyler Gill 5bec41b665 Update both SharePoint and Office 365 group backends to support more human-discernable methods of specifying the backend destination.
For SharePoint, this means instead of giving the site ID as a parameter (and a relative path as the backup URL), the full URL to the folder in SharePoint (e.g., 'sharepoint://{tenant}.sharepoint.com/{PathToSite}/{DocumentBase}/{subfolder}') can be given, and the site ID will be looked up.
(This should match the existing SharePoint backend, including the convention of using '//' to indicate the document root, though I can't explicitly test that since the SharePoint sites I have access to require 2FA, which the old backend doesn't support.)
I've tested both explicit ID and site path methods of specifying the destination, and they appear to be working.
For Office 365 groups, it now supports looking up a group by its email address.
2018-03-22 15:20:17 -06:00
Tyler Gill 987cda7e1d When uploading large files, MS graph backends need to parse the response inside the try block for retries to work (since that is where errors are thrown) 2018-03-22 14:41:19 -06:00
Tyler Gill 258799266e SharePoint and Group drives appear to report quota info that is all zeros.
In that case, pretend that no quota info was reported instead of causing incorrect quota warnings and errors.
2018-03-22 14:40:37 -06:00
Tyler Gill 07cfd65942 Add some more default filters for Windows, mostly based on files I've seen fail to backup due to being locked / in-use by other common processes (Google Chrome, Dropbox, OneDrive, Windows, etc.) 2018-03-22 10:28:55 -06:00
Kenneth Skovhede 9e48de8e01 Merge branch 'master' of github.com:duplicati/duplicati 2018-03-22 08:32:48 +01:00
Kenneth Skovhede e9d477889f Fixed the order of arguments for throttling downloads.
This fixes part of #2890
2018-03-22 08:32:33 +01:00
Tyler Gill 077fcc78b1 Fix LogfilelogfiltersLong help parameter, so that running the main help page doesn't crash. 2018-03-21 17:09:37 -06:00
Tyler Gill 2d429f65a1 Removed the All FilterGroup, since it becomes ambiguous in light of the DefaultExclude and DefaultInclude groups. 2018-03-21 16:52:25 -06:00