Commit Graph
4937 Commits
Author SHA1 Message Date
verhoek 7556c3fa63 Merge branch 'master' into feature/tempdir 2018-05-23 20:13:48 +02:00
verhoek 67c8929759 wip 2018-05-23 19:37:49 +02:00
Kenneth SkovhedeandGitHub fd26732e1f Merge pull request #3228 from warwickmm/use_string_join
Simplify construction of query parameter string
2018-05-23 11:11:02 +02:00
Kenneth SkovhedeandGitHub 19851c88f0 Merge pull request #3227 from warwickmm/use_string_builder
Replace string concatenation with StringBuilder
2018-05-23 11:10:36 +02:00
verhoek 7bf1768f80 Implemented default tempdir for backend server. 2018-05-22 21:51:29 +02:00
Tyler Gill bbdf4c2747 Add more broken file detection:
Blocksets with either blockset entires or blocklist entries that refer to invalid / unreachable blocks are now treated as broken as well.
2018-05-21 10:16:51 -06:00
verhoek e4398d3b68 Fixed broken help output in commandline.
E.g. "help find" works again.
2018-05-20 16:51:53 +02:00
verhoek cac891d187 Added BucketObjectPath helper method. 2018-05-20 11:10:37 +02:00
verhoek 13ef221196 Updated Rename method. 2018-05-20 10:57:49 +02:00
verhoek 745b77da23 Renamed WebApi GoogleCloudServices to GoogleCloudStorage. Refactored Get. Fixed Layout. 2018-05-20 10:50:37 +02:00
Kenneth Hsu 2384e6eb30 Simplify construction of query parameter string. 2018-05-19 16:12:12 -07:00
Kenneth Hsu 0b016cea2c Replace string concatenation with StringBuilder.
When appending to a string in a loop, using a StringBuilder should in
general yield better performance.
2018-05-19 15:36:00 -07:00
verhoek 18de687530 Updated Put and Createfolder using WebApi. 2018-05-19 23:06:02 +02:00
verhoek d6a85ae497 Imports organized, bucket locations moved to google webapi. 2018-05-18 23:00:01 +02:00
verhoek 41234a314d Introduced UrlPath wrapper for stringbuilder to ease concatenation of multiple paths.
Started cleaning googlecloud services API.
2018-05-18 22:55:09 +02:00
verhoek 2f41e02ca9 Merge branch 'master' into refactored 2018-05-18 08:05:19 +02:00
Tyler Gill b5931b2771 Adds a check for BlocksetIDs that don't have any corresponding BlocksetEntrys to the broken fileset check.
Bug #3210 (and several other possibly related ones) had cases where a recreated database would have these invalid blockset IDs.
It seems like they were caused by filesets referring to a blockset by hash, but not having any index or block file actually containing the block for that hash.
Also fixes countMissingInformation query - it should join with missingBlocklistVolumes, rather than missingBlocklistEntries, as it is selecting the VolumeID.
2018-05-17 08:11:13 -06:00
Kenneth SkovhedeandGitHub b7b4fbe778 Merge pull request #3221 from verhoek/webapi/googledrive
Webapi/googledrive
2018-05-17 14:44:50 +02:00
Tom Whitwell 54ae844536 Add Memset's Cloud Storage to Openstack providers 2018-05-17 12:03:30 +01:00
verhoek 0b9712ee84 Removed unused var. 2018-05-16 21:21:35 +02:00
verhoek 8a4031f66b Added skipped file in comparison spelling correction commit. 2018-05-16 20:24:31 +02:00
verhoek 143725c0b9 Removed some duplication. 2018-05-16 20:10:06 +02:00
verhoek 30cd41585b Corrected spelling function name. 2018-05-16 20:08:40 +02:00
verhoek be79384966 Removed duplicate ? when building urls with query parameters. 2018-05-15 21:50:14 +02:00
verhoek c5783b2ae4 Merge branch 'master' into webapi/googledrive 2018-05-15 20:31:58 +02:00
verhoek 0cca2797df Use concat paths in helper functions of googledrive. 2018-05-15 20:29:08 +02:00
verhoek 1cde60c640 Removed misplaced leftover line. 2018-05-15 20:28:52 +02:00
Kenneth Skovhede 2c44cce136 Merge branch 'feature/remove-console-writeline' 2018-05-15 12:12:07 +02:00
Kenneth Skovhede ee64517f7d Removed calls to Console.WriteLine as we may run somewhere without a console. 2018-05-15 11:29:08 +02:00
verhoek bbf489c86f Corrected appending paths to urls. 2018-05-14 22:53:13 +02:00
verhoek 6dd64a553d Fixed code quality issues. 2018-05-14 21:01:18 +02:00
Kenneth Hsu 0777d9c98a Fix indentation to improve readability.
The previous indentation could give the impression that it belongs to
the preceding if-statement.
2018-05-13 14:24:13 -07:00
Kenneth Hsu 9c6bccf478 Use braces to improve readability.
Previously, the indentation of the following code block gave the
impression that it was part of the foreach loop when in fact it would
only be executed once.
2018-05-13 14:24:13 -07:00
verhoek dae12fee53 Organized imports. 2018-05-13 16:27:14 +02:00
verhoek a67248f51f Moved Api strings to separate class similarly to the constant setup in Strings.cs. 2018-05-13 16:22:41 +02:00
verhoek 007e4c0829 Cleaned up imports. 2018-05-13 12:48:00 +02:00
verhoek 051b030836 Fixed typo regarding pageToken. Integrated other strings in static string class. 2018-05-12 12:42:51 +02:00
verhoek 6539c36e51 Merge branch 'master' into webapi/googledrive 2018-05-12 09:30:57 +02:00
verhoek 44b5b00276 Renamed some googledriveapi var names. Modified ListFolder to be more readable. 2018-05-11 19:57:09 +02:00
verhoek 78a46c3a5c Renamed misspelled class urluttility to urlutility and newly added urlutility to uriutility. 2018-05-11 19:09:14 +02:00
verhoek d303db30d6 Replacing magic strings in google drive rest calls by query key value pairs. 2018-05-11 18:23:16 +02:00
drwtsn32x 5384b135fe Include version information in Results 2018-05-11 06:25:52 -07:00
Kenneth Skovhede 57367890b9 Updated the query that fixes recreates where some remote dblock files are found through the dindex files, but these are not present. 2018-05-11 11:34:48 +02:00
Kenneth Skovhede 632b4ff0e2 Added support for cases where the recreate finds missing block files that are not needed. 2018-05-10 00:57:51 +02:00
verhoek 55e349f410 Renamed variable to indicate meaning properly. 2018-05-09 18:57:04 +02:00
verhoek a61777d4b0 Merge branch 'master' into google_based_changes 2018-05-09 18:40:26 +02:00
Kenneth Skovhede 13c33c6f89 Improved logging to isolate the cause of missing remote files 2018-05-09 18:09:20 +02:00
Kenneth Skovhede 4ff2a1ba0b Fixed a bug where the block splitter would mark all blocks as block-list hashes 2018-05-09 17:38:30 +02:00
Kenneth Skovhede 52987da027 Improved error message when reading invalid blocklists 2018-05-09 17:37:54 +02:00
Kenneth Skovhede c50721e0c4 Added input validation to the IndexVolumeCreator to make sure it does not create invalid temporary lists 2018-05-09 17:37:30 +02:00