haeaeae/proxy-scraper-checker
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
150 Commits 1 Branch 0 Tags
00a5b86bd6feeab05d1ceea3496921cf21f08696
Commit Graph
150 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
monosans 00a5b86bd6 Update .gitignore 2023-04-21 16:03:35 +03:00
monosans f34277c764 Update .pre-commit-config.yaml 2023-04-20 11:15:59 +03:00
monosans bc8cc26419 Update .pre-commit-config.yaml 2023-04-20 10:43:56 +03:00
monosans 86aeacc53c Add fix-byte-order-marker pre-commit hook 2023-04-17 22:48:24 +03:00
monosans 917bcb4ef5 Simplify proxy connector code 2023-04-17 16:48:11 +03:00
monosans ad5513d1a3 Don't check response content-type 2023-04-17 16:40:20 +03:00
monosans 5984aa191c Fix source 2023-04-17 08:01:35 +03:00
monosans 4fe4e3b0b6 Change final output 2023-04-16 21:49:53 +03:00
monosans a6411bc501 Minor optimizations 2023-04-16 21:11:46 +03:00
monosans 031f6f4bbb Add more default sources 2023-04-16 20:38:29 +03:00
monosans 6d5296534f Update User-Agent 2023-04-15 14:21:12 +03:00
monosans 2bd38fdcd1 Update User-Agent 2023-04-12 15:40:01 +03:00
monosans 751122c618 Remove dead source 
Closes #51
 2023-04-12 15:39:24 +03:00
pre-commit-ci[bot]GitHubpre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 		8ecaaf2d20 [pre-commit.ci] pre-commit autoupdate (#50) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-04-11 20:03:43 +00:00
pre-commit-ci[bot]GitHubpre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 		6100d82127 [pre-commit.ci] pre-commit autoupdate (#48) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-04-04 05:45:09 +00:00
monosans 0c1e12a216 Ignore ruff S311 2023-03-25 20:56:59 +03:00
monosans 7c0e45f6cf Fix pyproject.toml 2023-03-25 20:55:08 +03:00
monosans 02f78d45e6 Ignore ruff S311 2023-03-25 20:51:35 +03:00
monosans 57527b6c20 pre-commit autoupdate 2023-03-25 20:47:18 +03:00
monosans ea681fa55c Ignore ruff S308 2023-03-25 20:08:57 +03:00
pre-commit-ci[bot]GitHubpre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 		655cbe6519 [pre-commit.ci] pre-commit autoupdate (#46) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-03-21 06:03:28 +00:00
monosans 4d76fe1870 Change timeout log level from error to warning 2023-03-19 00:30:03 +03:00
monosans 55903cd834 Add more sources 2023-03-19 00:20:38 +03:00
monosans 5b4c829cc0 simplify error message 2023-03-18 10:47:54 +03:00
monosans 0b7f8a6e1f click to expand 2023-03-18 00:01:00 +03:00
monosans 8906b3d237 Use python3 on Unix and py on Windows 2023-03-17 23:55:48 +03:00
monosans 6c840e9acd Fix MaxConnections not working if limit is infinite 2023-03-17 23:42:22 +03:00
pre-commit-ci[bot]GitHubpre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 		a8f8ac2068 [pre-commit.ci] pre-commit autoupdate (#45) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-03-14 06:18:00 +00:00
pre-commit-ci[bot]GitHubpre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 		f6b121565f [pre-commit.ci] pre-commit autoupdate (#44) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-03-07 15:51:55 +00:00
pre-commit-ci[bot]GitHubpre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 		4553f88474 [pre-commit.ci] pre-commit autoupdate (#43) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-02-28 06:48:56 +00:00
monosans 9f3bd8a152 Ignore ruff D401 2023-02-25 23:11:02 +03:00
monosans d06579a514 Reconfigure mypy 2023-02-25 23:10:46 +03:00
monosans 8d16ec6fff Add pre-commit 2023-02-25 19:31:34 +03:00
monosans 8f9569edd9 Fix errors on Python 3.7/3.8 
Fixes #40
 2023-02-21 21:22:47 +03:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		eab87c5287 Update aiohttp-socks requirement from <0.8,>=0.7 to >=0.7,<0.9 (#42) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-02-21 15:27:56 +00:00
monosans 42ce1237a1 Reformat docstring 2023-02-19 22:33:06 +03:00
monosans 082e12b764 Many changes (see full commit message) 
Add ability to set MaxConnections to 0, at which this parameter will be set to the maximum available value for the OS
Add validation for Timeout and SourceTimeout options
Improve existing validators
Improve error and warning output
Misc refactoring
 2023-02-19 22:18:30 +03:00
monosans 635e993d56 Minor optimization of Folder 2023-02-19 00:07:19 +03:00
monosans b072219ab6 Update sources 2023-02-12 20:26:53 +03:00
monosans 490efee372 Add Debug option 2023-02-06 20:59:03 +03:00
monosans 9eb893bb6c Reformat code 2023-02-01 18:46:40 +03:00
monosans 8b157863c9 Update .gitignore 2023-01-28 18:57:15 +03:00
monosans 66cd4b584e Add CheckWebsite related comment to Folders section 2023-01-15 15:25:31 +03:00
monosans d70e2d7fff Add CheckWebsite example 2023-01-15 13:26:54 +03:00
monosans d21e32e4fc Add CheckWebsite setting 
Fixes #16, fixes #39
 2023-01-15 13:05:16 +03:00
monosans 7298a5594f Refactor 2023-01-15 00:22:17 +03:00
monosans cea51b2d71 Edit MaxConnections comment 2023-01-07 14:53:21 +03:00
monosans 8057229ec7 Set sock_connect timeout to float("inf") 2023-01-07 14:50:42 +03:00
monosans 0f67a11713 Add comment about RAM consumption 2023-01-07 12:39:38 +03:00
monosans 26f0b0c564 Fix typo 2023-01-07 12:26:32 +03:00