haeaeae/proxy-scraper-checker
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
588 Commits 1 Branch 0 Tags
1a96e012adf39bcf17812be128fe48df2fbaace2
Commit Graph
123 Commits
Author SHA1 Message Date
monosans 5de2b3f782 Sort alphabetically if checking is disabled 2024-09-18 18:35:56 +03:00
monosans 88ca6413c5 Allow disabling checker 2024-09-18 18:30:59 +03:00
monosans aa57dbfafc Save proxies event after interruption 
Fixes #316
 2024-09-18 18:23:01 +03:00
monosans[bot]GitHubmonosans[bot] <158570872+monosans[bot]@users.noreply.github.com>monosans
 		6653649733 Update .pre-commit-config.yaml (#308) 
* Update .pre-commit-config.yaml

* fix

---------

Co-authored-by: monosans[bot] <158570872+monosans[bot]@users.noreply.github.com>
Co-authored-by: monosans <hsyqixco@protonmail.com>
 2024-09-06 06:06:06 +00:00
monosans 5e9fe6f748 Add support for parsing hostname in proxy 2024-08-22 16:27:36 +03:00
monosans e3b69336eb Update User-Agent 2024-08-10 17:02:01 +03:00
monosans 4a29322a27 Don't create TypeVars at runtime 2024-07-09 03:35:36 +03:00
monosans 20332b5fea Reconfigure ruff 2024-07-09 03:08:30 +03:00
monosans cbfa19a41b Update User-Agent 2024-07-08 01:45:40 +03:00
monosansandGitHub 60ea0f498a Use modern type hints (#227) 2024-06-03 14:08:42 +05:00
monosans ef3ca6f304 Refactor run function 2024-05-31 21:12:18 +05:00
monosans 1372ab308b Fix mypy 2024-05-31 13:48:09 +05:00
monosans 82b097c6a6 Add async_run function instead of set_event_loop_policy 2024-05-31 12:30:17 +05:00
monosans 6de2dc8a2c Add type: ignore 2024-05-06 23:03:54 +05:00
monosans c487ae8c23 Add Accept header for httpbin 2024-05-06 22:55:17 +05:00
monosans 59a98e1236 Add type: ignore 2024-05-06 22:53:44 +05:00
monosans fdae372a08 Update User-Agent 2024-05-06 22:53:34 +05:00
monosans 00cffb5605 Support IPv6 on httpbin.org 2024-04-20 13:00:44 +05:00
monosans dbdcea6d86 Improve check_website validation error message 2024-04-11 23:13:31 +03:00
monosans 0050b08d87 Make sure check_website has an http or https scheme 2024-04-11 23:12:00 +03:00
monosans 186cadc764 Check that the source scheme is http or https when deciding whether it is a URL or a local file 2024-04-11 22:57:18 +03:00
monosansandGitHub 74edec2330 Support older winloop 2024-04-03 20:07:11 +00:00
monosansandGitHub 98d023c289 Add winloop support, remove max_connections limit on Windows 2024-04-03 19:58:58 +00:00
monosans f825a801ac Fix httpbin.io 2024-03-26 16:45:19 +03:00
monosans df408d62b7 Update User-Agent 2024-03-23 09:53:34 +03:00
monosans 38f910d1a6 rstrip instead of strip 2024-03-23 09:47:55 +03:00
monosans 5ded527f73 Fix possible KeyError 2024-03-23 09:47:19 +03:00
monosans dbdf5b84be Fix 2024-03-01 07:28:43 +03:00
monosans 2de104df7d Create cache dir only if geolocation is enabled 2024-02-29 22:29:12 +03:00
monosans 32fd6158ec Remove ETag from cache if response didn't provide it 2024-02-18 12:11:04 +03:00
monosans 8ed0cf378d force=True in logging.basicConfig 2024-02-13 21:45:41 +03:00
monosans 75fca04801 Rename argument 2024-02-08 12:01:37 +03:00
monosans dbeeec5641 Refactor asyncify 2024-02-08 11:22:51 +03:00
monosans 91d2624224 Remove maybe_add_permission 2024-02-08 09:42:30 +03:00
monosans 2cca716167 Remove monkeypatch 2024-02-08 09:27:42 +03:00
monosans a42f44e7e8 Automatically fix permissions issues 2024-02-08 09:12:13 +03:00
monosans 95c6e7f6eb Reformat utils.py 2024-02-07 13:03:31 +03:00
monosans 04bf2f6850 Fix directories access check 2024-02-07 12:37:46 +03:00
monosans 35518b67e9 Reformat 2024-02-07 10:25:01 +03:00
monosans 9026cf9fb4 Fix ruff 2024-02-07 10:21:22 +03:00
monosans d57620cae4 Minor improvements 2024-02-04 16:58:45 +03:00
monosans 419d9fc036 Fix AttributeError 2024-02-04 12:24:12 +03:00
monosans 328834eb03 Improve permissions check 2024-02-01 14:52:29 +03:00
monosansandGitHub 5005e0dc6b Add Docker support 2024-02-01 10:24:26 +03:00
monosans 624ffa2698 Add noqa 2024-01-29 14:04:37 +03:00
monosans 326f143d26 Use Chrome User-Agent 2024-01-29 13:52:46 +03:00
monosans 2d30886e74 Iterate over ProxyStorage instead of ._proxies 2024-01-29 00:33:55 +03:00
monosans 51c847811c Remove get_sorted method from ProxyStorage 2024-01-29 00:32:31 +03:00
monosans e201011ed3 Refactor typing_compat 2024-01-25 18:12:36 +03:00
monosans 330b607c59 Use sys.implementation.name instead of platform.python_implementation() 2024-01-25 15:43:12 +03:00