Commit Graph
34 Commits
Author SHA1 Message Date
monosans f8ce11d8fa chore: use absolute imports 2024-11-22 14:32:29 +03:00
monosans cf83719e2e chore: drop python 3.8 support 2024-10-17 14:18:27 +03:00
monosans aa57dbfafc Save proxies event after interruption
Fixes #316
2024-09-18 18:23:01 +03:00
monosans 20332b5fea Reconfigure ruff 2024-07-09 03:08:30 +03:00
monosansandGitHub 60ea0f498a Use modern type hints (#227) 2024-06-03 14:08:42 +05:00
monosans c487ae8c23 Add Accept header for httpbin 2024-05-06 22:55:17 +05:00
monosans f825a801ac Fix httpbin.io 2024-03-26 16:45:19 +03:00
monosans 419d9fc036 Fix AttributeError 2024-02-04 12:24:12 +03:00
monosans dca437feae Add raise_for_status=True when scraping sources 2024-01-23 09:47:43 +03:00
monosans 73303cab1b Improve response decoding performance 2024-01-23 09:37:29 +03:00
monosans 31a50964eb Fix duplicates 2024-01-23 08:09:08 +03:00
monosans f4af55d37a Fix encoding issues 2024-01-21 21:46:01 +03:00
monosansandGitHub e4047e16ae Huge update
- Drop support for Python 3.7.
- Use offline geolocation database instead of ip-api.com.
- Add support for proxy authentication.
- Add pre-compiled binaries.
- Refactor the code by a lot.
- Simplify config.
- Add automatic text encoding detection.
- Use TOML instead of INI for configuration.
- Add support for using httpbin-compatible services and services which return plain IP address for getting proxy's exit node.
- Add support for reading proxy lists from local files.
- Add support for saving to json.
- Remove support for saving geolocation to txt, use json instead.
- Improve parser.
- Improve config validation.
- Use poetry instead of requirements.txt.
- Use venv in start scripts.
2024-01-21 17:45:01 +00:00
monosans cbf10a37d3 Don't set geolocation if geolocation folders are disabled 2023-12-09 15:16:44 +03:00
monosansGitHubgithub-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
d45db44c6b Update .pre-commit-config.yaml (#111)
* Update .pre-commit-config.yaml

* Ignore PLR0917 in ruff

* Reformat

---------

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-12-07 08:08:12 +00:00
monosans fb59bdaf70 Update User-Agent 2023-11-24 19:54:03 +03:00
monosans 496cef3ae9 Update User-Agent 2023-10-28 14:25:31 +03:00
monosans 8eb9eee886 Update User-Agent 2023-09-29 17:48:32 +03:00
monosans 6f441a7499 Update User-Agent 2023-09-02 12:03:24 +03:00
monosans 5e1a81a369 Minor refactor 2023-08-22 12:23:45 +03:00
monosans d32f7f8707 Change max line length from 88 to 80 2023-06-27 12:04:44 +03:00
monosans 917bcb4ef5 Simplify proxy connector code 2023-04-17 16:48:11 +03:00
monosans ad5513d1a3 Don't check response content-type 2023-04-17 16:40:20 +03:00
monosans 8d16ec6fff Add pre-commit 2023-02-25 19:31:34 +03:00
monosans 082e12b764 Many changes (see full commit message)
Add ability to set MaxConnections to 0, at which this parameter will be set to the maximum available value for the OS
Add validation for Timeout and SourceTimeout options
Improve existing validators
Improve error and warning output
Misc refactoring
2023-02-19 22:18:30 +03:00
monosans d21e32e4fc Add CheckWebsite setting
Fixes #16, fixes #39
2023-01-15 13:05:16 +03:00
monosans 7298a5594f Refactor 2023-01-15 00:22:17 +03:00
monosans 906a514e10 Fix timeouts higher than 60 being ignored 2023-01-07 11:57:57 +03:00
monosans 43d322deb2 Replace getattr with getitem 2023-01-06 17:51:23 +03:00
monosans 3670096f26 Use DummyCookieJar 2023-01-04 20:24:44 +03:00
monosans 635086b23e Code quality improvements 2023-01-04 17:49:45 +03:00
monosans fcea2b49e0 Revert "Inherit Proxy from collections.abc.Hashable"
This reverts commit af22883839.
2023-01-03 11:39:50 +03:00
monosans af22883839 Inherit Proxy from collections.abc.Hashable 2023-01-02 22:02:31 +03:00
monosans a8b1db926b Refactor & improve output 2023-01-02 00:09:55 +03:00