Commit Graph
25 Commits
Author SHA1 Message Date
monosansandGitHub c9bd28057f Use faster json parser & remove charset-normalizer 2025-03-06 06:49:24 +00:00
monosans bbcd62dc4e refactor 2025-02-27 11:12:52 +03:00
monosans 278358a28c switch back to flat layout 2025-02-11 18:30:07 +03:00
monosans 7b32ffa1e5 switch to src layout 2025-02-11 10:00:26 +03:00
monosans 1e56188aa4 add proxies_per_source_limit setting 2025-01-10 12:49:36 +03:00
monosans 0a63e1008e remove useless comment 2025-01-10 12:34:12 +03:00
monosans 9e9e565100 skip too big sources 2025-01-10 12:33:56 +03:00
monosans 63b706a2bb allow file:// prefix for file proxy lists 2025-01-07 21:09:43 +03:00
monosans 07148d8ccf replace aiofiles with async pathlib where possible 2025-01-07 21:09:06 +03:00
monosans f8ce11d8fa chore: use absolute imports 2024-11-22 14:32:29 +03:00
monosans ebfcc92df9 feat: show amount of succesfull proxy checks in real time 2024-11-22 13:49:07 +03:00
monosans 48ffa9a672 fix: run log writer in a separate thread 2024-11-06 15:05:34 +03:00
monosans 20332b5fea Reconfigure ruff 2024-07-09 03:08:30 +03:00
monosansandGitHub 60ea0f498a Use modern type hints (#227) 2024-06-03 14:08:42 +05:00
monosans 186cadc764 Check that the source scheme is http or https when deciding whether it is a URL or a local file 2024-04-11 22:57:18 +03:00
monosans 38f910d1a6 rstrip instead of strip 2024-03-23 09:47:55 +03:00
monosans 5ded527f73 Fix possible KeyError 2024-03-23 09:47:19 +03:00
monosans 04bf2f6850 Fix directories access check 2024-02-07 12:37:46 +03:00
monosans cabc3a0061 Refactor progress bar 2024-01-25 11:49:22 +03:00
monosans 890c000139 Don't shuffle proxies before checking 2024-01-25 10:30:40 +03:00
monosans 82055d3417 Remove unused variable 2024-01-23 09:49:17 +03:00
monosans dca437feae Add raise_for_status=True when scraping sources 2024-01-23 09:47:43 +03:00
monosans 73303cab1b Improve response decoding performance 2024-01-23 09:37:29 +03:00
monosans f4af55d37a Fix encoding issues 2024-01-21 21:46:01 +03:00
monosansandGitHub e4047e16ae Huge update
- Drop support for Python 3.7.
- Use offline geolocation database instead of ip-api.com.
- Add support for proxy authentication.
- Add pre-compiled binaries.
- Refactor the code by a lot.
- Simplify config.
- Add automatic text encoding detection.
- Use TOML instead of INI for configuration.
- Add support for using httpbin-compatible services and services which return plain IP address for getting proxy's exit node.
- Add support for reading proxy lists from local files.
- Add support for saving to json.
- Remove support for saving geolocation to txt, use json instead.
- Improve parser.
- Improve config validation.
- Use poetry instead of requirements.txt.
- Use venv in start scripts.
2024-01-21 17:45:01 +00:00