monosans
250a8fa1eb
reformat
2025-03-06 10:04:05 +03:00
monosans
6a6e05e531
handle UnicodeDecodeError on non-utf-8 check_website
2025-03-06 09:57:26 +03:00
monosans and GitHub
c9bd28057f
Use faster json parser & remove charset-normalizer
2025-03-06 06:49:24 +00:00
monosans
7877dac25e
use methods instead of properties
2025-02-27 16:18:05 +03:00
monosans
278358a28c
switch back to flat layout
2025-02-11 18:30:07 +03:00
monosans
7b32ffa1e5
switch to src layout
2025-02-11 10:00:26 +03:00
monosans
f8ce11d8fa
chore: use absolute imports
2024-11-22 14:32:29 +03:00
monosans
cf83719e2e
chore: drop python 3.8 support
2024-10-17 14:18:27 +03:00
monosans
aa57dbfafc
Save proxies event after interruption
...
Fixes #316
2024-09-18 18:23:01 +03:00
monosans
20332b5fea
Reconfigure ruff
2024-07-09 03:08:30 +03:00
monosans and GitHub
60ea0f498a
Use modern type hints ( #227 )
2024-06-03 14:08:42 +05:00
monosans
c487ae8c23
Add Accept header for httpbin
2024-05-06 22:55:17 +05:00
monosans
f825a801ac
Fix httpbin.io
2024-03-26 16:45:19 +03:00
monosans
419d9fc036
Fix AttributeError
2024-02-04 12:24:12 +03:00
monosans
dca437feae
Add raise_for_status=True when scraping sources
2024-01-23 09:47:43 +03:00
monosans
73303cab1b
Improve response decoding performance
2024-01-23 09:37:29 +03:00
monosans
31a50964eb
Fix duplicates
2024-01-23 08:09:08 +03:00
monosans
f4af55d37a
Fix encoding issues
2024-01-21 21:46:01 +03:00
monosans and GitHub
e4047e16ae
Huge update
...
- Drop support for Python 3.7.
- Use offline geolocation database instead of ip-api.com.
- Add support for proxy authentication.
- Add pre-compiled binaries.
- Refactor the code by a lot.
- Simplify config.
- Add automatic text encoding detection.
- Use TOML instead of INI for configuration.
- Add support for using httpbin-compatible services and services which return plain IP address for getting proxy's exit node.
- Add support for reading proxy lists from local files.
- Add support for saving to json.
- Remove support for saving geolocation to txt, use json instead.
- Improve parser.
- Improve config validation.
- Use poetry instead of requirements.txt.
- Use venv in start scripts.
2024-01-21 17:45:01 +00:00
monosans
cbf10a37d3
Don't set geolocation if geolocation folders are disabled
2023-12-09 15:16:44 +03:00
d45db44c6b
Update .pre-commit-config.yaml ( #111 )
...
* Update .pre-commit-config.yaml
* Ignore PLR0917 in ruff
* Reformat
---------
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-12-07 08:08:12 +00:00
monosans
fb59bdaf70
Update User-Agent
2023-11-24 19:54:03 +03:00
monosans
496cef3ae9
Update User-Agent
2023-10-28 14:25:31 +03:00
monosans
8eb9eee886
Update User-Agent
2023-09-29 17:48:32 +03:00
monosans
6f441a7499
Update User-Agent
2023-09-02 12:03:24 +03:00
monosans
5e1a81a369
Minor refactor
2023-08-22 12:23:45 +03:00
monosans
d32f7f8707
Change max line length from 88 to 80
2023-06-27 12:04:44 +03:00
monosans
917bcb4ef5
Simplify proxy connector code
2023-04-17 16:48:11 +03:00
monosans
ad5513d1a3
Don't check response content-type
2023-04-17 16:40:20 +03:00
monosans
8d16ec6fff
Add pre-commit
2023-02-25 19:31:34 +03:00
monosans
082e12b764
Many changes (see full commit message)
...
Add ability to set MaxConnections to 0, at which this parameter will be set to the maximum available value for the OS
Add validation for Timeout and SourceTimeout options
Improve existing validators
Improve error and warning output
Misc refactoring
2023-02-19 22:18:30 +03:00
monosans
d21e32e4fc
Add CheckWebsite setting
...
Fixes #16 , fixes #39
2023-01-15 13:05:16 +03:00
monosans
7298a5594f
Refactor
2023-01-15 00:22:17 +03:00
monosans
906a514e10
Fix timeouts higher than 60 being ignored
2023-01-07 11:57:57 +03:00
monosans
43d322deb2
Replace getattr with getitem
2023-01-06 17:51:23 +03:00
monosans
3670096f26
Use DummyCookieJar
2023-01-04 20:24:44 +03:00
monosans
635086b23e
Code quality improvements
2023-01-04 17:49:45 +03:00
monosans
fcea2b49e0
Revert "Inherit Proxy from collections.abc.Hashable"
...
This reverts commit af22883839
2023-01-03 11:39:50 +03:00
monosans
af22883839
Inherit Proxy from collections.abc.Hashable
2023-01-02 22:02:31 +03:00
monosans
a8b1db926b
Refactor & improve output
2023-01-02 00:09:55 +03:00
monosans