c0ce5dcd67fd586be691d63d08b7b896c5863f08
proxy-scraper-checker
HTTP, SOCKS4, SOCKS5 proxies scraper and checker.
- Asynchronous.
- Uses regex to search for proxies (ip:port format) on a web page, which allows you to pull out proxies even from json without making any changes to the code.
- Supports determining the geolocation of the proxy exit node.
- Can determine if a proxy is anonymous.
For a version that uses Python's built-in logging instead of rich, see the simple-output branch.
Usage
- Install Python (Windows 7 requires Python 3.8.X). During installation, be sure to check the box
Add Python to PATH. - Download and unpack the archive with the program.
- Install dependencies from
requirements.txt(python -m pip install -U -r requirements.txton the command line).- If you want to improve the performance, you can also install extra dependencies. See aiohttp documentation.
- Edit
config.pyaccording to your preference. - Run
main.py.
Folders description
When the script finishes running, the following folders will be created (this behavior can be changed in the config):
proxies- proxies with any anonymity level.proxies_anonymous- anonymous proxies.proxies_geolocation- same asproxies, but including exit-node's geolocation.proxies_geolocation_anonymous- same asproxies_anonymous, but including exit-node's geolocation.
Geolocation format is ip:port::Country::Region::City.
Buy me a coffee
Ask for details in Telegram or VK.
License
Languages
Rust
88.6%
Shell
5.8%
Dockerfile
3.6%
PowerShell
1.9%
