monosans
082e12b764
Add ability to set MaxConnections to 0, at which this parameter will be set to the maximum available value for the OS Add validation for Timeout and SourceTimeout options Improve existing validators Improve error and warning output Misc refactoring
proxy-scraper-checker
HTTP, SOCKS4, SOCKS5 proxies scraper and checker.
- Asynchronous.
- Uses regex to search for proxies (ip:port format) on a web page, allowing proxies to be extracted even from json without making changes to the code.
- It is possible to specify the URL to which to send a request to check the proxy.
- Can sort proxies by speed.
- Supports determining the geolocation of the proxy exit node.
- Can determine if the proxy is anonymous.
You can get proxies obtained using this script in monosans/proxy-list.
Installation and usage
- Download and unpack the archive with the program.
- Edit
config.iniaccording to your preference. - Install Python (Windows 7 requires Python 3.8.X). During installation, be sure to check the box
Add Python to PATH. - Install dependencies and run the script. There are 2 ways to do this:
- Automatic:
- On Windows run
start.cmd - On Unix-like OS run
start.sh
- On Windows run
- Manual:
cdinto the unpacked folder- Install dependencies with the command
python -m pip install -U --no-cache-dir --disable-pip-version-check pip setuptools wheel; python -m pip install -U --no-cache-dir --disable-pip-version-check -r requirements.txt - Run with the command
python -m proxy_scraper_checker
- Automatic:
Folders description
When the script finishes running, the following folders will be created (this behavior can be changed in the config):
proxies- proxies with any anonymity level.proxies_anonymous- anonymous proxies.proxies_geolocation- same asproxies, but includes exit-node's geolocation.proxies_geolocation_anonymous- same asproxies_anonymous, but includes exit-node's geolocation.
Geolocation format is ip:port|Country|Region|City.
Buy me a coffee
Ask for details on Telegram or VK.