🚀 proxy-scraper-checker

A lightning-fast, feature-rich proxy scraper and checker built in Rust.

Collect, test, and organize HTTP/SOCKS4/SOCKS5 proxies from multiple sources with detailed metadata and intelligent filtering.

✨ Key Features

• 🔥 Blazing Performance - Rust-powered async engine with configurable concurrency
• 🌍 Rich Metadata - ASN, country/city geolocation, and response time data via offline MaxMind databases
• 🎯 Smart Parsing - Advanced regex engine extracts proxies from any format (protocol://user:pass@host:port). Also supports CIDR notation (e.g. 192.168.0.0/24), automatically expanding ranges into individual hosts.
• 🔐 Auth Support - Handles username/password authentication seamlessly
• 📊 Interactive TUI - Real-time progress monitoring with beautiful terminal interface
• ⚡ Flexible Output - JSON (with metadata) and plain text formats
• 🎛️ Configurable - Extensive options for sources, timeouts, and checking
• 📁 Local & Remote - Supports both web URLs and local files as proxy sources
• 🐳 Docker Ready - Containerized deployment with volume mounting

🔗 Related

Get pre-checked proxies from monosans/proxy-list - updated regularly using this tool.

⚠️ SAFETY WARNING ⚠️

This tool makes thousands of concurrent network requests to test proxies, which may trigger rate limiting or security flags from your ISP or network provider. Consider using a VPN to protect your IP reputation.

🚀 Quick Start

All configuration options are documented in config.toml with detailed comments explaining each setting.

💻 Download & run pre-built binary (easiest)

Note: For Android/Termux users, see the dedicated section below.

1. Download the archive for your platform from nightly builds

   • Look for artifacts starting with proxy-scraper-checker-binary- followed by your platform
   • Not sure which platform? Check the platform support table

2. Extract the archive to a dedicated folder

3. Configure by editing config.toml to your needs

4. Run the executable

🐳 Docker

Note: Docker version outputs logs to stdout instead of the interactive TUI (terminal user interface).

1. Install Docker Compose

2. Download the archive from nightly builds

   • Look for artifacts starting with proxy-scraper-checker-docker- followed by your CPU architecture

3. Extract to a folder and configure config.toml

4. Build and run:

   # Windows
   docker compose build
   docker compose up --no-log-prefix --remove-orphans
   
   # Linux/macOS
   docker compose build --build-arg UID=$(id -u) --build-arg GID=$(id -g)
   docker compose up --no-log-prefix --remove-orphans
   

📱 Android / Termux

Important: Download Termux from F-Droid, not Google Play (why?).

1. Install with one command:

   bash <(curl -fsSL 'https://raw.githubusercontent.com/monosans/proxy-scraper-checker/main/termux.sh')
   

2. Configure using a text editor:

   nano ~/proxy-scraper-checker/config.toml
   

3. Run the tool:

   cd ~/proxy-scraper-checker && ./proxy-scraper-checker
   

🛠️ Build from source

1. Install Rust toolchain

   See https://rust-lang.org/tools/install/

2. Clone the repository

   git clone https://github.com/monosans/proxy-scraper-checker.git
   cd proxy-scraper-checker
   

3. Build release binary with TUI enabled

   cargo build --features tui --release --locked
   

4. Run with TUI

   cargo run --features tui --release --locked
   

Binary location:

• target/release/proxy-scraper-checker (Linux/macOS)
• target\\release\\proxy-scraper-checker.exe (Windows)

💎 Sponsors

🚀 Want to be featured here? Support the project and get your name in this section.

💖 Support This Project

Help this project grow and reach more developers:

• ⭐ Star the repository — Help others discover this tool
• 🤝 Interested in becoming a sponsor? DM me on Telegram

📄 License

MIT

This product includes GeoLite2 Data created by MaxMind, available from https://www.maxmind.com