2023-08-01 19:50:56 +02:00
|
|
|
<div align="center">
|
|
|
|
|
<img src="assets/logo.svg">
|
|
|
|
|
</div>
|
2022-08-06 15:59:57 +02:00
|
|
|
|
2023-08-01 19:50:56 +02:00
|
|
|
---
|
2022-08-01 00:51:09 +02:00
|
|
|
|
2022-11-26 01:24:38 +01:00
|
|
|
# <p align="center">👾 KC-Scraper 👾</p>
|
2022-11-23 23:05:55 +01:00
|
|
|
<br>
|
2022-08-01 00:51:09 +02:00
|
|
|
|
2023-08-01 19:50:56 +02:00
|
|
|
<div align="center">
|
|
|
|
|
<strong>A powerful and open source proxy scraper <br> able to scrape from almost any website </strong>
|
|
|
|
|
</div>
|
|
|
|
|
|
2022-11-23 23:05:55 +01:00
|
|
|
<br>
|
2022-09-09 19:36:29 +02:00
|
|
|
|
2023-08-01 19:50:56 +02:00
|
|
|
<div align="center">
|
|
|
|
|
<img src="https://img.shields.io/github/downloads/Kuucheen/KC-Scraper/total.svg">
|
|
|
|
|
<img src="https://img.shields.io/github/license/Kuucheen/KC-Scraper.svg">
|
|
|
|
|
<img src="https://img.shields.io/github/issues/Kuucheen/KC-Scraper.svg">
|
|
|
|
|
</div>
|
|
|
|
|
|
2023-08-01 19:52:40 +02:00
|
|
|
<br>
|
2023-08-01 19:50:56 +02:00
|
|
|
|
2022-11-23 23:05:55 +01:00
|
|
|
<p align="center">
|
2023-08-01 19:50:56 +02:00
|
|
|
<img src="assets/preview.gif" width="800" height=420">
|
2022-11-23 23:05:55 +01:00
|
|
|
</p>
|
|
|
|
|
<br>
|
|
|
|
|
<br>
|
2022-09-09 19:36:29 +02:00
|
|
|
|
2022-08-01 01:02:04 +02:00
|
|
|
-----
|
2022-08-01 01:05:10 +02:00
|
|
|
|
2022-11-23 23:05:55 +01:00
|
|
|
### <p align="center">☄ Features ☄</p>
|
|
|
|
|
<br>
|
2022-08-05 20:51:12 +02:00
|
|
|
|
2022-08-01 01:08:37 +02:00
|
|
|
• Threads
|
2022-11-23 23:05:55 +01:00
|
|
|
|
|
|
|
|
• Very fast
|
2022-08-01 01:04:14 +02:00
|
|
|
|
2022-12-04 14:05:22 +01:00
|
|
|
• Highly customizable
|
2022-09-20 19:59:12 +02:00
|
|
|
|
2023-10-13 21:51:40 +02:00
|
|
|
• Custom proxy delimiter
|
|
|
|
|
|
2022-09-20 19:59:12 +02:00
|
|
|
• Settings for automatisation
|
2022-11-23 23:05:55 +01:00
|
|
|
|
2023-08-01 19:50:56 +02:00
|
|
|
• Presets get ~200 elite proxies
|
|
|
|
|
|
2022-11-23 23:05:55 +01:00
|
|
|
• Automatically removes duplicates
|
2022-08-01 01:03:53 +02:00
|
|
|
|
2022-11-23 23:05:55 +01:00
|
|
|
<br>
|
2022-08-01 01:05:10 +02:00
|
|
|
|
2022-08-01 01:03:53 +02:00
|
|
|
-----
|
2022-09-09 19:35:09 +02:00
|
|
|
|
2022-11-23 23:05:55 +01:00
|
|
|
### <p align="center">❓ How to use ❓</p>
|
|
|
|
|
<br>
|
2022-08-05 20:51:12 +02:00
|
|
|
|
2023-08-01 19:50:56 +02:00
|
|
|
1. Place your proxy sites in the "sites.txt" file or create configs in the "presets" folder.
|
2022-08-01 01:31:27 +02:00
|
|
|
|
2023-03-18 15:14:02 +01:00
|
|
|
2. Ensure that the website you choose is capable of displaying proxies. For instance, you can use
|
|
|
|
|
the following example site: https://openproxy.space/list/http.
|
2022-08-01 18:16:11 +02:00
|
|
|
|
2023-03-01 22:35:54 +01:00
|
|
|
3. (secret) Pro tip: Don't forget to add "http://" or "https://" before the website URL.
|
2022-11-23 23:05:55 +01:00
|
|
|
<br>
|
2022-08-14 23:32:41 +02:00
|
|
|
|
|
|
|
|
-----
|
|
|
|
|
|
2022-11-23 23:05:55 +01:00
|
|
|
### <p align="center">🔩 Requirements 🔩</p>
|
|
|
|
|
<br>
|
2022-08-05 20:49:58 +02:00
|
|
|
|
2023-08-01 19:50:56 +02:00
|
|
|
<strong>Use `python -m pip install -r requirements.txt` to install
|
|
|
|
|
|
2022-08-14 23:09:21 +02:00
|
|
|
|
2022-08-21 20:45:36 +02:00
|
|
|
`httpx[http2]`
|
2022-08-14 23:09:21 +02:00
|
|
|
`pystyle`
|
2022-08-14 23:28:56 +02:00
|
|
|
`pyyaml`
|
2022-08-14 23:09:21 +02:00
|
|
|
|
2022-08-01 00:58:45 +02:00
|
|
|
<a href="https://www.python.org/">Python3</a> or higher
|
2022-11-23 23:05:55 +01:00
|
|
|
<br>
|
2022-08-01 00:59:49 +02:00
|
|
|
|
2022-11-23 23:05:55 +01:00
|
|
|
----
|
|
|
|
|
### <p align="center">📌 Other 📌</p>
|
|
|
|
|
<br>
|
|
|
|
|
<p align="center"><strong>this tool is made for educational purposes only</strong><br><br>if you have ideas or better websites make a pull request</p>
|
2022-08-14 23:09:21 +02:00
|
|
|
|
