2022-08-06 16:00:09 +02:00
|
|
|
# <p align="center">KC-Scraper</p>
|
2022-08-06 15:59:57 +02:00
|
|
|
-----
|
|
|
|
|
|
2022-08-04 22:34:41 +02:00
|
|
|
An open-source proxy scraper able to scrape from almost every website
|
2022-08-01 00:51:09 +02:00
|
|
|
|
2022-08-01 01:12:44 +02:00
|
|
|

|
2022-08-01 00:51:09 +02:00
|
|
|
|
2022-08-01 01:02:04 +02:00
|
|
|
-----
|
2022-08-01 01:04:26 +02:00
|
|
|
### <p align="center">Features</p>
|
2022-08-01 01:05:10 +02:00
|
|
|
|
2022-08-05 20:51:12 +02:00
|
|
|
|
2022-08-01 01:08:37 +02:00
|
|
|
• Threads
|
2022-08-01 01:04:14 +02:00
|
|
|
|
2022-08-01 01:08:37 +02:00
|
|
|
• Auto remove not reachable websites
|
2022-08-01 01:03:53 +02:00
|
|
|
|
2022-08-01 01:05:10 +02:00
|
|
|
|
2022-08-01 01:03:53 +02:00
|
|
|
-----
|
2022-08-01 01:31:27 +02:00
|
|
|
### <p align="center">How to use</p>
|
|
|
|
|
|
2022-08-05 20:51:12 +02:00
|
|
|
|
2022-08-01 01:31:27 +02:00
|
|
|
Install requirements, put your proxysites in sites.txt and start KC-Scraper.py
|
|
|
|
|
|
2022-08-01 22:29:25 +02:00
|
|
|
You can use any site, but make sure you are able to see proxys in the website
|
2022-08-01 18:16:11 +02:00
|
|
|
|
|
|
|
|
Example site: https://openproxy.space/list/http
|
|
|
|
|
|
2022-08-05 20:50:19 +02:00
|
|
|
-----
|
|
|
|
|
|
2022-08-05 20:50:42 +02:00
|
|
|
### <p align="center">Premades</p>
|
2022-08-05 20:49:58 +02:00
|
|
|
|
2022-08-05 20:51:12 +02:00
|
|
|
|
2022-08-05 20:49:58 +02:00
|
|
|
You can add and delete these as you like if you have good ones open a pull request
|
|
|
|
|
|
2022-08-05 20:50:19 +02:00
|
|
|
-----
|
|
|
|
|
|
2022-08-05 20:50:42 +02:00
|
|
|
### <p align="center">Notice</p>
|
2022-08-01 01:03:53 +02:00
|
|
|
|
2022-08-05 20:51:12 +02:00
|
|
|
|
2022-08-01 01:32:04 +02:00
|
|
|
How to NOT use sites:
|
2022-08-01 00:51:09 +02:00
|
|
|
|
2022-08-01 00:52:36 +02:00
|
|
|

|
2022-08-01 00:51:09 +02:00
|
|
|
|
2022-08-01 00:53:09 +02:00
|
|
|
How to use sites:
|
2022-08-01 00:51:09 +02:00
|
|
|
|
2022-08-01 00:52:36 +02:00
|
|
|

|
2022-08-01 01:01:26 +02:00
|
|
|
|
|
|
|
|
-----
|
2022-08-01 00:56:47 +02:00
|
|
|
### <p align="center">Requirements</p>
|
2022-08-01 00:51:09 +02:00
|
|
|
|
2022-08-05 20:51:12 +02:00
|
|
|
|
2022-08-01 00:58:45 +02:00
|
|
|
<a href="https://www.python.org/">Python3</a> or higher
|
2022-08-01 00:59:49 +02:00
|
|
|
|
2022-08-01 01:00:20 +02:00
|
|
|
`pip install -U -r requirements.txt`
|