haeaeae/proxy-scraper-checker
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
334 Commits 1 Branch 0 Tags
2d0bf89fa9a84ae58725b094a487d5d4e8a3838b
Commit Graph
334 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		2d0bf89fa9 Bump the pip-semver-minor group with 1 update (#141) 
Bumps the pip-semver-minor group with 1 update: [ruff](https://github.com/astral-sh/ruff).


Updates `ruff` from 0.2.0 to 0.2.1
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ruff/compare/v0.2.0...v0.2.1)

---
updated-dependencies:
- dependency-name: ruff
  dependency-type: direct:development
  update-type: version-update:semver-patch
  dependency-group: pip-semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-02-06 00:45:17 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		d11cb9c917 Bump the pip-semver-minor group with 1 update (#139) 
Bumps the pip-semver-minor group with 1 update: [nuitka](https://github.com/Nuitka/Nuitka).


Updates `nuitka` from 2.0 to 2.0.1
- [Changelog](https://github.com/Nuitka/Nuitka/blob/develop/Changelog.rst)
- [Commits](https://github.com/Nuitka/Nuitka/compare/2.0...2.0.1)

---
updated-dependencies:
- dependency-name: nuitka
  dependency-type: direct:development
  update-type: version-update:semver-patch
  dependency-group: pip-semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-02-05 00:31:26 +00:00
monosans d57620cae4 Minor improvements 2024-02-04 16:58:45 +03:00
monosans 419d9fc036 Fix AttributeError 2024-02-04 12:24:12 +03:00
monosans a23cf0ba35 Improve GitHub Actions automations 2024-02-02 22:11:16 +03:00
monosans a5fcd8f1c3 Disable FURB180 in ruff 2024-02-02 19:11:47 +03:00
monosans 25bebd68a2 Improve GitHub Actions automations 2024-02-02 15:51:24 +03:00
monosans 2222233987 Update README.md 2024-02-02 13:08:42 +03:00
monosansGitHubgithub-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 		8247c801e1 Update poetry.lock (#138) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-02-02 03:51:51 +00:00
monosansGitHubgithub-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 		449f8c0d8c Update .pre-commit-config.yaml (#137) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-02-02 03:41:54 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		004ef53f68 Bump certifi from 2023.11.17 to 2024.2.2 (#136) 
Bumps [certifi](https://github.com/certifi/python-certifi) from 2023.11.17 to 2024.2.2.
- [Commits](https://github.com/certifi/python-certifi/compare/2023.11.17...2024.02.02)

---
updated-dependencies:
- dependency-name: certifi
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-02-02 02:43:28 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		4fbb2fbe28 Bump the pip-semver-minor group with 1 update (#135) 
Bumps the pip-semver-minor group with 1 update: [ruff](https://github.com/astral-sh/ruff).


Updates `ruff` from 0.1.15 to 0.2.0
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ruff/compare/v0.1.15...v0.2.0)

---
updated-dependencies:
- dependency-name: ruff
  dependency-type: direct:development
  update-type: version-update:semver-minor
  dependency-group: pip-semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-02-02 02:37:02 +00:00
monosans ad093456c1 Update auto-merge.yml 2024-02-01 18:33:16 +03:00
monosans 328834eb03 Improve permissions check 2024-02-01 14:52:29 +03:00
monosansandGitHub a1f971db21 Docker (#134) 2024-02-01 14:15:47 +03:00
monosansandGitHub 5005e0dc6b Add Docker support 2024-02-01 10:24:26 +03:00
monosans 3e4b9e5921 Fix aiohttp version 2024-02-01 07:35:08 +03:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		5eee380dfe Bump peter-evans/create-pull-request from 5 to 6 (#132) 
Bumps [peter-evans/create-pull-request](https://github.com/peter-evans/create-pull-request) from 5 to 6.
- [Release notes](https://github.com/peter-evans/create-pull-request/releases)
- [Commits](https://github.com/peter-evans/create-pull-request/compare/v5...v6)

---
updated-dependencies:
- dependency-name: peter-evans/create-pull-request
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-02-01 03:36:51 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		a7e96fdc50 Bump the minor group with 1 update (#131) 
Bumps the minor group with 1 update: [platformdirs](https://github.com/platformdirs/platformdirs).


Updates `platformdirs` from 4.1.0 to 4.2.0
- [Release notes](https://github.com/platformdirs/platformdirs/releases)
- [Changelog](https://github.com/platformdirs/platformdirs/blob/main/CHANGES.rst)
- [Commits](https://github.com/platformdirs/platformdirs/compare/4.1.0...4.2.0)

---
updated-dependencies:
- dependency-name: platformdirs
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-01-31 02:39:11 +00:00
monosansGitHubgithub-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 		df39fd5e00 Update .pre-commit-config.yaml (#130) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-01-30 03:41:14 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		1f998a076f Bump the minor group with 2 updates (#129) 
Bumps the minor group with 2 updates: [aiohttp](https://github.com/aio-libs/aiohttp) and [ruff](https://github.com/astral-sh/ruff).


Updates `aiohttp` from 3.9.2 to 3.9.3
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.9.2...v3.9.3)

Updates `ruff` from 0.1.14 to 0.1.15
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ruff/compare/v0.1.14...v0.1.15)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor
- dependency-name: ruff
  dependency-type: direct:development
  update-type: version-update:semver-patch
  dependency-group: minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-01-30 02:30:27 +00:00
monosans 624ffa2698 Add noqa 2024-01-29 14:04:37 +03:00
monosans 326f143d26 Use Chrome User-Agent 2024-01-29 13:52:46 +03:00
monosans bd1b76a32e Fix aiohttp version 2024-01-29 13:28:55 +03:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		8f4a36c3d8 Bump nuitka from 1.9.7 to 2.0 (#128) 
Bumps [nuitka](https://github.com/Nuitka/Nuitka) from 1.9.7 to 2.0.
- [Changelog](https://github.com/Nuitka/Nuitka/blob/develop/Changelog.rst)
- [Commits](https://github.com/Nuitka/Nuitka/compare/1.9.7...2.0)

---
updated-dependencies:
- dependency-name: nuitka
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-01-29 04:54:52 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		a1afe51d50 Bump the minor group with 1 update (#127) 
Bumps the minor group with 1 update: [aiohttp](https://github.com/aio-libs/aiohttp).


Updates `aiohttp` from 3.9.1 to 3.9.2
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.9.1...v3.9.2)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-01-29 02:41:38 +00:00
monosans 2d30886e74 Iterate over ProxyStorage instead of ._proxies 2024-01-29 00:33:55 +03:00
monosans 51c847811c Remove get_sorted method from ProxyStorage 2024-01-29 00:32:31 +03:00
monosans 4aad31cd73 Remove platform from mypy config 2024-01-26 10:43:20 +03:00
monosans e201011ed3 Refactor typing_compat 2024-01-25 18:12:36 +03:00
monosans 330b607c59 Use sys.implementation.name instead of platform.python_implementation() 2024-01-25 15:43:12 +03:00
monosans afb85a6202 Refactor installation & scripts 2024-01-25 14:26:39 +03:00
monosans cabc3a0061 Refactor progress bar 2024-01-25 11:49:22 +03:00
monosans 890c000139 Don't shuffle proxies before checking 2024-01-25 10:30:40 +03:00
monosans 3059940212 Monkeypatch os.link to make aiofiles work on Termux 2024-01-25 09:05:53 +03:00
monosans c481a0e191 Add typing-modules in ruff 2024-01-24 11:42:00 +03:00
monosans 82055d3417 Remove unused variable 2024-01-23 09:49:17 +03:00
monosans dca437feae Add raise_for_status=True when scraping sources 2024-01-23 09:47:43 +03:00
monosans 73303cab1b Improve response decoding performance 2024-01-23 09:37:29 +03:00
monosans 31a50964eb Fix duplicates 2024-01-23 08:09:08 +03:00
monosans 0c0b23a161 Use lto=auto in compilation 2024-01-22 12:13:26 +03:00
monosans 2d6296b577 Enable full extras when compiling 2024-01-22 12:13:18 +03:00
monosans a42448808e Refactor get_grouped 2024-01-21 23:40:05 +03:00
monosans 0984fd1a82 Fix an edge case 2024-01-21 23:37:46 +03:00
monosans d42f09aeba Rename output path 2024-01-21 21:51:31 +03:00
monosans f4af55d37a Fix encoding issues 2024-01-21 21:46:01 +03:00
monosans 24f5eb5f2f Less strict parser 2024-01-21 21:24:09 +03:00
monosans 58935cd328 Remove dead sources 2024-01-21 21:19:33 +03:00
monosans 40b1d1596e Edit README.md 2024-01-21 21:00:43 +03:00
monosansandGitHub e4047e16ae Huge update 
- Drop support for Python 3.7.
- Use offline geolocation database instead of ip-api.com.
- Add support for proxy authentication.
- Add pre-compiled binaries.
- Refactor the code by a lot.
- Simplify config.
- Add automatic text encoding detection.
- Use TOML instead of INI for configuration.
- Add support for using httpbin-compatible services and services which return plain IP address for getting proxy's exit node.
- Add support for reading proxy lists from local files.
- Add support for saving to json.
- Remove support for saving geolocation to txt, use json instead.
- Improve parser.
- Improve config validation.
- Use poetry instead of requirements.txt.
- Use venv in start scripts.
 2024-01-21 17:45:01 +00:00