Content-Length: 275280 | pFad | http://github.com/Sharang121/proxy-scraper-checker

35 GitHub - Sharang121/proxy-scraper-checker: HTTP, SOCKS4, SOCKS5 proxies scraper and checker with rich functionality.
Skip to content

HTTP, SOCKS4, SOCKS5 proxies scraper and checker with rich functionality.

License

Notifications You must be signed in to change notification settings

Sharang121/proxy-scraper-checker

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

49 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

proxy-scraper-checker

Screenshot

HTTP, SOCKS4, SOCKS5 proxies scraper and checker.

  • Asynchronous.
  • Uses regex to search for proxies (ip:port format) on a web page, which allows you to pull out proxies even from json without making any changes to the code.
  • Supports determining the geolocation of the proxy exit node.
  • Can determine if a proxy is anonymous.

For a version that uses Python's built-in logging instead of rich, see the simple-output branch.

You can get proxies obtained using this script in monosans/proxy-list.

Usage

  • Install Python (Windows 7 requires Python 3.8.X). During installation, be sure to check the box Add Python to PATH.
  • Download and unpack the archive with the program.
  • Install dependencies from requirements.txt (cd into the unpacked folder and run python -m pip install -U -r requirements.txt on the command line).
  • Edit config.ini according to your preference.
  • Run main.py (python main.py on the command line).

Folders description

When the script finishes running, the following folders will be created (this behavior can be changed in the config):

  • proxies - proxies with any anonymity level.
  • proxies_anonymous - anonymous proxies.
  • proxies_geolocation - same as proxies, but includes exit-node's geolocation.
  • proxies_geolocation_anonymous - same as proxies_anonymous, but includes exit-node's geolocation.

Geolocation format is ip:port|Country|Region|City.

Buy me a coffee

Ask for details in Telegram or VK.

License

MIT

About

HTTP, SOCKS4, SOCKS5 proxies scraper and checker with rich functionality.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%








ApplySandwichStrip

pFad - (p)hone/(F)rame/(a)nonymizer/(d)eclutterfier!      Saves Data!


--- a PPN by Garber Painting Akron. With Image Size Reduction included!

Fetched URL: http://github.com/Sharang121/proxy-scraper-checker

Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy