Simple and efficient proxy pool, providing the following functions. Regularly crawl free proxy websites, easy and scalable. Use Redis to store brokers and sort broker availability. Regular testing and screening to eliminate unavailable proxies and leave available proxies. Provides a proxy API to randomly select available proxies that pass the test. The principle analysis of the proxy pool can be seen in " How to Build an Efficient Proxy Pool ". It is recommended to read it before using it. There are two ways to run the proxy pool, one is using Docker (recommended), and the other is the normal way.
Features
- Requires Docker
- You can search for the installation method by yourself
- The conventional method requires a Python environment and a Redis environment
- If you have Docker and Docker-Compose installed, you only need one command to run
- If you do not use Docker to run, you can also run it after configuring the Python and Redis environments
- Install and configure Redis
License
MIT LicenseFollow ProxyPool
Other Useful Business Software
Simplify IT and security with a single endpoint management platform
NinjaOne automates the hardest parts of IT, delivering visibility, security, and control over all endpoints for more than 20,000 customers.
The NinjaOne automated endpoint management platform is proven to increase productivity, reduce security risk, and lower costs for IT teams and managed service providers. The company seamlessly integrates with a wide range of IT and security technologies. NinjaOne is obsessed with customer success and provides free and unlimited onboarding, training, and support.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of ProxyPool!