How to scrape free proxy list from internet?

I am trying to scrape free USA, UK, China proxies from the internet to apply on my custom web scraping API. We get this question a lot. So here I am going to show you how to scrape proxy websites.

I just need the following fields every minute accessible via an API

  1. proxy_address
  2. proxy_port
  3. country
  4. up_time
  5. response_time

How can I do this using Agenty?

You may setup a scraping agent for this website to scrape the proxies. This is a HTML table, so the best selector will be td:nth-child(n) . And then replace the n with the column position for each field you want to scrape out.

For example, to extract the proxy_address. The selector will be : td:nth-child(2)

To scrape the proxy port number, it will be td:nth-child(3) and so on for other fields you mentioned and then save your scraping agent

Then you can schedule the agent to run every minute or via the API and pull the result in JSON using the result API as in documentation here - Jobs API | Agenty

14 days free trial

Automate your business with advanced, fully-featured agents on Agenty. Fast, scalable and no-code web automation tool for scraping, change monitoring and more...

Sign up for free →

No credit card required