I am trying to scrape free USA, UK, China proxies from the internet to apply on my custom web scraping API. We get this question a lot. So, here I’m going to show you how to scrape proxy list from websites.
I just need the following fields every minute accessible via an API
How can I scrape free proxy list using scraping tool?
You may set up a scraping agent for this website to scrape the proxies. This is a HTML table, so the best selector will be
td:nth-child(n). And then replace the
n with the column position for each field you want to scrape out.
For example to extract the proxy_address, the selector will be :
To scrape the proxy port number, it will be
td:nth-child(3) and so on for other fields you mentioned and then save your scraping agent
Then, you can schedule the agent to run every minute or via the API and pull the result in JSON using the result API as in documentation here - Jobs API | Agenty