I am trying to scrape free USA, UK, China proxies from the internet to apply on my custom web scraping API. We get this question a lot. So, here I’m going to show you how to scrape proxy list from websites.
I just need the following fields every minute accessible via an API
How can I scrape free proxy list using scraping tool?
You may set up a scraping agent for this website to scrape the proxies. This is a HTML table, so the best selector will be
td:nth-child(n). And then replace the
n with the column position for each field you want to scrape out.
For example to extract the proxy_address, the selector will be :
To scrape the proxy port number, it will be
td:nth-child(3) and so on for other fields you mentioned and then save your scraping agent