How to scrape data from list of URLs?

I have created a scraper and it is scraping the data correctly from the page it was set up on, but how can I scrape the data from the list of URLs I have?

Or is there any tool or script in Agenty I can use to build the URLs automatically?

Yes it is! This is as simple as - go to input tab and change your agent input type as : MANUAL
Then enter the URL list in the input textarea:

Agenty allows you to extract data from list of urls without writing any code.

For New User:
Here is the simple steps to scraping data from urls list using web scraping agent:

  1. Log in your Agenty’ dashboard

  2. Click on the (+) New Agent button and select a sample agent

  3. Here, I choose simple Scraping Agent

  4. Go to Input section, choose Manual URL(s) as Input type

  5. Now, enter/paste the urls that you want to scrape in the URL(s) List

  6. Preview your field’s css selectors in the Configuration section. Know how to create field’s css selectors

And this is the video tutorial to clear more about scraping the list of urls:

And you can use MS Excel or Google spreadsheet to generate a list of URLs easily. Just enter your URLs and then use the number in the next column to scroll down and concatenate.

If the number should be increased by 1, you can add to the URL and drag it down like in this gif.


So, this is how you can scrape multiple urls for your business to achieve the goal:)
If you have any other queries related scraping list of urls, ask on help desk.

Signup now to get 100 pages credit free

14 days free trial, no credit card required!