What is Lists?

The List feature in Agenty is used to upload CSV, TSV or other delimited files, which allow us to create and manage large numbers of input/URLs in agents input.

Lists feature is very helpful, especially when you are scraping a large website while having their URL list with multiple columns to associate some additional data as well in the agent result with the URL. Also, we cannot enter a lot of URLs in the manual input text area on the agent page, which might freeze your browser due to the size of in-memory text.

For example, if you have a scraping agent to extract price from a large eCommerce website using the URLs. You can bulk upload the URLs using a CSV file and then change the input type to “URL LIST” and select the URL field to point your scraping agent to that uploaded URL list.

Create a List

1. Go to the Lists menu from the left sidebar,
2. Now click on NEW LIST to create a new list,
3. A dialog box will open, where you can give a name to your list and can also add the description,
4. Save it by clicking on Add button in green color,

list1167×382 28.6 KB

5. Agenty will redirect to the next step page where we can upload our delimited files. For example: csv, tsv etc.

6. Drag and drop the file or click anywhere on the drag area to upload it manually,

7. Select the Has headers? switch if your file has headers or un-check if there is no header, Agenty will auto-generate the heading with names like Field1, Field2...,

8. Select the Delimiter as per your file. For example: comma(,) separated for csv
   

   

   upload a url list1133×615 21.7 KB

9. Select the Text Qualifier if your file has quotes or any other qualifier,

10. Now click on Next button, to see the preview to make sure that Agenty is reading the file correctly with the settings you have applied,

11. If you see the data is populated correctly in table preview, click on the Next button,

12. View final confirmation, and click on Final Upload button,

13. The list is successfully created and uploaded. You can go back to the Lists menu to view the list and its contents.

Select List in Agent

1. Go to your agent page
2. Click on the Input tab
3. Now choose the “Select a URL List” option in Input Type
4. Select your list in the dropdown
5. Finally, select the field that contains the URL in your list
   
   

   list input1129×560 24.4 KB
6. And Save the input configuration
7. Now, we can start the web scraping jobright away, or schedule it to run later for the selected list.

Update a List

1. Go to the Lists page
2. Click on the Action tab for the list you want to update
3. Then select the Upload file from the dropdown to add more URLs as we did in the Create a List step.

Delete a List

1. Go to the Lists page
2. Select the list you want to delete by clicking the checkbox
3. And click on the top left side Delete button
4. A confirmation dialog box will open asking for confirmation, select Yes to delete the list.
   
   

   list2812×327 19.9 KB