If you are scraping a website with multiple agents by connecting them with each other to scrape data like a workflow. For example - Scraping categories from a retail website and then, products of each category scraped by category scraper. Then you must be looking for a way to combine both agents data automatically. Here is how to do that -
We can simply use the
Input type field option to pull any field from the source file. E.g. selected list in input or the source agent connected.
Add a input field
- Edit your details agent
- Go to fields and collections tab
- Click on add field button and then select type:
Inputto pull any field from the source agent, as in screenshot below.
- Type = Input
- From = Field name in source agent
Rerun the agent
Now, you can re-run your web scraping agent and it will set the input type field value automatically as in the source agen.