Getting Started with Agenty

Agenty helps you to automate the data collection, transformation, validation and analysis using the machine learning automotive agents running on cloud with distributed architecture to boost the performance and speed.

Creating an Agent

Most of the agents can be created using our Chrome Extension(Available on Chrome Store). After installing the extension, go to any website, launch the extension where you can add any number of fields, and choose the elements and type of information you want to extract.

  1. How to create website scraping agent
  2. How to create website change detection agent

Executing the Agent

Once the agent has been created, it can be started manually by clicking on the Start button available on agent details page or using the schedule option to run automatically on a particular time or day. And, If you are a developer and want to integrate with your existing app? you can also use our API as well to start the agent by passing the AgentId and the ApiKey.

Tracking Progress

After starting a agent job, it’s progress can be tracked on agent details page, where you can see the job status, total input processed, and the progress in percentage.

Automate the Delivery

Agenty offers a large and growing collection of Plugins to send the data to popular cloud storage, FTP and emails automatically, to make it smooth the delivery of agent result and important notification about the agent you are running.

Creating an Organization

After you sign up for a Agenty account, an organization is created automatically under the name you’ve entered in company name field. This organization will be the home for all the agents or projects, you’ll host with Agenty, along with the people involved in the process. As the person who signed-up/created the organization, you’ll be designated as one of its Administrators.

Inviting Team Members

After creating an organization, you can invite other team member to join your account with role-based security. Managing people’s access to your organization with roles. A person’s role in your organization defines their level of access to your Agenty account, its settings, projects, agents and your data. You can make people Admin, Manager, or Viewer for your organization.

Pages Credit

The page credit is like a stamp, you’d need pages credit to run your agents. The credit is deducted based on the number of successful processed pages by an agent job when it’s completed or while running. The pages credit is not carried forward to next month, but the same pages credit is given every month as per your plan. For example, if you are on Professional plan - You will get 75k pages credit every month to run your agent jobs.

Managing Subscription

To use Agenty, after the initial 14 days free trial or 100 pages(whichever comes first), you’d need to purchase a subscription to continue using Agenty. The subscriptions are available in Monthly and Annually billing options and can be purchased from the pricing page. Once the subscription purchase has been completed, Agenty will automatically charge the subscription amount every month(or year for annual) to renew the plan you’ve purchased.

If you want to cancel your subscription, you can login to your account > then go to settings > subscription and click on the Cancel Subscription button learn more…

All Posts

MCP Server: Web scraping automation with AI

Web Scraping with AI

How to capture a website screenshot every hour?

How to intercept HTTP request, responses with Puppeteer?

How to scrape hidden data from collapsible element?

Web scraping with Google sheets

Introducing Agenty AI

How to do client-side web scraping with JavaScript and jQuery?

How to scrape data from unstructured HTML lists?

How to change the scraping agent location for location-based web scraping?

Agenty product update - January 2022

How to accept cookie consent prompts before scraping the website

How to extract data from a Web API?

How to extract HTML table using REGEX?

How to extract product URL links?

How to use web scraping data for business?

How to use web scraping in data science?

How to extract prices from competitor websites?

Top 10 Web Scraping Tools

Agenty 2.0

How to block ads with Puppeteer to super-fast your web scraping

Scraping iframes with Puppeteer

How to get/set cookies, sessionStorage and localStorage in Puppeteer?

How to pull source scraping agent fields to merge data automatically?

How to Scrape Infinite Scroll Web Pages?

How to Pin your Agents to Dashboard

How to combine 2 or more scraping agents result in one agent?

Web Scraping with Puppeteer and Node.js

How to apply coupon on Agenty?

January 2020 changes in Agenty

How do I change my Agenty plan?

How long does it take to scrape a large ecommerce website?

How to scrape data from list of URLs?

How to scrape value from option tag inside select?

How to extract data from German website?

How to scrape free proxy list from internet?

How to scrape next pages when the selector repeated in pagination?

How to scrape all product color variants?

How to Extract Images and Image URLs from Websites?

How to extract drop-down select option excluding the 1st option?

How to build a website scraper?

How to scrape dynamic web pages rendered with JavaScript?

How can I scrape hidden elements from HTML?

How can I create an API to scrape website data?

How to extract email from websites online?

How does page credit work in Agenty?

XML Scraping

Web Scraping with Screenshot

Web Crawling History

Throttling in Web Scraping

Scraping Web API Data Using JSONPath Query Selectors

Scraping Details Pages from Listings

Scraping Data using CSS Selectors

Scraping Data from JSON using Regex

Scraping Chinese or Japanese Language Text Websites

Retry Errors in Web Scraping

Infinite Scrolling, Load More and Next Click Pagination in Web Scraping

Multiple Output Collections in Scraping

Join Two or More Extracted Rows into Single Cell

Field Types in Web Scraping Agent

Bulk URL Scraping

Scraping Data from HTML

Download Images, PDF Files in Web Scraping

Default Fields in Scraping Agent

Scraping Data from CSV File

CSS Extractor

How to create a scraping agent to extract data from websites?

Crawling Password Protected Website Online

Anonymous web scraping using proxy servers

Zapier integration

Webhook Integration

Shopify Integration : Scrape supplier website and upload product to Shopify store automatically

SFTP Integration

MongoDB Integration

Firestore Integration

Email Notification with Attachment

Dropbox Integration

Amazon S3 Integration

Algolia Integration: Crawl your website and import to Algolia indices to create custom search engine

October 2019 changes in Agenty

December 2019 changes in Agenty

How to create a website change detection agent?

Log inSign up