Skip to content
Any website, any data.

Tell us what you need and we'll send a free sample before you commit.

Request a sample

AI Web Scraper & Data Extraction API

Describe the data you need in plain English and get clean JSON from any web page, with no CSS selectors to write or maintain.

Bulk AI data extraction
Paste one URL per line. Requests run one by one in your browser. 5 of 5 free requests left. Sign in for more.
API reference

Tell the AI what to extract, optionally list the fields and their types, then paste your URLs. Each page is rendered in a real browser and the AI returns the matching data as structured JSON. Because there are no selectors, extraction keeps working when a site changes its layout.

For high-volume jobs where speed and cost matter, define CSS selectors with the web scraper instead. For scheduled, multi-page jobs, build a scraping agent. Every option is documented in the Extract API reference.

Features

  • Plain-English prompts
    Describe what you want; no selectors required.
  • Typed fields
    Define text, number, or yes/no fields for clean JSON.
  • Lists of items
    Returns every matching item, such as all products.
  • JS rendering
    Pages are rendered in headless Chrome before extraction.
  • Layout-proof
    Keeps working when class names and markup change.
  • Bulk extraction
    Paste a list of URLs and extract from all of them.

Use cases

  • Price and inventory monitoring across e-commerce sites
  • Lead generation from directories and B2B catalogs
  • Real-estate and rental listing aggregation
  • Product review and rating collection for analytics
  • Building training datasets for LLMs and recommender systems
Extract typed fields with a prompt using cURLbash
curl -X POST https://api.agenty.ai/v1/extract \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://scrapingsandbox.com",
    "prompt": "Extract every product on the page",
    "fields": [
      { "name": "name", "type": "string" },
      { "name": "price", "type": "number" },
      { "name": "vendor", "type": "string" },
      { "name": "in_stock", "type": "boolean" }
    ]
  }'
Extract data from many URLs in Node.jsjavascript
const urls = [
  'https://scrapingsandbox.com/product/1',
  'https://scrapingsandbox.com/product/2',
];

for (const url of urls) {
  const res = await fetch('https://api.agenty.ai/v1/extract', {
    method: 'POST',
    headers: {
      'Authorization': 'Bearer YOUR_API_KEY',
      'Content-Type': 'application/json',
    },
    body: JSON.stringify({
      url,
      prompt: 'Extract the product details',
      fields: [
        { name: 'name', type: 'string' },
        { name: 'price', type: 'number' },
      ],
    }),
  });
  const { result } = await res.json();
  console.log(url, result);
}
Extract structured data with a prompt in Pythonpython
import requests

res = requests.post(
    "https://api.agenty.ai/v1/extract",
    headers={"Authorization": "Bearer YOUR_API_KEY"},
    json={
        "url": "https://news.ycombinator.com",
        "prompt": "Extract the top 10 stories with title and points",
    },
)
print(res.json()["result"])

How Agenty compares

FeatureAgentyDiffbotScrapingBeeScrapeStack
AI extraction (no selectors)YesYesYesNo
Typed field schemaYesFixed typesLimitedNo
JavaScript renderingYesYesYesYes
Online tool, no codeYesLimitedNoNo
Free tierYesYesYesYes

Frequently asked questions

What is the AI Data Extraction API?

The Agenty Extract API uses AI to read a rendered web page and return the data you describe as JSON. Send a prompt, a list of fields, or both. See the API reference for the full request format.

Do I need to write CSS selectors?

No. Describe the data in plain English, such as "every product with its name, price, and rating", and add typed fields if you want a fixed JSON shape. If you prefer selectors, use the web scraper.

How do I extract data from multiple URLs?

Paste your URLs into the tool at the top of this page, one per line, and click Extract data. The same prompt and fields are applied to every page, and you can download all results as JSON.

Does it work with JavaScript-heavy sites?

Yes. Every page is rendered in headless Chrome before extraction, so React, Vue, and Angular single-page apps work out of the box.

Is there a free tier?

You can run 5 extractions without an account, and every account starts with free credits. Check our pricing page for current limits.

API pricing

Pay only for successful requests

Buy credits when you need them. They never expire and the same key works for every endpoint.

Compare all plans

Pay as you go

$5 /1,000 credits

  • Credits never expire
  • Only successful requests billed
  • No monthly commitment

Credits per request

/v1/scrape
1
/v1/content
1
/v1/markdown
1
/v1/links
1
/v1/redirects
1
/v1/screenshot
2
/v1/pdf
2
/v1/extract
5
Web scraping agent

Web scraping with AI

Start scraping data from any website using the Agenty's web scraping agents with AI.

  • Custom web scraping at scale
  • Real-time price monitoring
  • LLM training data curation
  • Structured JSON & CSV exports
  • Anti-bot bypass built-in
  • 99.9% uptime SLA

Get a free sample dataset from any website before you commit.