By use case · Pricing comparison
Web scraping API pricing: what 11 web scraping APIs cost, and how to work out your real price per page
The short answer
Web scraping API pricing in 2026 starts around $16 to $69 a month for an entry plan and rises to roughly $300 to $1,000 a month for volume tiers, with most vendors billing in credits rather than requests. The headline price is rarely what you pay: rendering JavaScript, retrying blocked pages and stealth mode all consume extra credits, so the number that matters is your cost per successfully extracted page, not the plan price. ClawEngine is $39 a month for Hobby, $99 for Startup and $399 for Scale, with rendering and schema extraction included in one call rather than billed as add-ons. All prices below were checked in July 2026 on each vendor's own pricing page.
Clean markdown & JSON · JavaScript rendered · robots.txt respected
Last updated July 2026
Hit Extract to turn this page into clean, LLM-ready data.
robots.txt respected · public data only
Comparing web scraping APIs on their monthly price is how teams end up over budget in month two. Almost every vendor in this category sells credits, and a credit is not a page. A plain fetch might cost one credit, the same page with JavaScript rendering might cost five, a request that needs a residential proxy or stealth mode might cost ten, and a failed request may or may not be refunded depending on the vendor. Two APIs with identical $99 tiers can differ by 5x in what you actually get through them.
The honest way to compare is to take a sample of the pages you really need, count how many of them require rendering, estimate a realistic failure rate, and divide the plan price by the number of pages you expect to successfully extract. Then add the second bill nobody puts on the pricing page: the engineering time spent parsing the result. An API that returns raw HTML for half the price of one that returns clean typed JSON is not cheaper if a developer has to write and maintain a parser per site.
The table below is every vendor we track, with the entry price, the published tier ladder and the free allowance, taken from each vendor's own pricing page rather than from a review aggregator. Aggregator sites in this category are frequently wrong, and we have found invented tiers on more than one of them. Where a vendor is usage-priced with no simple list price, we describe the billing model instead of guessing a figure.
We include ourselves in the table and we are not the cheapest line on it. Firecrawl starts lower, ScrapeGraphAI starts lower, and Crawl4AI has no license cost at all if you are willing to run the browsers, proxies and retries yourself. What ClawEngine prices is one call that crawls, renders and returns typed JSON, on public and permitted pages only, so the pipeline after the API is smaller. If you are scraping a handful of static pages a month, a cheaper tool or a free library is the correct decision and we would rather say so here than sell you a plan you do not need.
Any URL in LLM-ready data out
robots.txt respected public data only
Why it works
What you get with Pricing comparison
Rendering is included, not an add-on
JavaScript rendering and typed schema extraction happen in the same call at the same price, so your plan does not shrink the moment you point it at a single page app.
Cost per page, not cost per credit
One request returns a finished, boilerplate-free document. There is no separate crawl, scrape and extract billing to reconcile before you know what a page cost you.
The parser bill you never see
Typed JSON out of the API means no per-site parser to write and maintain, which is usually the larger line item once you count developer time honestly.
What it handles
Any URL in, clean structured data out
Point ClawEngine at a public page and it crawls, renders the JavaScript and extracts clean markdown or typed JSON in one call. Define a schema for structured fields, and respect robots.txt and Terms of Service by default.
- Published US list prices, checked July 2026
- Entry, mid and volume tiers side by side
- What each vendor's credits really buy
- Where a cheaper tool is the right call
- How to model your own cost per page
- Usage-priced vendors described, never guessed
{
"url": "https://example.com/products/atlas",
"title": "Atlas Field Notebook",
"markdown": "# Atlas Field Notebook\n\nDurable...",
"data": {
"name": "Atlas Field Notebook",
"price": 24.00,
"currency": "USD",
"rating": 4.7
},
"links": [ "/products", "/cart" ],
"metadata": { "rendered": true }
}
Side by side
11 web scraping API prices compared
Published US list prices, checked in July 2026 on each vendor's own pricing page. We include ourselves, and we say where a cheaper tool is the right call.
| Web scraping API | Entry price | Published tiers | Free tier |
|---|---|---|---|
| ClawEngine | $39/mo | Hobby $39, Startup $99, Scale $399, Enterprise custom | No free plan |
| Firecrawl | $16/mo | Hobby $16, Standard $83 (100k credits), Growth $333, Scale $599 | Yes, 1,000 credits |
| Bright Data | Usage-based | Web Scraper API billed per record, roughly $0.75 to $3 per 1,000 depending on product and tier, with pay-as-you-go and no monthly commitment | Trial credits |
| Apify | $29/mo | Free tier with $5 credits, Starter $29, Scale $199, Business $999, plus per-Actor usage | Yes, $5 credits |
| ScrapingBee | $49/mo | Freelance $49, Startup $99, Business $249 | 1,000 free API calls |
| ScraperAPI | $49/mo | Hobby $49 (100k credits), Business $299 (3M credits), Enterprise $475 (14M credits) | Trial credits |
| ZenRows | $69/mo | Developer $69, Startup $129, Business $299 | Trial credits |
| Oxylabs | $49/mo | Web Scraper API: Micro $49, Starter $99, Business $999, Custom+ by quote. Proxies are priced separately, residential from $6/GB | Trial, up to 2,000 results |
| Crawl4AI | Free, open source | Apache-2.0, no license cost. You pay for your own servers, proxies and engineering time | Yes, fully open source |
| Diffbot | $299/mo | Free 10,000 credits, Startup $299 (250k credits), Plus $899 (1M credits), Professional $3,999 (5M credits), Enterprise custom | Yes, 10,000 credits |
| ScrapeGraphAI | $20/mo | Free 500 credits one-time, Starter $20 (10k credits), Growth $100 (100k), Pro $500 (750k), Enterprise custom. The Python library is MIT licensed and free to self-host. | Yes, 500 credits |
What you actually pay with Firecrawl
Credits do not roll over, and stealth mode bills 5 credits per page instead of 1, which changes the real cost on protected sites.
What you actually pay with Bright Data
It is a broad platform rather than a single LLM-ready endpoint, so output usually needs cleaning before you can embed it, and the pricing surface is complex.
What you actually pay with Apify
Costs stack (platform plan plus per-Actor compute or per-result fees), and output is generic JSON rather than LLM-ready markdown.
What you actually pay with ScrapingBee
You mostly get HTML back, so the cleaning, chunking and structuring work for an LLM is still yours to do.
What you actually pay with ScraperAPI
It is proxy infrastructure first, so an LLM pipeline still needs its own parsing, boilerplate stripping and schema layer.
What you actually pay with ZenRows
Protected requests consume far more credits than plain ones, so the effective price depends heavily on your targets.
What you actually pay with Oxylabs
The headline result counts are best-case for a single cheap target: Oxylabs own FAQ notes the Micro plan's 98,000 results apply to Amazon, and spreading the same plan across mixed targets works out closer to 16,000 per target. Whole-site crawling means buying a second product.
What you actually pay with Crawl4AI
You own the ops: proxy rotation, browser fleet, retries, blocks and upgrades. Free software is not free infrastructure.
What you actually pay with Diffbot
The first paid tier is $299 a month and credits are consumed fast (a Knowledge Graph record costs 25 credits, a data-center proxy request doubles the cost), so for plain RAG ingestion it is expensive and heavier than you need.
What you actually pay with ScrapeGraphAI
The managed API bills per credit and the rate depends on the endpoint (extract costs 5 credits, stealth adds 5, a crawl adds 2 on top of per-page scrape cost), so cost per page is harder to predict. Self-hosting means you supply the LLM key and pay model tokens on every page.
Why ClawEngine
One API that crawls, renders and extracts
Not a raw HTML dump, not a headless browser fleet to run, and not a brittle parser to maintain. One call crawls a public page, renders its JavaScript and returns clean markdown or typed JSON, built for RAG pipelines and AI agents.
LLM-ready output
Clean markdown or typed JSON with the boilerplate stripped, so the data drops straight into a vector store, a prompt or an agent without a cleanup step.
JavaScript rendered
Each page loads in a real browser environment before extraction, so single-page apps and client-rendered content come back complete, not as an empty shell.
Compliance-first
ClawEngine works on public, permitted data only. It respects robots.txt and site Terms of Service and honors crawl-delay, so responsible scraping is the default.
Code examples
Model your real cost per page before you buy
The plan price is an input, not an answer. This script takes your own URL sample, runs it, and reports the cost per successfully extracted page so you can compare vendors on the same basis.
import os, requests
BASE = "https://api.clawengine.ai/v1"
headers = {"Authorization": f"Bearer {os.environ['CLAWENGINE_API_KEY']}"}
SAMPLE = [...] # 100 representative URLs from your real target list
PLAN_PRICE = 99 # what the tier costs per month
PLAN_PAGES = 100_000 # pages the tier is sold as covering
ok = 0
for url in SAMPLE:
r = requests.post(f"{BASE}/extract", headers=headers,
json={"url": url, "format": "markdown", "render": True})
if r.ok and r.json().get("data", {}).get("markdown"):
ok += 1
success_rate = ok / len(SAMPLE)
real_pages = PLAN_PAGES * success_rate
print(f"success rate : {success_rate:.0%}")
print(f"effective pages : {real_pages:,.0f}")
print(f"cost per good page: ${PLAN_PRICE / real_pages:.5f}")
curl -s https://api.clawengine.ai/v1/extract \
-H "Authorization: Bearer $CLAWENGINE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"url":"https://example.com/pricing","format":"json","render":true,
"schema":{"plan_name":"string","monthly_price":"number","currency":"string"}}' \
| jq '{usage: .usage, data: .data}'
People also ask
web scraping API pricing: the questions buyers ask
How much does a web scraping API cost?
Entry plans across the major web scraping APIs run roughly $16 to $69 a month in 2026, mid tiers land between $99 and $333, and volume tiers reach $475 to $999. Diffbot is the outlier at $299 to start. Usage-priced vendors such as Bright Data bill per record instead, roughly $0.75 to $3 per 1,000 records depending on product and tier. Most plans are credit based, so your real cost depends on how many credits each page consumes.
What is the cheapest web scraping API?
On published list price, ScrapeGraphAI at $20 a month and Firecrawl at $16 a month are the lowest paid entry points among the managed APIs, and Crawl4AI is free and open source if you host it. Cheapest on the invoice is not always cheapest overall: with a self-hosted crawler you pay for servers, proxies and the engineering hours to keep a browser fleet alive, which usually costs more than the plan you avoided.
How is web scraping API pricing calculated?
Most vendors sell a monthly bundle of credits and charge a different number of credits per request depending on what the request needs. A plain HTML fetch is typically one credit, JavaScript rendering multiplies it, stealth or anti-bot bypass multiplies it again, and structured extraction may add its own charge. To compare vendors fairly, convert everything to cost per successfully extracted page for your own mix of targets.
What is a credit in web scraping API pricing?
A credit is the vendor's internal billing unit, not a page. The vendor decides how many credits each operation costs, so 100,000 credits might mean 100,000 simple fetches or 20,000 rendered pages on the same plan. Always read the credit table before comparing two plans by credit count, and check whether unused credits roll over, because in most plans they expire at the end of the billing period.
Why do JavaScript rendered pages cost more to scrape?
Rendering runs the page in a real browser so client-side JavaScript can build the content, which uses far more CPU, memory and wall-clock time than fetching raw HTML. A rendered request can occupy a browser instance for several seconds while a plain fetch takes milliseconds. Vendors pass that cost through as a credit multiplier, which is why a plan that looks generous can shrink dramatically once you turn rendering on.
Is a web scraping API cheaper than building your own scraper?
For anything beyond a few static pages, usually yes. The API bill is visible and the build cost is not: a self-hosted crawler needs proxy rotation, browser upgrades, retry logic, block handling and per-site parsers, and each of those is recurring engineering time. A rough test is to compare the annual plan cost against two to three weeks of developer time plus infrastructure, which is what a maintained in-house crawler tends to consume.
Is there a free web scraping API?
Several vendors include a trial or a small monthly allowance, and Crawl4AI and the ScrapeGraphAI library are genuinely open source. Those allowances are sized for evaluation, not production, and free managed tiers usually come with rate limits and no support. ClawEngine has no free plan on purpose, because it is built for teams running a real pipeline rather than one-off experiments.
Good questions
Questions about Pricing comparison
Explore more
More ways to turn the web into data with ClawEngine
Stop wrangling raw HTML. Get LLM-ready data.
Point ClawEngine at a public page and one call crawls, renders the JavaScript and extracts clean markdown or typed JSON, ready for your RAG pipeline or AI agent. Public, permitted data only.
Crawl · render JS · extract markdown & JSON · robots.txt respected, public data only