ClawEngine.ai
How it works Docs Pricing Blog Log in

By use case · Spider Cloud pricing

Spider Cloud pricing and Spider API cost per 1,000 pages by page weight

The short answer

Spider Cloud is prepaid pay as you go with no subscription required. Credits cost $1 per 10,000, the minimum purchase is $1 and balances never expire. Each request is billed on two meters: bandwidth at $1 per GB, measured on the bytes before Spider converts them to markdown, and compute at $0.0001 per minute, capped at $0.003 per request or $0.005 when a headless browser was needed. Failed requests cost nothing and JavaScript rendering carries no multiplier. Spider publishes averages of about $0.0001 per scrape and $0.0003 per crawled page, and $0.02 to $0.155 per 1,000 pages across its HTTP, smart and browser modes. The real figure moves with three things: how heavy your target pages are, whether you route through residential proxies at $2 per GB with a 2x to 4x multiplier, and whether you turn on zero data retention, which bills 2.5x on self-serve accounts. A separate Unlimited plan sells concurrency instead, from $40 a month for 2 concurrent requests to $350 for 25. Every figure here was read from the Spider pricing page, its pricing guide and its proxy documentation, never from an aggregator.

Clean markdown & JSON · JavaScript rendered · robots.txt respected

Extraction demo
POST
Try:

Hit Extract to turn this page into clean, LLM-ready data.

robots.txt respected · public data only ·

Markdown · JSON · structured fields, from one API call. Crawling, rendering and extracting ... Samples are recorded. Your own URL is crawled live.

Spider is one of the cheapest crawl APIs on the market for plain pages, and it says so with numbers rather than adjectives. There is no plan ladder to decode. You buy credits, ten thousand to the dollar, and every request draws down bandwidth and compute until the balance runs out. Rendering is not a surcharge, standard proxy rotation is included and a request that fails costs nothing. For a team that has been burned by 5x and 25x credit multipliers elsewhere, that is a genuinely better deal.

The catch is that a bandwidth meter does not give you a price per page. It gives you a price per gigabyte, and the number of pages in a gigabyte depends entirely on the sites you crawl. Spider measures bandwidth on the bytes it downloads, before it turns them into markdown, so the clean 8 KB of text you receive can be billed as the 400 KB of HTML and scripts it came from. A documentation site and a retail category page can differ by ten times on the same request.

That is why the averages on the pricing guide are useful and also not a forecast. They are averages across Spider traffic, not across your target list. The honest way to budget Spider is to crawl a sample of your real targets, read the bandwidth figure on each response, and multiply. The table below does that arithmetic at four page weights so you can see how wide the range is.

We sell a crawl API with a flat monthly page allowance, so read the third column with that in mind. On raw price for light pages, Spider beats us and the table says so. Where we compete is a bill you can quote before the month starts, and schema-typed output from our own extraction without bringing a model key.

If you are pricing the other usual shortlist, our Firecrawl pricing breakdown converts its credits into pages on every plan, and Spider vs Firecrawl pricing per 1,000 pages prices four real workloads on both. For the wider field, the cheapest web scraping API comparison ranks every vendor we could verify by cost per 1,000 pages.

Data engineer checking a bandwidth usage graph on a monitor in a server room corridor
CRAWL RENDER JS EXTRACT MARKDOWN JSON

Any URL in LLM-ready data out

robots.txt respected public data only

Why it works

Three Spider billing rules that decide the real number

Bandwidth is billed before the markdown

Spider charges $1 per GB on the bytes it downloads, not on the cleaned output you receive. A 100 KB page costs $0.10 per 1,000 in bandwidth, a 500 KB page $0.50 and a 2 MB page $2.00. Asking for markdown instead of raw HTML changes what you get back, not what you pay for.

Residential proxies multiply the bandwidth line

Standard rotation is included. The residential pool is listed at $2 per GB with a 2x to 4x multiplier, and the pricing guide puts proxied bandwidth at 1.5x to 4x the base rate. On a heavy page that is the difference between $2 and $8 per 1,000. Zero data retention adds a further 2.5x on self-serve accounts.

Unlimited sells concurrency, not pages

The Unlimited plan is $350 a month for 25 concurrent requests, $14 each, sliding from $20 a slot at 2 concurrent to $13 at the top. Requests over the limit get an immediate 429. At $0.20 per 1,000 pages on pay as you go, $350 buys about 1.75 million pages, so Unlimited only pays once you keep those slots busy around the clock.

What it handles

Any URL in, clean structured data out

Point ClawEngine at a public page and it crawls, renders the JavaScript and extracts clean markdown or typed JSON in one call. Define a schema for structured fields, and respect robots.txt and Terms of Service by default.

  • Every published Spider rate, read from its pricing page, guide and proxy docs on 13 October 2026
  • Bandwidth and compute converted into a cost per 1,000 pages at four page weights
  • What residential proxies and zero data retention do to the bill
  • Top-up bonuses from $500 and the break-even point of the Unlimited plan
  • Per-endpoint averages for scrape, crawl, links, screenshots and search
  • Where Spider is the right purchase and a flat per-page crawl API is not
POST /v1/extract extraction result
200 · JSON
{
  "url": "https://example.com/products/atlas",
  "title": "Atlas Field Notebook",
  "markdown": "# Atlas Field Notebook\n\nDurable...",
  "data": {
    "name": "Atlas Field Notebook",
    "price": 24.00,
    "currency": "USD",
    "rating": 4.7
  },
  "links": [ "/products", "/cart" ],
  "metadata": { "rendered": true }
}
JS rendered · boilerplate stripped ✓ robots.txt respected

Head to head

Spider Cloud pricing by page weight next to a flat per-page crawl API

Every Spider figure below was read from its pricing page, its pricing guide and its proxy documentation on 13 October 2026. Bandwidth rows are our arithmetic at the stated page weight. We put ourselves last and we lose several rows outright.

Swipe to compare all columns →

What you are comparing Spider pay as you go Spider Unlimited ClawEngine
What the meter counts Bandwidth at $1 per GB plus compute at $0.0001 per minute Concurrent requests a month Pages. One page of plan allowance per page returned
Entry price $1 minimum top-up, credits never expire $40 a month for 2 concurrent requests $49 a month on Hobby. No free plan
Per 1,000 pages at 100 KB About $0.10 bandwidth plus compute Flat, inside the monthly price $0.40 on Startup monthly, about $0.13 on Scale yearly
Per 1,000 pages at 500 KB About $0.50 bandwidth plus compute Flat, inside the monthly price The same $0.40 or $0.13, page weight does not count
Per 1,000 pages at 2 MB About $2.00 bandwidth plus compute Flat, inside the monthly price The same $0.40 or $0.13
Per 1,000 pages at 2 MB on residential About $4 to $8 at the 2x to 4x residential multiplier Geo-targeting not yet available on Unlimited No residential pool and no anti-bot bypass
Failed requests Free Over the limit returns 429, nothing billed Count only when a page is returned
JavaScript rendering No multiplier, billed as compute up to $0.005 a request Included Included on every plan
Typed output against your schema AI features need an AI plan. The guide says model calls are billed by your model provider The same Schema extraction from Startup, up to 900 model-mapped pages a month, 3,500 on Scale. Pages with schema.org data are mapped without the model
Zero data retention 2.5x on self-serve, included on Enterprise The same Not sold as a separate option
Search and screenshots Search about $0.001 a request, screenshots about $0.0006 Included in concurrency Not offered. We do not run web search
Volume discount 5 percent bonus at $500, up to 15 percent at $5,000 $20 a slot falling to $13 at high concurrency Yearly billing at half of twelve monthly payments
Forecasting the bill Depends on page weight and proxy pool per target Fixed, if you can keep the slots busy Fixed. The plan allowance is the forecast
Best for Plain pages at very large volume on a tight budget, and defended targets Continuous high-throughput crawling Known public sites into markdown or typed fields on a bill finance can approve

Why ClawEngine

One API that crawls, renders and extracts

Not a raw HTML dump, not a headless browser fleet to run, and not a brittle parser to maintain. One call crawls a public page, renders its JavaScript and returns clean markdown or typed JSON, built for RAG pipelines and AI agents.

LLM-ready output

Clean markdown or typed JSON with the boilerplate stripped, so the data drops straight into a vector store, a prompt or an agent without a cleanup step.

JavaScript rendered

Each page loads in a real browser environment before extraction, so single-page apps and client-rendered content come back complete, not as an empty shell.

Compliance-first

ClawEngine works on public, permitted data only. It respects robots.txt and site Terms of Service and honors crawl-delay, so responsible scraping is the default.

Code examples

A crawl whose cost you know before it runs

On a bandwidth meter the cost of this crawl depends on what the 500 pages weigh. Here it is 500 pages of plan allowance whatever they weigh, returned as markdown, or as typed fields against a schema on Startup and Scale.

curl Crawl a known section into markdown (POST /v1/crawl)
curl https://clawengine.ai/v1/crawl \
  -H "Authorization: Bearer $CLAWENGINE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://example.com/docs/",
    "limit": 500,
    "path_prefix": "/docs/",
    "format": "markdown"
  }'

# 500 pages of plan allowance, whether each page
# weighs 50 KB or 2 MB on the wire.

People also ask

Spider Cloud pricing, the questions buyers ask

How much does Spider Cloud cost?

Spider Cloud is pay as you go at $1 per 10,000 credits, with a $1 minimum and no expiry. Requests are billed at $1 per GB of bandwidth plus $0.0001 per minute of compute, and Spider estimates about $0.0001 per scrape and $0.0003 per crawled page. An optional Unlimited plan sells concurrency from $40 a month for 2 requests to $350 for 25.

How is Spider Cloud priced?

Spider prices on usage rather than on pages. Every request draws two meters: bandwidth at $1 per GB, measured on the bytes downloaded before transformation, and compute at $0.0001 per minute, prorated to the millisecond and capped at $0.003 per request, or $0.005 with a headless browser. JavaScript rendering and standard proxy rotation carry no separate multiplier.

How much does Spider cost per 1,000 pages?

The pricing guide gives averages of $0.02 to $0.10 per 1,000 pages in HTTP mode, $0.028 to $0.123 in smart mode and $0.035 to $0.155 in browser mode. Your own figure depends on page weight because bandwidth is the larger meter: 1,000 pages at 500 KB each is half a gigabyte, or $0.50, before compute.

Does Spider charge for failed requests?

No. The pricing page states that failed requests cost $0, which is a buyer-friendly rule. It differs from vendors that bill a credit whenever a document comes back, including a page that returns a 403 or 404. Protected pages are retried with rotating proxies and, for heavily protected sites, routed to the cloud browser, which is billed as compute.

Do Spider credits expire?

No. Spider says balances do not expire and nothing resets monthly, so credits bought for a one-off crawl stay usable for the next one. That is more generous than credit plans that reset each billing period. The Unlimited concurrency plan is a separate monthly subscription and is not drawn from the credit balance.

Does Spider Cloud have volume discounts?

Yes, as bonus credits on larger top-ups. The pricing guide lists 5 percent extra at $500, 8 percent at $1,000, 12 percent at $2,000 and 15 percent at $5,000, applied automatically on a single purchase of that size. The pricing page itself shows the $500 and $2,000 steps. Enterprise pricing is custom and adds dedicated support and unlimited concurrency.

What is the Spider Unlimited plan?

Unlimited is a monthly plan priced by concurrent requests rather than by bandwidth. The default is $350 a month for 25 concurrent requests, and the slider runs from 2 concurrent for $40 to 1,538 concurrent for $19,994, with the price per slot falling from $20 to $13. Requests over the limit return a 429 with a Retry-After header, and geo-targeting is not yet available on it.

How much do Spider residential proxies cost?

The Spider proxy documentation lists the residential pool at $2.00 per GB with a 2x to 4x multiplier, and the ISP pool at $1.00 per GB with no multiplier. The pricing guide describes proxied bandwidth as 1.5x to 4x the base rate. Bringing your own proxy is documented as saving 50 percent on data transfer.

How much does Spider search cost?

The pricing guide estimates about $0.001 per search request, which is $1 per 1,000 searches, before any result pages are scraped. Screenshots average about $0.0006 each, link extraction about $0.0002 and the transform endpoint $0.0001 per object. All of these are averages, because the underlying meters are still bandwidth and compute.

Is Spider cheaper than Firecrawl?

For plain pages, usually by a wide margin. Firecrawl Standard is $83 a month billed yearly for 100,000 credits, $0.83 per 1,000 plain pages, while Spider averages $0.02 to $0.155. The gap is smaller on heavy pages and residential proxies. Firecrawl is easier to forecast because a page is one credit whatever it weighs.

Good questions

Questions about Spider Cloud pricing

For light pages on pay as you go, usually yes. Spider publishes $0.02 to $0.155 per 1,000 pages across its request modes, against $0.40 per 1,000 on our $99 Startup plan billed monthly and about $0.13 on Scale billed yearly. The gap narrows on heavy pages and closes on residential proxies, where bandwidth can reach several dollars per 1,000. If your target list is mostly heavy retail or media pages, run a sample before you assume Spider is cheaper.
When someone has to approve the number before the month starts. A metered bill that depends on page weight is cheap and hard to quote, and it moves when a target site adds a heavy script. A page allowance turns the same job into one line on an invoice. Teams with steady volume and a finance sign-off tend to pay a little more per page for that.

Explore more

More ways to turn the web into data with ClawEngine

Stop wrangling raw HTML. Get LLM-ready data.

Point ClawEngine at a public page and one call crawls, renders the JavaScript and extracts clean markdown or typed JSON, ready for your RAG pipeline or AI agent. Public, permitted data only.

See pricing

Crawl · render JS · extract markdown & JSON · robots.txt respected, public data only