Home / Cost tools

Scraping cost tools

Calculators for the parts of a scraping bill no vendor works out for you, because each sells one side of the question. They run in your browser on the prices this site reads from each vendor's own pages; nothing you type is stored or sent.

• Proxies or a scraping API

  100,000 pages of 500 KB are 50 GB a month. Put in your page size and proxy price, and see where bandwidth alone overtakes the cheapest API.

• Credit converter

  10,000 ScrapingBee credits buy 10,000 plain pages, 2,000 pages with JavaScript or 133 pages in stealth mode. The same for 18 APIs that bill in credits.

• What failed requests cost

  At 80% success, 15 of 17 web scraping APIs bill the same as at 100%; on the other 2 the failures add to the bill.

• Crawl budget

  20 sites of 5,000 pages crawled once a month is 100,000 JavaScript pages a month: from $49.00 on ScrapeBadger, across 40 web scraping APIs.

• RAG pipeline budget

  20,000 pages as markdown, refreshed weekly with 10% changing: $25.60 for the first month, then $7.60 a month on WebScraping.AI. Put in your own corpus.

• Real estate listings budget

  50 areas of 400 listings, refreshed weekly: $55.60 for the first month, then $19.60 a month on WebScraping.AI. Put in your own areas and listings.

• cURL converter

  Paste the cURL example from a scraping API's documentation and get the same request in Python, Node.js, PHP, Go, Java, Rust and 9 more, in your browser.

Scraping utilities

Small tools for the work around a scraping API's request and its reply, run in your browser like the rest.

• CSS and XPath selector tester

  Check that a selector picks the prices, titles or links you want from a page before you put it in a scraper.

• Base64 encoder and decoder

  Turn the Base64 screenshot or file an API returns back into an image or text, or encode a value for a header.

• URL encoder and decoder

  Encode the target address you pass to a scraping API as its url parameter, or read an encoded one.

• URL parser and normaliser

  Split an address into its parts and query parameters, and normalise it so one page is not crawled twice.

• Cookie parser

  Read the cookies a site sets, or turn them into the one Cookie header a scraping request sends.

• Text diff

  See what changed between two scrapes of the same page, or two API replies, line by line.

Plans and overage at your own volume are on every vendor's pricing page, and the whole market for any job is on the home page.