Home / Cost to scrape / Search engines
What it costs to scrape search engines
100,000 searches a month cost from $60.00 for Bing on DataForSEO SERP API to $90.00 for DuckDuckGo, Google Lens, Google Search, Google Shopping and Google Trends on ScrapingDog, across these 7 search engines.
Every one of them has a rate an API publishes for that site. Each bill is the cheapest of that API's current plans, worked out from its own pricing page.
| Site | 100,000 searches | Cheapest API | Rates for this site | How hard | The site's own API |
|---|---|---|---|---|---|
| Bing | $60.00 | DataForSEO SERP API, Standard Queue | 11 from 11 APIs | Moderate | None found |
| Google News | $60.00 | DataForSEO SERP API, Standard Queue | 18 from 14 APIs | Hard | None found |
| DuckDuckGo | $90.00 | ScrapingDog, Standard | 7 from 5 APIs | Moderate | None found |
| Google Lens | $90.00 | ScrapingDog, Standard | 11 from 10 APIs | Hard | None found |
| Google Search | $90.00 | ScrapingDog, standard search, Standard | 12 from 9 APIs | Hard | Custom Search JSON API |
| Google Shopping | $90.00 | ScrapingDog, Standard | 10 from 8 APIs | Hard | Merchant API |
| Google Trends | $90.00 | ScrapingDog, Trends explore, Standard | 17 from 13 APIs | Moderate | Google Trends API (alpha) |
What the levels mean: Easy means no protection is recorded; moderate, rate limits or fingerprinting without CAPTCHAs; hard, CAPTCHAs and IP checks that usually call for residential proxies; very hard, all of that plus measures such as TLS fingerprinting, a login wall in front of most data or honeypot links.
What each site's terms say
A vendor that can fetch a site is not permission to scrape it. Each site's own terms, as its record holds them:
- Bing: Microsoft's Services Agreement bans circumventing access restrictions, naming 'impermissible scraping', and says Bing materials are for noncommercial, personal use only; bing.com/robots.txt disallows /search for all user agents. The terms, read Oct 11, 2026
- Google News: Google's terms ban automated access that ignores a page's machine-readable instructions such as robots.txt; news.google.com's robots.txt disallows everything for all user agents except the home, topics, publications and stories pages. The terms, read Oct 11, 2026
- DuckDuckGo: DuckDuckGo's Terms and Acceptable Use Policy do not mention scraping or bots; the policy bans accessing the services without authorization and selling or reselling any portion of them, and robots.txt disallows the /html and /lite pages for all user agents. The terms, read Oct 11, 2026
- Google Lens: Google's terms ban automated access that ignores a page's machine-readable instructions, such as robots.txt. The terms, read Oct 11, 2026
- Google Search: Google's Terms prohibit automated access that violates machine-readable instructions on its web pages. The terms, read Oct 11, 2026
- Google Shopping: Google's Terms prohibit automated access that violates machine-readable instructions on its web pages. The terms, read Oct 11, 2026
- Google Trends: Google's terms ban automated access that ignores robots.txt; trends.google.com's robots.txt disallows the Explore pages for all user agents. The terms, read Oct 11, 2026