scrapingbenchGitHub

8 web data APIs for agents, graded on whether the job got done

Every provider gets the same tasks, the same model and the same limits. A task only counts when a script confirms every answer.

How a scrape task runs

The task1 of 60Price, stock and SKUfrom this product page?The modelClaude Haiku 5.5, same promptfor every providerOne toolscrape(url)API testedBrowserbaseContext.devFirecrawlJina LinkupScrapflySpiderTinyFishJSON answer{ "price": "168.28 USD", "stock": "In stock", "sku": "NS-18AADCCC"}Script checksSame as the page we generated?it countsup to 2 calls,60 s, $0.10
60 tasks. 50 pages on our own test site, including JavaScript, PDFs, tabs and missing answers, plus 10 project pages on PyPI.

Tasks done every answer correct, checked by script, with the cost of each finished task

Correct page given100%0.38¢ per task
Context.dev92%0.72¢ per task
Linkup90%0.60¢ per task
Firecrawl90%1.22¢ per task
TinyFish90%0.43¢ per task
Scrapfly88%0.61¢ per task
Jina87%0.57¢ per task
Browserbase82%1.12¢ per task
Spider20%2.48¢ per task
Model alone0%

None of the gaps between providers is big enough to rule out chance on 60 tasks, since tasks from the same site are counted as one group.

Cost per finished task all API and model spend, failures included, divided by tasks done

TinyFish0.43¢
Jina0.57¢
Linkup0.60¢
Scrapfly0.61¢
Context.dev0.72¢
Browserbase1.12¢
Firecrawl1.22¢
Spider2.48¢

Time per finished task median, lower is better

Firecrawl3.3 s
Browserbase3.3 s
Linkup3.4 s
TinyFish3.5 s
Context.dev3.7 s
Jina3.8 s
Spider4.6 s
Scrapfly5.0 s

Raw output, no model does the API's own output contain every answer? Cost is the API alone

Context.dev93%0.26¢ per task
Firecrawl93%0.80¢ per task
Jina93%0.01¢ per task
Linkup91%0.12¢ per task
TinyFish91%free
Scrapfly78%0.02¢ per task
Browserbase67%0.65¢ per task
Spider18%0.04¢ per task

Tuned settings each provider's best documented settings, frozen before the run

Context.dev92%0.69¢ per task
Scrapfly92%0.62¢ per task
Linkup90%1.04¢ per task
Jina87%0.59¢ per task
Firecrawl82%2.24¢ per task

Spider refused our test site because its filter flags the workers.dev domain; it scraped all 10 PyPI pages correctly. Firecrawl's tuned run hit its free plan's 10 requests a minute, which is why it scores lower than its default.