Webfetch SDKs
Official clients for the webfetch.io scraping and search
API, in JavaScript, Python and PHP. MIT licensed.
Each one wraps GET https://api.webfetch.io/v1/ and the search endpoints
(/v1/google, /v1/bing, /v1/yahoo, /v1/brave). The API is ScrapingBee-compatible, so
parameter names, defaults and credit costs match.
The shape is the same in all three
Search
The response has the shape of ScrapingBee's Google Search API.
Needs a paid plan with the robots.txt opt-out turned on for the key in the
key portal: every engine's robots.txt disallows its
result pages. Google, Bing, Yahoo and Brave are all open. 10 credits a page, 15 with light_request false; a failed
search costs nothing. Reference: https://webfetch.io/documentation#search.
Credits
mode=auto tries those routes cheapest first and charges only the one that
worked; max_cost caps it. An anti-bot challenge or CAPTCHA page is never
charged.
render_js defaults to true, so a call that does not set it costs 5 credits.
Pass render_js=false for a plain HTTP fetch at 1 credit.
A key is required
There is no keyless tier. A free account starts with
1,000 credits and gets 250 more each month (banking up to 1,000), and needs only a
confirmed email address. Each client
raises WebfetchError immediately when constructed without a key, rather than
spending a round trip on a request that cannot succeed.
Errors
Every SDK raises the same three-level hierarchy, so you can catch broadly or
narrowly:
A failed call is never billed, so you do not need to reconcile credits after an
error.
MCP server
Webfetch is also a remote MCP server, so an AI
assistant can fetch pages and run searches as tools, with no SDK in between.
A failed call costs nothing. Claude Code, in .mcp.json:
Documentation
https://webfetch.io/documentation