CrawlKit Scrapers

io.github.CrawlKit560由 GitHub 账号 CrawlKit560 发布v1.0.2更新于 Nov 5, 2026

58 scrapers via Apify MCP: Booking, Airbnb, Amazon, Google, Zillow, Indeed, Yelp, Reddit, Vinted

已验证Streamable HTTP可网页运行网页搜索与抓取金融商业与电商

概览

AI 生成的概览

托管在 Apify 上的 MCP 端点,提供 CrawlKit 的网页抓取器,覆盖电商、旅行、房产、招聘、社交媒体、评论、金融与搜索。

可以做什么
  • 抓取电商与平台商品数据:价格、库存、评分与评论,覆盖 Amazon、Walmart、AliExpress、Shopify 等
  • 收集旅行与本地数据:酒店与 Airbnb 房源、机票价格、餐厅信息
  • 获取房产挂牌与招聘职位,含薪资与公司信息
  • 提取社交媒体内容:子版块帖子、公开 Telegram 频道消息、YouTube 字幕
  • 获取应用商店、Trustpilot 与 Yelp 的评论与评分
  • 查询 SEC 文件与 Yahoo Finance 金融数据,以及搜索结果、新闻、趋势与网站技术栈
适用场景
适合需要大规模结构化公开网页数据的场景,例如价格与商品对比、旅行或房产调研、招聘市场扫描、评论舆情分析、新闻与搜索结果收集,且不想自行搭建和维护抓取程序。
运行要求
远程 MCP 端点 mcp.apify.com,仅限 CrawlKit 的抓取器。需要 Apify 账号,并通过 OAuth 登录或在 Authorization 请求头中提供 Apify API 令牌。使用按结果计费。
安装前请注意
抓取按结果计费,重复或大规模任务会产生费用。Apify API 令牌是可计费的凭据,应妥善保密。抓取数据来自第三方网站并经 Apify 托管服务传输,需遵守目标网站条款与相关法律。

安装

在 SourceWeft 中

  1. 打开 控制台中的 CrawlKit Scrapers,将其添加到工作区。
  2. 连接 所需的 凭据。它们会被私密存储,绝不会在公开页面上展示。
  3. 为需要使用其工具的对话启用该服务。

Web executable,通过 Streamable HTTP。 远程服务在工作区中配置后即可从网页运行时运行。

交给智能体安装

把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体,或 SourceWeft 对话中。智能体会读取该服务器的安装指南,先向你展示发布者、端点和登录方式,经你同意后再把它添加到你的客户端。密钥不会写进任何命令。

阅读 https://sourceweft.com/mcp/io.github.CrawlKit560%2Fcrawlkit-scrapers/install.md,并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前,先告诉我它的发布者、端点和登录方式,等我确认。不要把 API 密钥写进命令或我会提交的文件;问我密钥应从哪里获取。

查看智能体所依据的安装指南

其他 MCP 客户端

把它添加到你客户端的 mcpServers 配置中。 客户端会在首次连接时完成 OAuth 登录。

{
  "mcpServers": {
    "crawlkit-scrapers": {
      "type": "http",
      "url": "https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/wayfair-scraper,sweet_stickball/bestbuy-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/grubhub-scraper,sweet_stickball/offerup-scraper,sweet_stickball/vinted-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp,sweet_stickball/airbnb-reviews-scraper,sweet_stickball/amazon-bestsellers-scraper,sweet_stickball/amazon-product-scraper,sweet_stickball/app-store-reviews-scraper,sweet_stickball/ats-jobs-scraper,sweet_stickball/bluesky-scraper,sweet_stickball/booking-reviews-scraper,sweet_stickball/contact-details-scraper,sweet_stickball/eventbrite-scraper,sweet_stickball/glassdoor-scraper,sweet_stickball/google-ads-transparency-scraper,sweet_stickball/google-hotels-scraper,sweet_stickball/google-images-scraper,sweet_stickball/google-maps-scraper,sweet_stickball/google-patents-scraper,sweet_stickball/google-play-apps-scraper,sweet_stickball/google-play-reviews-scraper,sweet_stickball/google-trends-scraper,sweet_stickball/investing-scraper,sweet_stickball/realtor-scraper,sweet_stickball/remote-jobs-scraper,sweet_stickball/resy-scraper,sweet_stickball/sec-edgar-yahoo-finance,sweet_stickball/seek-job-scraper,sweet_stickball/spotify-scraper,sweet_stickball/substack-scraper,sweet_stickball/tech-stack-scanner,sweet_stickball/ted-tenders-scraper,sweet_stickball/thefork-scraper,sweet_stickball/thumbtack-scraper,sweet_stickball/ticketmaster-scraper,sweet_stickball/trustpilot-reviews,sweet_stickball/walmart-scraper,sweet_stickball/youtube-channel-scraper,sweet_stickball/youtube-comments-scraper,sweet_stickball/youtube-search-scraper,sweet_stickball/youtube-shorts-scraper,sweet_stickball/youtube-transcripts"
    }
  }
}

README

CrawlKit Scrapers

[Apify Store] [MCP] [License: MIT] [Listed on mcpservers.org]

29 production scrapers for e-commerce, travel, real estate, jobs, social media, finance and more. All Actors run on Apify — no infrastructure to manage, pay per result.

Quick Start

bash
pip install httpxexport APIFY_TOKEN="your_api_token_here"python examples/booking.py

Get your API token at console.apify.com/account#/integrations.

Actors

E-commerce

ActorPrice/resultDescription
AliExpress Scraper$0.0063Product search: title, price, discount, rating, store
Amazon Reviews Scraper$0.0042Product reviews: rating, text, date, verified — 9 marketplaces
Best Buy Scraper$0.0017Products: price, regular price, savings, rating, brand, model, stock
Google Shopping Scraper$0.0024Shopping results: prices, sellers, ratings — 12 countries
OfferUp Scraper$0.0014Marketplace listings: price, condition, location, seller, photos — US
Shopify Scraper$0.0007Store products: prices, variants, stock, images, tags
Vinted Scraper$0.0007Listings: price with fees, brand, size, condition — 23 countries
Walmart Scraper$0.0031Product search/pages: price, rating, seller, availability
Wayfair Scraper$0.0010Furniture & home products: price, discount, rating, brand, delivery

Travel

ActorPrice/resultDescription
Airbnb Scraper$0.0028Search results: listing, price, rating, reviews, room type
Booking.com Scraper$0.0035Hotel search: name, price, rating, stars, district, coordinates
Google Flights Scraper$0.00017Flight fares: price, airline, times, duration, stops

Food & Local

ActorPrice/resultDescription
Grubhub Scraper$0.0035Restaurants: rating, delivery fee and time, address, optional full menu — US

Real Estate

ActorPrice/resultDescription
Realtor.com Scraper$0.0007Property listings: price, beds, baths, sqft, coordinates
Zillow Scraper$0.0016Listings: price, Zestimate, beds, baths, sqft

Jobs

ActorPrice/resultDescription
Google Jobs Scraper$0.0063Job listings: title, company, location, salary, apply links
Indeed Jobs Scraper$0.0005Job listings: title, company, salary — 6 countries
Glassdoor Scraper$0.0023Company reviews + salary ranges by title

Social Media

ActorPrice/resultDescription
Reddit Scraper$0.0028Subreddit posts/comments: title, text, author, date
Telegram Channel Scraper$0.0035Public channel messages: text, dates, views, media
YouTube Transcript Scraper$0.0035Video transcripts with timestamps + metadata + comments

Reviews

ActorPrice/resultDescription
App Store Reviews Scraper$0.00007iOS + Google Play reviews: text, rating, date, app version
Trustpilot Reviews Scraper$0.00048Reviews + company TrustScore, review count
Yelp Scraper$0.0035Business reviews: name, address, rating, review text

Finance

ActorPrice/resultDescription
SEC EDGAR & Yahoo Finance$0.00035SEC filings (10-K, 10-Q, 8-K) + stock quotes + financials

Search & Tech

ActorPrice/resultDescription
Bing & DuckDuckGo SERP$0.0031Search results: titles, URLs, snippets, positions
Google News Scraper$0.0028News articles: headlines, sources, dates, URLs
Google Trends Scraper$0.0021Interest over time + related queries, up to 5 keywords
Tech Stack Detector$0.0016Website tech stack: CMS, frameworks, analytics, CDN, hosting

MCP Integration

The public CrawlKit Actors are available as MCP tools through Apify's hosted MCP server, restricted to CrawlKit with the actors parameter, so AI agents (Claude, Cursor, etc.) see only these tools. Sign in with Apify OAuth or send your Apify API token.

Endpoint: the url in server.json (https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,...). Also listed on the official MCP Registry as io.github.CrawlKit560/crawlkit-scrapers.

See tutorials/mcp_integration.md for setup instructions.

Examples

FileWhat it does
booking.pyScrape hotels in Paris from Booking.com
amazon_reviews.pyFetch product reviews from Amazon
youtube.pyExtract a video transcript from YouTube
google_trends.pyGet interest-over-time data for keywords
zillow.pyScrape real estate listings from Zillow

All examples use httpx + the Apify REST API. No SDK required.

Tutorials

  • Getting Started — API token, first run, reading results
  • MCP Integration — Connect CrawlKit to Claude, Cursor and other AI agents
  • Pricing — Pay-per-result model, tiers, volume discounts

License

MIT

来源:README.md,提交 bee86a8

工具

0
该服务器需要登录,因此 SourceWeft 无法在没有账号的情况下读取其工具,也未收录。已连接账号所能看到的内容可能因账号及其权限而异。

版本历史

3
  1. v1.0.2最新Nov 5, 2026
  2. v1.0.1Oct 23, 2026
  3. v1.0.0Oct 22, 2026

评分

已满足适用检查项的 85%

该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。

  • 近 30 天内可连通必需25 分
  • 已声明认证方式必需10 分
  • 已列出工具15 分

    请让服务器在无凭据时响应 tools/list,或发布可在沙箱中无凭据启动的软件包。

  • 描述必需15 分
  • 图标10 分
  • 文档15 分
  • 许可证10 分