CrawlKit Scrapers

io.github.CrawlKit560由 GitHub 帳號 CrawlKit560 發布v1.0.2更新於 Nov 5, 2026

58 scrapers via Apify MCP: Booking, Airbnb, Amazon, Google, Zillow, Indeed, Yelp, Reddit, Vinted

已驗證Streamable HTTP可網頁執行網頁搜尋與抓取金融商業與電商

概覽

AI 產生的概覽

託管於 Apify 的 MCP 端點,提供 CrawlKit 的網頁擷取器,涵蓋電商、旅遊、房地產、徵才、社群媒體、評論、金融與搜尋。

可以做什麼
  • 擷取電商與平台商品資料:價格、庫存、評分與評論,涵蓋 Amazon、Walmart、AliExpress、Shopify 等
  • 收集旅遊與在地資料:飯店與 Airbnb 房源、機票價格、餐廳資訊
  • 取得房地產物件與徵才職缺,含薪資與公司資訊
  • 提取社群媒體內容:看板貼文、公開 Telegram 頻道訊息、YouTube 字幕
  • 取得應用程式商店、Trustpilot 與 Yelp 的評論與評分
  • 查詢 SEC 文件與 Yahoo Finance 金融資料,以及搜尋結果、新聞、趨勢與網站技術堆疊
適用情境
適合需要大規模結構化公開網頁資料的情境,例如價格與商品比較、旅遊或房產調查、就業市場掃描、評論輿情分析、新聞與搜尋結果蒐集,且不想自行建置與維護擷取程式。
執行需求
遠端 MCP 端點 mcp.apify.com,僅限 CrawlKit 的擷取器。需要 Apify 帳號,並透過 OAuth 登入或在 Authorization 標頭提供 Apify API 權杖。依結果計費。
安裝前請注意
擷取依結果計費,重複或大規模任務會累積費用。Apify API 權杖是可計費的憑證,應妥善保密。擷取資料來自第三方網站並經 Apify 託管服務傳輸,須遵守目標網站條款與相關法規。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 CrawlKit Scrapers,將其新增到工作區。
  2. 連接 所需的 憑證。它們會被私密儲存,絕不會在公開頁面上展示。
  3. 為需要使用其工具的對話啟用該服務。

Web executable,透過 Streamable HTTP。 遠端服務在工作區中設定後即可從網頁執行環境執行。

交給代理程式安裝

把這段提示詞貼上到 Claude Code、Codex、Cursor 等代理程式,或 SourceWeft 對話中。代理程式會讀取該伺服器的安裝指南,先向你展示發布者、端點和登入方式,經你同意後再把它新增到你的客戶端。金鑰不會寫進任何命令。

閱讀 https://sourceweft.com/mcp/io.github.CrawlKit560%2Fcrawlkit-scrapers/install.md,並按其中說明把這個 MCP 伺服器接入我的客戶端。修改任何設定之前,先告訴我它的發布者、端點和登入方式,等我確認。不要把 API 金鑰寫進命令或我會提交的檔案;問我金鑰應從哪裡取得。

檢視代理程式所依據的安裝指南

其他 MCP 客戶端

把它新增到你客戶端的 mcpServers 設定中。 客戶端會在首次連接時完成 OAuth 登入。

{
  "mcpServers": {
    "crawlkit-scrapers": {
      "type": "http",
      "url": "https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/wayfair-scraper,sweet_stickball/bestbuy-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/grubhub-scraper,sweet_stickball/offerup-scraper,sweet_stickball/vinted-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp,sweet_stickball/airbnb-reviews-scraper,sweet_stickball/amazon-bestsellers-scraper,sweet_stickball/amazon-product-scraper,sweet_stickball/app-store-reviews-scraper,sweet_stickball/ats-jobs-scraper,sweet_stickball/bluesky-scraper,sweet_stickball/booking-reviews-scraper,sweet_stickball/contact-details-scraper,sweet_stickball/eventbrite-scraper,sweet_stickball/glassdoor-scraper,sweet_stickball/google-ads-transparency-scraper,sweet_stickball/google-hotels-scraper,sweet_stickball/google-images-scraper,sweet_stickball/google-maps-scraper,sweet_stickball/google-patents-scraper,sweet_stickball/google-play-apps-scraper,sweet_stickball/google-play-reviews-scraper,sweet_stickball/google-trends-scraper,sweet_stickball/investing-scraper,sweet_stickball/realtor-scraper,sweet_stickball/remote-jobs-scraper,sweet_stickball/resy-scraper,sweet_stickball/sec-edgar-yahoo-finance,sweet_stickball/seek-job-scraper,sweet_stickball/spotify-scraper,sweet_stickball/substack-scraper,sweet_stickball/tech-stack-scanner,sweet_stickball/ted-tenders-scraper,sweet_stickball/thefork-scraper,sweet_stickball/thumbtack-scraper,sweet_stickball/ticketmaster-scraper,sweet_stickball/trustpilot-reviews,sweet_stickball/walmart-scraper,sweet_stickball/youtube-channel-scraper,sweet_stickball/youtube-comments-scraper,sweet_stickball/youtube-search-scraper,sweet_stickball/youtube-shorts-scraper,sweet_stickball/youtube-transcripts"
    }
  }
}

README

CrawlKit Scrapers

[Apify Store] [MCP] [License: MIT] [Listed on mcpservers.org]

29 production scrapers for e-commerce, travel, real estate, jobs, social media, finance and more. All Actors run on Apify — no infrastructure to manage, pay per result.

Quick Start

bash
pip install httpxexport APIFY_TOKEN="your_api_token_here"python examples/booking.py

Get your API token at console.apify.com/account#/integrations.

Actors

E-commerce

ActorPrice/resultDescription
AliExpress Scraper$0.0063Product search: title, price, discount, rating, store
Amazon Reviews Scraper$0.0042Product reviews: rating, text, date, verified — 9 marketplaces
Best Buy Scraper$0.0017Products: price, regular price, savings, rating, brand, model, stock
Google Shopping Scraper$0.0024Shopping results: prices, sellers, ratings — 12 countries
OfferUp Scraper$0.0014Marketplace listings: price, condition, location, seller, photos — US
Shopify Scraper$0.0007Store products: prices, variants, stock, images, tags
Vinted Scraper$0.0007Listings: price with fees, brand, size, condition — 23 countries
Walmart Scraper$0.0031Product search/pages: price, rating, seller, availability
Wayfair Scraper$0.0010Furniture & home products: price, discount, rating, brand, delivery

Travel

ActorPrice/resultDescription
Airbnb Scraper$0.0028Search results: listing, price, rating, reviews, room type
Booking.com Scraper$0.0035Hotel search: name, price, rating, stars, district, coordinates
Google Flights Scraper$0.00017Flight fares: price, airline, times, duration, stops

Food & Local

ActorPrice/resultDescription
Grubhub Scraper$0.0035Restaurants: rating, delivery fee and time, address, optional full menu — US

Real Estate

ActorPrice/resultDescription
Realtor.com Scraper$0.0007Property listings: price, beds, baths, sqft, coordinates
Zillow Scraper$0.0016Listings: price, Zestimate, beds, baths, sqft

Jobs

ActorPrice/resultDescription
Google Jobs Scraper$0.0063Job listings: title, company, location, salary, apply links
Indeed Jobs Scraper$0.0005Job listings: title, company, salary — 6 countries
Glassdoor Scraper$0.0023Company reviews + salary ranges by title

Social Media

ActorPrice/resultDescription
Reddit Scraper$0.0028Subreddit posts/comments: title, text, author, date
Telegram Channel Scraper$0.0035Public channel messages: text, dates, views, media
YouTube Transcript Scraper$0.0035Video transcripts with timestamps + metadata + comments

Reviews

ActorPrice/resultDescription
App Store Reviews Scraper$0.00007iOS + Google Play reviews: text, rating, date, app version
Trustpilot Reviews Scraper$0.00048Reviews + company TrustScore, review count
Yelp Scraper$0.0035Business reviews: name, address, rating, review text

Finance

ActorPrice/resultDescription
SEC EDGAR & Yahoo Finance$0.00035SEC filings (10-K, 10-Q, 8-K) + stock quotes + financials

Search & Tech

ActorPrice/resultDescription
Bing & DuckDuckGo SERP$0.0031Search results: titles, URLs, snippets, positions
Google News Scraper$0.0028News articles: headlines, sources, dates, URLs
Google Trends Scraper$0.0021Interest over time + related queries, up to 5 keywords
Tech Stack Detector$0.0016Website tech stack: CMS, frameworks, analytics, CDN, hosting

MCP Integration

The public CrawlKit Actors are available as MCP tools through Apify's hosted MCP server, restricted to CrawlKit with the actors parameter, so AI agents (Claude, Cursor, etc.) see only these tools. Sign in with Apify OAuth or send your Apify API token.

Endpoint: the url in server.json (https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,...). Also listed on the official MCP Registry as io.github.CrawlKit560/crawlkit-scrapers.

See tutorials/mcp_integration.md for setup instructions.

Examples

FileWhat it does
booking.pyScrape hotels in Paris from Booking.com
amazon_reviews.pyFetch product reviews from Amazon
youtube.pyExtract a video transcript from YouTube
google_trends.pyGet interest-over-time data for keywords
zillow.pyScrape real estate listings from Zillow

All examples use httpx + the Apify REST API. No SDK required.

Tutorials

  • Getting Started — API token, first run, reading results
  • MCP Integration — Connect CrawlKit to Claude, Cursor and other AI agents
  • Pricing — Pay-per-result model, tiers, volume discounts

License

MIT

來源:README.md,提交 bee86a8

工具

0
該伺服器需要登入,因此 SourceWeft 無法在沒有帳號的情況下讀取其工具,也未收錄。已連接帳號所能看到的內容可能因帳號及其權限而異。

版本歷史

3
  1. v1.0.2最新Nov 5, 2026
  2. v1.0.1Oct 23, 2026
  3. v1.0.0Oct 22, 2026

評分

已滿足適用檢查項的 85%

該評分衡量此收錄條目的完整程度,依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價,也不表示伺服器安全或目前可用:可連通性是帶日期的檢查結果,評分也不包含安裝量或使用者評價。

  • 近 30 天內可連通必需25 分
  • 已宣告認證方式必需10 分
  • 已列出工具15 分

    請讓伺服器在無憑證時回應 tools/list,或發布可在沙箱中無憑證啟動的軟體包。

  • 描述必需15 分
  • 圖示10 分
  • 文件15 分
  • 授權條款10 分