CrawlKit Scrapers

io.github.CrawlKit560Published by GitHub account CrawlKit560v1.0.2Updated Nov 5, 2026

58 scrapers via Apify MCP: Booking, Airbnb, Amazon, Google, Zillow, Indeed, Yelp, Reddit, Vinted

VerifiedStreamable HTTPWeb executableWeb Search & ScrapingFinanceBusiness & Commerce

Overview

AI-generated overview

Hosted Apify MCP endpoint exposing CrawlKit's web scrapers for e-commerce, travel, real estate, jobs, social media, reviews, finance and search.

What you can do
  • Run scrapers for e-commerce and marketplace products, prices, stock and reviews across Amazon, Walmart, AliExpress, Shopify and similar sites
  • Collect travel and local data: hotel and Airbnb listings, flight fares, restaurant details
  • Gather real estate listings and job postings with salary and company details
  • Pull social media content such as subreddit posts, public Telegram channel messages and YouTube transcripts
  • Retrieve reviews and ratings from app stores, Trustpilot and Yelp
  • Fetch finance data from SEC filings and Yahoo Finance, plus search results, news, trends and website tech stacks
When to use it
Useful when an assistant needs structured public web data at scale — price and product comparisons, travel or property research, job market scans, review sentiment, or news and search result collection — without building and maintaining scrapers.
Requirements
Remote MCP endpoint at mcp.apify.com, restricted to CrawlKit actors. Requires an Apify account and either OAuth sign-in or an Apify API token sent in the Authorization header. Usage is billed per result by Apify.
Before you install
Scraping runs cost money per result, so repeated or large jobs can accumulate charges. The Apify API token is a billable credential and should be kept private. Scraped data comes from third-party sites and is sent through Apify's hosted service; respect those sites' terms and applicable law.

Installation

In SourceWeft

  1. Open CrawlKit Scrapers in the dashboard and add it to a workspace.
  2. Connect the required credentials. They are stored privately and never shown on public pages.
  3. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/io.github.CrawlKit560%2Fcrawlkit-scrapers/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config. The client completes OAuth sign-in on first connect.

{
  "mcpServers": {
    "crawlkit-scrapers": {
      "type": "http",
      "url": "https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/wayfair-scraper,sweet_stickball/bestbuy-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/grubhub-scraper,sweet_stickball/offerup-scraper,sweet_stickball/vinted-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp,sweet_stickball/airbnb-reviews-scraper,sweet_stickball/amazon-bestsellers-scraper,sweet_stickball/amazon-product-scraper,sweet_stickball/app-store-reviews-scraper,sweet_stickball/ats-jobs-scraper,sweet_stickball/bluesky-scraper,sweet_stickball/booking-reviews-scraper,sweet_stickball/contact-details-scraper,sweet_stickball/eventbrite-scraper,sweet_stickball/glassdoor-scraper,sweet_stickball/google-ads-transparency-scraper,sweet_stickball/google-hotels-scraper,sweet_stickball/google-images-scraper,sweet_stickball/google-maps-scraper,sweet_stickball/google-patents-scraper,sweet_stickball/google-play-apps-scraper,sweet_stickball/google-play-reviews-scraper,sweet_stickball/google-trends-scraper,sweet_stickball/investing-scraper,sweet_stickball/realtor-scraper,sweet_stickball/remote-jobs-scraper,sweet_stickball/resy-scraper,sweet_stickball/sec-edgar-yahoo-finance,sweet_stickball/seek-job-scraper,sweet_stickball/spotify-scraper,sweet_stickball/substack-scraper,sweet_stickball/tech-stack-scanner,sweet_stickball/ted-tenders-scraper,sweet_stickball/thefork-scraper,sweet_stickball/thumbtack-scraper,sweet_stickball/ticketmaster-scraper,sweet_stickball/trustpilot-reviews,sweet_stickball/walmart-scraper,sweet_stickball/youtube-channel-scraper,sweet_stickball/youtube-comments-scraper,sweet_stickball/youtube-search-scraper,sweet_stickball/youtube-shorts-scraper,sweet_stickball/youtube-transcripts"
    }
  }
}

README

CrawlKit Scrapers

[Apify Store] [MCP] [License: MIT] [Listed on mcpservers.org]

29 production scrapers for e-commerce, travel, real estate, jobs, social media, finance and more. All Actors run on Apify — no infrastructure to manage, pay per result.

Quick Start

bash
pip install httpxexport APIFY_TOKEN="your_api_token_here"python examples/booking.py

Get your API token at console.apify.com/account#/integrations.

Actors

E-commerce

ActorPrice/resultDescription
AliExpress Scraper$0.0063Product search: title, price, discount, rating, store
Amazon Reviews Scraper$0.0042Product reviews: rating, text, date, verified — 9 marketplaces
Best Buy Scraper$0.0017Products: price, regular price, savings, rating, brand, model, stock
Google Shopping Scraper$0.0024Shopping results: prices, sellers, ratings — 12 countries
OfferUp Scraper$0.0014Marketplace listings: price, condition, location, seller, photos — US
Shopify Scraper$0.0007Store products: prices, variants, stock, images, tags
Vinted Scraper$0.0007Listings: price with fees, brand, size, condition — 23 countries
Walmart Scraper$0.0031Product search/pages: price, rating, seller, availability
Wayfair Scraper$0.0010Furniture & home products: price, discount, rating, brand, delivery

Travel

ActorPrice/resultDescription
Airbnb Scraper$0.0028Search results: listing, price, rating, reviews, room type
Booking.com Scraper$0.0035Hotel search: name, price, rating, stars, district, coordinates
Google Flights Scraper$0.00017Flight fares: price, airline, times, duration, stops

Food & Local

ActorPrice/resultDescription
Grubhub Scraper$0.0035Restaurants: rating, delivery fee and time, address, optional full menu — US

Real Estate

ActorPrice/resultDescription
Realtor.com Scraper$0.0007Property listings: price, beds, baths, sqft, coordinates
Zillow Scraper$0.0016Listings: price, Zestimate, beds, baths, sqft

Jobs

ActorPrice/resultDescription
Google Jobs Scraper$0.0063Job listings: title, company, location, salary, apply links
Indeed Jobs Scraper$0.0005Job listings: title, company, salary — 6 countries
Glassdoor Scraper$0.0023Company reviews + salary ranges by title

Social Media

ActorPrice/resultDescription
Reddit Scraper$0.0028Subreddit posts/comments: title, text, author, date
Telegram Channel Scraper$0.0035Public channel messages: text, dates, views, media
YouTube Transcript Scraper$0.0035Video transcripts with timestamps + metadata + comments

Reviews

ActorPrice/resultDescription
App Store Reviews Scraper$0.00007iOS + Google Play reviews: text, rating, date, app version
Trustpilot Reviews Scraper$0.00048Reviews + company TrustScore, review count
Yelp Scraper$0.0035Business reviews: name, address, rating, review text

Finance

ActorPrice/resultDescription
SEC EDGAR & Yahoo Finance$0.00035SEC filings (10-K, 10-Q, 8-K) + stock quotes + financials

Search & Tech

ActorPrice/resultDescription
Bing & DuckDuckGo SERP$0.0031Search results: titles, URLs, snippets, positions
Google News Scraper$0.0028News articles: headlines, sources, dates, URLs
Google Trends Scraper$0.0021Interest over time + related queries, up to 5 keywords
Tech Stack Detector$0.0016Website tech stack: CMS, frameworks, analytics, CDN, hosting

MCP Integration

The public CrawlKit Actors are available as MCP tools through Apify's hosted MCP server, restricted to CrawlKit with the actors parameter, so AI agents (Claude, Cursor, etc.) see only these tools. Sign in with Apify OAuth or send your Apify API token.

Endpoint: the url in server.json (https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,...). Also listed on the official MCP Registry as io.github.CrawlKit560/crawlkit-scrapers.

See tutorials/mcp_integration.md for setup instructions.

Examples

FileWhat it does
booking.pyScrape hotels in Paris from Booking.com
amazon_reviews.pyFetch product reviews from Amazon
youtube.pyExtract a video transcript from YouTube
google_trends.pyGet interest-over-time data for keywords
zillow.pyScrape real estate listings from Zillow

All examples use httpx + the Apify REST API. No SDK required.

Tutorials

  • Getting Started — API token, first run, reading results
  • MCP Integration — Connect CrawlKit to Claude, Cursor and other AI agents
  • Pricing — Pay-per-result model, tiers, volume discounts

License

MIT

Source: README.md at commit bee86a8

Tools

0
This server asks you to sign in, so SourceWeft could not read its tools without an account and has not indexed them. What a connected account sees can depend on that account and its permissions.

Version history

3
  1. v1.0.2LatestNov 5, 2026
  2. v1.0.1Oct 23, 2026
  3. v1.0.0Oct 22, 2026

Score

85% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 daysRequired25 pts
  • Auth declaredRequired10 pts
  • Tools listed15 pts

    Answer tools/list without a credential, or ship a package that starts in a sandbox without one.

  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts
  • License10 pts