Apify Scrapers

mcp-name: io.github.jlucasmcrell/apify-scrapers

Apify Public Data MCP: 40 Production Data Tools & Public Records

[Python 3.10+] [Node.js 18+] [Apify Verified] [Glama MCP Server] [License: MIT] [Smithery] [Listed on mcpservers.org] One MCP server gives an AI agent 40 production data extractors - Google Maps business leads, Google News, Google Autocomplete, LinkedIn and Glassdoor jobs, SEC EDGAR, USAspending, Grants.gov, TED tenders, NHTSA recalls, FEC, EPA, ClinicalTrials.gov, openFDA, Europe PMC, GLEIF, CMS providers, Census geocoding, state business registries, contractor licences, Airbnb, YouTube, Twitch and Google Play - each running as an Actor on your own Apify account. Install with uvx apify-data-scrapers (Claude Desktop, Cursor, any MCP client), or call the same Actors directly from Python, Node.js or no-code tools.

Each actor is built with strict schema validation, deterministic field mapping, self-healing DOM selectors, and pay-per-event pricing (per-result rates from $0.00015, Actor-start from $0.0005; the live Apify Store price is authoritative).

Runtime contract and spending control

Since version 1.1.0, calls return {results, status, run?} in both MCP structured content and text. Status is success, partial, empty_unverified, or error; errors include a stable code and retry guidance. Zero rows are not proof that no matching records exist. Existing integrations that parsed a bare result array must now read results. Native dataset field names are preserved.

Each call requests a 120-second Actor timeout and a pay-per-event charge cap of $1 by default. Set APIFY_MAX_CHARGE_USD to adjust the cap. This is per run, not a total account spending limit; platform fees outside Actor event charges may still apply. Up to four calls may run concurrently. Cancelling a request attempts to abort its cloud run; check the returned run ID if confirmation fails. An ambiguous start is never retried automatically.

The MCP executable is Python; Node.js files are direct Actor API examples, not a second MCP server. Private queued Actors are omitted from this public catalog.

Quick Navigation

• Make.com templates
• Use-case guides
• Available Extractors & Store Listings
• Python Quickstart
• Node.js Quickstart
• No-Code & Automation Workflows (n8n, Sheets, Slack)
• Pre-Built Example Tasks (Zero Code)
• Free Sample Datasets
• AI Agent & MCP Integration (Claude Desktop, Cursor, Custom Agent)
• In-Depth Engineering Guides
• Repository Structure
• Contributing & Author

Choose your tools

Choose a focused tool profile and generate your installation configuration.

Version 1.2.0 adds the optional APIFY_TOOL_PROFILE environment variable: all (default), leads, market, government, or research. These correspond to the four catalog categories below. Profiles restrict tool discovery and calls, prompts, and the Actor catalog. Restart the MCP server and refresh/reconnect your client after changing the profile. Keep only the focused server entry if you do not also want the full catalog loaded. Direct Actor API examples are unchanged; this setting is not an Apify account permission boundary.

Choose your first workflow

No separate subscription to this MCP package is required. Actor runs are billed through your Apify account at the displayed Store price. Start with a small run and inspect its output before scheduling recurring work; public-source data can be delayed, incomplete, or temporarily unavailable.

Privacy Policy

The MCP server collects nothing. It runs on your machine, reads APIFY_TOKEN from your environment, and its only outbound calls are to the Apify API to run the Actor you asked for — on your own Apify account. No telemetry, no logs, no data sent to us. Full policy: apify.revenuesystemslabs.com/privacy.

Make.com templates

Eight published Make scenarios, one click to copy into your own Make account. Each asks for your Apify token and your destination (Google Sheets or Slack) in the setup wizard.

Use-case guides

One page per question an agent gets asked, each listing the tools, arguments, returned fields and prices for that job:

• MCP server for SEC EDGAR filings
• MCP server for Google Maps data and business leads
• MCP server for public records: business registries, licences and providers
• MCP server for job search: LinkedIn and Glassdoor listings
• MCP server for US government data

Focused, end-to-end tutorials:

• Use public-data Actors directly in ChatGPT with Apify MCP
• Monitor SEC EDGAR filings automatically
• Build a contractor lead list from Google Maps
• Monitor CMS healthcare-provider changes

Available Extractors & Store Listings

Every extractor below is both an Apify Store listing and an MCP tool of the same server; the sections are the questions buyers arrive with.

Business intelligence & lead generation

Also available: Cross-border company registry search, combining UK, French and GLEIF records where available.

Jobs, market & consumer intelligence

Government & public records

Also available: SEC Form 4 insider transactions, OFAC sanctions, CourtListener cases, and NVD/CISA vulnerability intelligence.

Research & health data

Python Quickstart

1. Install dependencies

pip install apify-client pandas python-dotenv

2. Export 50 Google Maps Leads to CSV

import osfrom apify_client import ApifyClientimport pandas as pd
# Get your API token from https://console.apify.com/account/integrationsclient = ApifyClient(os.getenv("APIFY_TOKEN"))
# Run the actorrun = client.actor("captainhandsome/google-maps-business-search").call(run_input={    "search_query": "commercial electricians",    "location": "Dallas, Texas",    "max_items": 50,    "include_details": True,})
# Fetch dataset items and export to CSVitems = list(client.dataset(run["defaultDatasetId"]).iterate_items())df = pd.DataFrame(items)df.to_csv("dallas_electricians.csv", index=False)print(f"Exported {len(df)} leads to dallas_electricians.csv")

See examples/google_maps_leads_to_csv.py for the full script.

Node.js Quickstart

1. Install dependencies

npm install apify-client

2. Query SEC EDGAR Filings

import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: process.env.APIFY_TOKEN });
const run = await client.actor('captainhandsome/sec-edgar-filings-search').call({  companies: ['AAPL', 'NVDA', 'MSFT'],  forms: ['10-K'],  max_items: 15,});
const { items } = await client.dataset(run.defaultDatasetId).listItems();items.forEach(filing => {  console.log(`[${filing.ticker}] ${filing.form} (${filing.filing_date}): ${filing.filing_url}`);});

See examples/sec_filings.js for the full script.

No-Code & Automation Workflows

If you automate via n8n, Make, Zapier, or Google Sheets, ready-to-import blueprints are included in workflows/:

• Google Maps Leads to Google Sheets (n8n): Weekly scheduled local-lead extraction into Google Sheets with persistent duplicate suppression.
• SEC EDGAR 10-K & 8-K Alerts (n8n): Four-hour filing monitor with persistent duplicate suppression.
• Competitor News Alerts (n8n): Daily Google News monitoring with persistent duplicate suppression.
• Grants.gov Opportunity Alerts (n8n): Daily funding-opportunity monitoring with persistent duplicate suppression.
• TED European Tender Alerts (n8n): Daily procurement monitoring with persistent duplicate suppression.
• NHTSA Vehicle Recall Alerts (n8n): Daily safety-recall monitoring with persistent duplicate suppression.
• Eight Make-approved templates: Guided setup for Google Sheets and Slack workflows. Connect your own accounts and review inputs before running; Apify and Make usage charges may apply.

Open a template in Make: Google Maps, Glassdoor, California contractors, SEC filings to Slack, Google News, Grants.gov, TED tenders, or NHTSA recalls.

Pre-Built Example Tasks (Zero Code)

If you prefer runnable web UI tasks without writing any code, each actor includes pre-configured tasks published on Apify Store:

Google Maps Leads

• Phoenix HVAC Company Leads
• Dallas Commercial Electrician Leads
• Chicago Dentist Directory

Glassdoor Jobs

• Austin Software Developer Jobs
• Seattle Product Manager Jobs
• New York Data Analyst Jobs

Airbnb Rentals

• Nashville Airbnb Listings
• Miami Airbnb Listings
• Austin Airbnb Listings

YouTube & Google Play

• Small Business Marketing Videos
• Python Tutorial Video Research
• Instagram One-Star Play Store Reviews

Free Sample Datasets

Looking for clean data to benchmark, analyze, or train models? Verified sample bundles with metadata schemas are available in datasets/ and hosted publicly on Hugging Face Datasets:

Eight verified sample bundles, each exported from a production run of the Actor named beside it. Every one is served from this repository and mirrored to Hugging Face, where the dataset card links back to the Actor that produced it.

1. Phoenix HVAC Contractor Leads: datasets/phoenix_hvac_leads/ | Hugging Face Hub — 10 verified HVAC contractor profiles with ratings, addresses, and phone numbers (Google Maps Business Leads).
2. California Licensed Contractors: datasets/california_solar_contractors/ | Hugging Face Hub — 50 active C-46 and B licensed solar installers with state verification numbers (California Contractor License Search).
3. Austin Software Engineer Postings: datasets/austin_software_jobs/ | Hugging Face Hub — 30 normalized job listings with estimated posting dates and salary ranges (LinkedIn Public Jobs).
4. S&P 500 Corporate Filings: datasets/sp500_sec_edgar_filings/ | Hugging Face Hub — 5 SEC EDGAR filing records with CIK, ticker, SIC and document links (SEC EDGAR Filings).
5. US Federal Defense & AI Awards: datasets/us_federal_defense_ai_awards/ | Hugging Face Hub — 10 federal contract awards with recipient, agency, obligation amount and dates (USAspending Federal Awards).
6. US Remote AI & ML Job Postings: datasets/us_remote_ai_ml_job_postings/ | Hugging Face Hub — 10 remote AI/ML postings with title, company, location and apply URL (LinkedIn Public Jobs).
7. Top Twitch Live Streams: datasets/twitch_top_live_streams_metadata/ | Hugging Face Hub — 10 live-channel records with viewer counts, category and language (Twitch Live Streams).
8. Mobile App Sentiment Reviews: datasets/mobile_apps_user_sentiment_reviews/ | Hugging Face Hub — 10 Google Play reviews with score, thumbs-up count and reviewer metadata (Google Play Reviews).

AI Agent & MCP Integration

All actors in this repository conform to OpenAPI and JSON Schema standards, making them directly callable by AI agents via the Model Context Protocol (MCP):

Option 1: Claude Desktop / Cursor with UVX (Recommended)

Add this to your claude_desktop_config.json or Cursor MCP settings:

{  "mcpServers": {    "apify-data-scrapers": {      "command": "uvx",      "args": ["apify-data-scrapers"],      "env": {        "APIFY_TOKEN": "YOUR_APIFY_API_TOKEN"      }    }  }}

Option 2: Docker Container (Glama / Cloud)

Run via Docker:

{  "mcpServers": {    "apify-data-scrapers": {      "command": "docker",      "args": ["run", "-i", "--rm", "-e", "APIFY_TOKEN", "glcr.b-cdn.net/jlucasmcrell/apify-scrapers:latest"],      "env": {        "APIFY_TOKEN": "YOUR_APIFY_API_TOKEN"      }    }  }}

Option 3: Local Python Stdio Runner

Install via pip or run directly:

pip install apify-data-scrapersexport APIFY_TOKEN="your_token_here"apify-data-scrapers

Or from local source:

python mcp_server.py

Agent Prompts That Work Out-of-the-Box:

• "Search Google Maps for 50 commercial roofers in Atlanta with phone numbers and websites."
• "Retrieve Apple and Microsoft Form 10-K filings from SEC EDGAR for the last 2 years."
• "Search Glassdoor for remote product manager jobs with salary estimates."

In-Depth Engineering Guides

Technical case studies and problem-solution writeups are located in articles/:

• Bypassing Playwright Headless Pagination Hurdles on Airbnb: How to solve sticky overlay modal interruptions and viewport boundary clipping in large headless browser crawls.
• Extracting & Normalizing Clean Job Posting Dates from Glassdoor: Overcoming relative timestamp drift ("24h", "3d", "30d+") with deterministic parsing and ISO-8601 boundary tracking.

Repository Structure

apify-scrapers/ README.md                                # Documentation and quickstart LICENSE                                  # MIT License requirements.txt                         # Python client dependencies package.json                             # Node.js dependencies mcp.json                                 # MCP tool registry specification mcp_server.py                            # Native Python stdio MCP server articles/                                # In-depth engineering case studies    airbnb_playwright_pagination_guide.md    glassdoor_posting_dates_guide.md    reddit_community_responses.md        # Reference technical answers for forums datasets/                                # Sample benchmark datasets    phoenix_hvac_leads/    california_solar_contractors/    austin_software_jobs/ workflows/                               # No-code automation templates    n8n_google_maps_to_sheets.json    n8n_sec_edgar_to_slack.json    n8n_google_news_competitor_monitor.json    n8n_grants_gov_opportunity_monitor.json    n8n_ted_eu_tender_monitor.json    README.md examples/                                # Standalone developer scripts     google_maps_leads_to_csv.py     sec_edgar_filings_downloader.py     glassdoor_jobs_tracker.py     airbnb_market_scraper.py     usaspending_defense_awards.py     twitch_live_stream_monitor.py     google_maps_leads.js     sec_filings.js

Author & Support

Maintained by Joseph McRell.

• Apify Store: https://apify.com/captainhandsome
• GitHub: @jlucasmcrell
• Hugging Face: @joeygambino
• Issues & Requests: Please open an issue on this repository or submit a ticket on the respective Apify Actor Store page.

License

This project is licensed under the MIT License - see the LICENSE file for details.