Web Search & Scraping MCP Servers
Search, news retrieval, crawling, scraping, extraction, and public web collection.
AI Readiness Kit
Published by GitHub account silverbackmarketing
A hosted MCP server that guides an assistant through researching a website and generating a set of AI readiness files such as llms.txt, ai.txt, schema and RAG.
Silent Directive Tools
Published by GitHub account silentdirectivellc-hub
Remote MCP server with three free utilities: a 2026 API shutdown scanner, a small-business website auditor, and a photo-based resale value estimator.
Web To Markdown Mcp
Published by GitHub account sidney
Fetches a URL and returns the page's main content as clean Markdown, falling back to a real Chromium browser for JavaScript-heavy or bot-protected pages.
Namera
Published by GitHub account siddmax
Checks a startup or product name across domains, USPTO trademarks and social handles, then scores and ranks candidates for an AI assistant.
Smart Crawler
Published by GitHub account shulex-voc
Hosted MCP server for e-commerce competitor intelligence, VOC review sentiment, Amazon ASIN analysis and Reddit growth playbooks.
Geo Tool Check
Published by GitHub account shufflethis
Scores how readable and citable a web page is for AI crawlers, checking robots.txt access, HTML structure, and citability.
Social Search Mcp
Published by GitHub account shubhamekapure
Lets an assistant run web searches restricted to social media domains such as Facebook, Reddit, LinkedIn and Instagram.
Shoptera Product Intelligence
Published by GitHub account shoptera-ai
A remote MCP server that lets an assistant search about 8.5 million products from over 2,500 Central European online shops by meaning, keyword or GTIN.
Browser Proof
Published by GitHub account shin1219-eng
A remote MCP server that lets an assistant verify web content and return deterministic JSON, text evidence and screenshots as proof.
MyMCPTools
Published by GitHub account shibley
A hosted, read-only MCP server for searching an MCP server catalog and checking whether listed servers actually respond to live handshake probes.
Schema Gen
Published by GitHub account sharozdawa
Generates Schema.org JSON-LD structured data for 12 schema types and validates existing markup, for SEO and rich-result work.
Robotstxt Ai
Published by GitHub account sharozdawa
Analyzes and generates robots.txt rules for AI crawlers, letting an assistant check which of 25+ bots are blocked on a site and draft new rules.
Indexnow
Published by GitHub account sharozdawa
A local MCP server that lets an assistant submit URLs for indexing through IndexNow and the Google Indexing API, parse sitemaps, and generate IndexNow keys.
Content Optimizer
Published by GitHub account sharozdawa
A local MCP server that scores and optimizes web content against search results, with SEO recommendations across seven categories.
Google AI Search MCP
Published by GitHub account shariqriazz
A local MCP server that gives an assistant Google AI-powered web search, documentation lookup, code analysis and architecture advice via Vertex AI or the Gemini
Zen Mcp
Published by GitHub account sh6drack
MCP server that lets an assistant drive the Zen Browser over WebDriver BiDi: navigate, read pages, click, fill forms, and take screenshots.
Minirag Mcp
Published by GitHub account sfrangulov
Local-first RAG server that indexes a folder of your own documents and gives an assistant hybrid semantic and keyword search over them.
SerpApi
Published by GitHub account serpapi
Official SerpApi MCP server that gives an assistant live search-engine results across many engines plus web page extraction and crawling.
Web Analytics Mcp
Published by GitHub account sercanmetalore
A remote MCP server for in-house on-page SEO auditing, including robots.txt checks and an SSRF-protected crawl of a site.
Social Media Data Mcp
Published by GitHub account sercanmetalore
A remote MCP endpoint that gives an assistant access to social media data from X, Instagram and TikTok using the user's own API keys.
Serp Content Mcp
Published by GitHub account sercanmetalore
A remote MCP server for web search, news retrieval and content extraction, using Brave or SerpApi keys you supply or a keyless news feed.
Job Search Mcp
Published by GitHub account sercanmetalore
A remote MCP server for hybrid job-posting search that queries official ATS board APIs, such as Greenhouse and Lever, without requiring an API key.
Velog
Published by GitHub account seongwon030
Write, publish, and manage Velog (velog.io) posts, series, comments, and trends. 30 tools.
Domain Check Skills Mcp
Published by GitHub account seomarlboro
Lets an assistant check domain name availability, compare registrar prices, and look up registration dates across 50+ TLDs.