Website to Markdown

io.github.saulius876-lgtmv1.0.0Updated Oct 9, 2026

Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.

VerifiedStreamable HTTPWeb executableWeb Search & ScrapingKnowledge & Memory

Overview

AI-generated overview

Crawls web pages and whole sites and returns their content as clean Markdown for RAG and AI agents.

What it does
This remote MCP server converts web pages and entire websites into clean Markdown. It crawls links and sitemaps to collect pages, then returns the extracted content in a form suited to retrieval-augmented generation and AI agents. It is hosted by Apify and reached over streamable HTTP.
When to use it
Use it when an assistant needs readable text from one or more web pages, or from a whole site, for summarization, indexing, or feeding a knowledge base. It fits RAG pipelines and agent workflows that need site content without writing a custom crawler.
Requirements
A remote MCP client that supports streamable HTTP, connecting to the Apify-hosted endpoint. Network access is required. No packages, environment variables, or headers are declared in the manifest.
Before you install
The server fetches third-party web content, so crawled pages and their URLs pass through the Apify service. Crawling may be subject to the target site's terms of service, robots rules, and rate limits. No credentials are declared, but confirm any account or quota requirements with the provider before relying on it.

Installation

In SourceWeft

  1. Open Website to Markdown in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Other MCP clients

Add this to your client's mcpServers config.

{
  "mcpServers": {
    "website-content-crawler": {
      "type": "http",
      "url": "https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api"
    }
  }
}

Tools

0
Tool metadata has not been indexed yet.

Version history

1
  1. v1.0.0LatestOct 9, 2026