Web Content & URL Tools

ai.avaloncompanyv1.0.0更新於 Oct 3, 2026

26 tools: web pages to Markdown, metadata, tech stack, SSL, SEO, domains, email auth and SSO checks.

已驗證Streamable HTTP可網頁執行Developer ToolsSecurity & MonitoringWeb Search & Scraping

概覽

AI 產生的概覽

一個託管型 MCP 伺服器，提供 26 個工具，可將網頁讀取為 Markdown、擷取中介資料與結構，並檢查 URL、網域、SEO、郵件驗證與 SSO。

功能
它提供 26 個工具，用來抓取並分析公開網頁與 URL。頁面類工具可把頁面轉成乾淨的 Markdown、擷取中介資料、取出標題階層、連結、圖片與 JSON-LD、辨識技術堆疊、追蹤重新導向、檢查 TLS 憑證與安全標頭、解析 robots.txt、網站地圖與訂閱來源、查詢 WHOIS/DNS、稽核頁面 SEO，並檢查最多 100 個連結。它也能評估郵件驗證（SPF、DMARC、DKIM、MTA-STS、BIMI）、檢查 SAML 與 OpenID Connect 設定，並提供 cron、正規表示式、色彩、Unicode、時區轉換等開發者工具，以及 Hyperliquid 永續合約行情資料。
適用情境
當助理需要在不啟動瀏覽器的情況下讀取或稽核公開網頁內容時使用：摘要頁面、檢查網站 SEO、安全標頭、憑證、重新導向或失效連結、驗證郵件或 SSO 設定，或做小型開發者轉換。
執行需求
託管於 Apify 的遠端 Streamable HTTP 端點，本機不需執行任何程式。需要 Apify API 權杖，以 Authorization 標頭依 Bearer 形式送出，或透過 Apify 的 OAuth MCP 閘道登入 Apify 帳號。需要能連線至該端點與目標網站。
安裝前請注意
Authorization 標頭帶有 Apify API 權杖，應視為機密，避免分享用戶端設定。呼叫依成功次數透過 Apify 帳號計費（檢查與實用工具每次 $0.001，頁面工具每次 $0.003），失敗的呼叫免費。工具只抓取公開的 http/https 位址，會拒絕私有或內部位址，部分網站會阻擋自動存取。回傳的行情資料不構成投資建議。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 Web Content & URL Tools，將其新增到工作區。
  2. 為需要使用其工具的對話啟用該服務。

Web executable，透過 Streamable HTTP。 遠端服務在工作區中設定後即可從網頁執行環境執行。

其他 MCP 客戶端

把它新增到你客戶端的 mcpServers 設定中。

{
  "mcpServers": {
    "web-content-url-tools": {
      "type": "http",
      "url": "https://avalonai--web-content-url-tools-mcp.apify.actor/mcp"
    }
  }
}

README

Web Content & URL Tools MCP Server

A remote Model Context Protocol server that gives AI agents 26 tools for reading and checking the web — no browser, no setup, pay only for successful calls.

Read any page as clean Markdown, pull its metadata or structure, detect its tech stack, and check redirects, TLS certificates, security headers, robots.txt, sitemaps, feeds, domains (WHOIS/DNS), SEO, broken links, email authentication (SPF, DMARC, DKIM) and single sign-on (SAML, OpenID Connect). It also includes everyday developer utilities (cron, regex, color, Unicode, time zones) and Hyperliquid perpetuals market data.

Connect

Option 1 — Standby URL + Apify API token

Use your Apify API token as a Bearer token. Works in Claude Desktop, Claude Code, Cursor, VS Code, Windsurf and any MCP client that supports remote servers with headers.

json
{  "mcpServers": {    "web-content-url-tools": {      "url": "https://avalonai--web-content-url-tools-mcp.apify.actor/mcp",      "headers": { "Authorization": "Bearer <YOUR_APIFY_TOKEN>" }    }  }}

Option 2 — OAuth via mcp.apify.com (no token to copy)

Clients that support MCP OAuth can connect through Apify's hosted MCP gateway and sign in with their Apify account in the browser:

https://mcp.apify.com?tools=avalonai/web-content-url-tools-mcp

Claude Code example:

bash
claude mcp add --transport http web-content-url-tools "https://mcp.apify.com?tools=avalonai/web-content-url-tools-mcp"

Tools

Web pages and URLs

ToolWhat it returnsPrice per call
to_markdownClean, LLM-ready Markdown of the main content (menus, ads and footers removed), word/character counts, language$0.003
get_metadataTitle, description, preview image, site name, canonical URL, favicon, author, publish time, Open Graph / Twitter tags$0.003
extract_structureHeading outline, internal/external links, images, tables and JSON-LD$0.003
detect_technologiesCMS, framework, e-commerce platform, CDN, analytics and payment tools, with evidence$0.003
trace_redirectsEvery redirect hop (HTTP and meta refresh) to the final URL — expands short links$0.001
check_sslCertificate issuer, expiry, days remaining, SANs, and whether browsers trust it$0.001
grade_security_headersA+ to F grade for security headers, information leaks and insecure cookies$0.001
parse_robotsrobots.txt rules per user agent, sitemaps, and whether a path may be crawled$0.001
parse_sitemapURLs from a sitemap or sitemap index (auto-discovered, gzip supported)$0.001
read_feedRSS, Atom or RDF feed as JSON (auto-discovered from a website URL)$0.001
lookup_domainWHOIS (RDAP) registrar, dates, domain age, nameservers, DNS records, MX/SPF/DMARC$0.001
audit_seoOn-page SEO score and grade with prioritised issues and fixes$0.003
check_broken_linksUp to 100 links checked: broken, redirected and bot-blocked reported separately$0.003

Email and identity diagnostics

ToolWhat it returnsPrice per call
check_email_domainMX, SPF (10-lookup limit), DMARC, DKIM, MTA-STS, TLS-RPT and BIMI graded pass/warn/fail with fixes and a 0-100 score$0.003
analyze_saml_metadataSAML metadata (XML or URL): entity ID, endpoints and bindings, NameID formats, signing certificate expiry and issues$0.001
check_oidc_providerOpenID Connect discovery and JWKS: issuer match, HTTPS, PKCE S256, ID token algorithms, key sizes, certificate expiry$0.001

Developer utilities

ToolWhat it returnsPrice per call
parse_cronValidity, plain-English explanation, previous and next run times in any time zone$0.001
test_regexEvery match with positions and groups, plus find-and-replace; runaway patterns stop in 0.1 s$0.001
convert_colorHEX, RGB, HSL, HSV, CMYK, best text color, contrast and palettes$0.001
check_color_contrastWCAG 2 contrast ratio with AA/AAA pass/fail$0.001
inspect_unicodePer-character code point, name and bytes; grapheme count; normalization forms$0.001
convert_timezoneOne time in many IANA zones with offsets, abbreviations and DST$0.001
list_timezonesIANA time zone names, optionally by region$0.001

Hyperliquid perpetuals market data

ToolWhat it returnsPrice per call
hyperliquid_marketsMark/oracle price, 24h change, hourly and annualized funding, open interest, volume$0.001
hyperliquid_funding_historyHourly funding history (up to 30 days) with average and annualized rate$0.001
hyperliquid_candlesOHLCV candles from 1 minute to 1 week$0.001

Hyperliquid data comes from Hyperliquid's public market data. This server is not affiliated with Hyperliquid, and nothing it returns is financial advice.

Pricing

Pay per successful tool call through your Apify account: $0.001 for check and utility tools, $0.003 for page tools. Failed calls (invalid URL, blocked site, timeout) are free and return a clear error reason.

Good to know

  • Pages are read from the HTML the server sends; sites that render everything in the browser return little text and say so in a warning field.
  • Some sites block automated access; those calls return target_blocked and are not charged.
  • Only public http/https addresses are fetched; private and internal addresses are refused.

This repository

This is the source of the Apify Actor that hosts the MCP server. It is a thin connector: each tool forwards the request to the Web Content API and returns the JSON result.

.actor/        Apify Actor definition (Standby mode, MCP path /mcp, pay-per-event pricing)src/main.py    MCP server (FastMCP, Streamable HTTP) and tool definitionsDockerfile     Container image

You do not need to run it yourself — connect to the hosted endpoint above.

License

MIT © Avalon Company

來源：README.md，提交 44579ed

工具

0
工具後設資料尚未被收錄。

版本歷史

1
  1. v1.0.0最新Oct 3, 2026