detect_runtime_capabilities
Detect Hosted Runtime Capabilities
Report hosted Apps SDK readiness, read-only runtime capabilities, unsupported capture behavior, and the local stdio command.
Takes no parameters.
io.github.jongko54Published by GitHub account jongko54v0.3.13Updated Nov 8, 2026
Clone any web page from a URL into a verified offline HTML copy, embed, or rebuild.
Turns a web page URL into an embed, an offline HTML snapshot, or a bounded rebuild, with read-only URL inspection tools and a local capture engine.
Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.
Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.
Read https://sourceweft.com/mcp/io.github.jongko54%2Fweb-embedding/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.Add this to your client's mcpServers config.
{
"mcpServers": {
"webembedding": {
"type": "http",
"url": "https://webembedding-jongkos-mcp.vercel.app/mcp"
}
}
}webEmbedding clones any web page from its URL for AI coding agents. Give Claude Code, Codex, Cursor, or any MCP client a URL and it returns a verified clone: the original embed when the page allows it, otherwise a self-contained offline HTML snapshot (inlined CSS, shadow DOM, localized fonts and images) or a bounded rebuild, scored against desktop, tablet, and mobile screenshots of the live page.
Add it to your agent in one line:
Then ask: "Clone https://example.com into ./clone and tell me the fidelity score." (Machine-readable summary for LLMs: llms.txt.)
webEmbedding is a source-first website cloning engine: it captures live pages with Playwright, replays network evidence from HAR artifacts, rebuilds only when direct reuse is blocked, and self-verifies the result.
It ships as a Skill + MCP server. Instead of asking a model to "clone this site" from a screenshot, it inspects the URL, chooses a reuse or rebuild route, captures DOM/runtime HTML/styles/assets/network traces, generates bounded frontend reconstruction artifacts, and checks the output with visual, DOM, computed-style, interaction, and responsive-breakpoint verification.
[webEmbedding Skill and MCP workflow]
GitHub listing, social preview, and launch-copy recommendations are in docs/github-listing.md.
The current pipeline is strongest for static and semi-static web pages:
It is not a full backend or app-logic clone engine. Login-only screens, app-first or native-app-required services, captcha-heavy sites, maps, games, canvas/WebGL-heavy pages, real-time feeds, payments, booking flows, and private server behavior still need separate handling.
Operationally, the repo is now a production-candidate clone engine for URL-based capture and bounded reconstruction: jobs can be queued, network evidence can be replay-audited from HAR artifacts, authenticated dashboard runs can be driven from user-owned browser state, and local gates verify the route corpus, score checks, package contents, and CI wiring. The remaining hard boundary is server-side product behavior, not front-end evidence capture and reconstruction.
Local benchmark runs from this repo (scripts/check_clone_quality_bench.py, mobile + tablet breakpoints, 2026-10-28):
These are generated by the local self-verify pipeline, not manually assigned ratings. Earlier bounded-rebuild previews embedded the reference screenshot, which inflated their visual score; the runtime snapshot renders real DOM and CSS, and every row above was also checked by side-by-side screenshot review. Known gap: layouts that page scripts compute for viewports other than the captured one (for example masonry footers) can still drift at tablet width.
The reproducible commands and score thresholds are tracked in docs/benchmark-evidence.json.
Production readiness gates are tracked in docs/production-pipeline-gates.json.
X-Frame-Options and CSP-blocked pages by rebuilding from captured evidencenetwork-replay-limited, auth-session-missing, public-app-gate, and canvas-visual-fallbackreplay_readiness before treating captured network evidence as replay-gradenetwork/manifest.json artifactsstorage_state_path or user_data_dir outside the repo1440x1200768x1024390x844The package uses playwright-core; it does not download a browser by itself.
Installing this project adds the source-first-clone plugin bundle, the exact-clone-intake skill, and the MCP server that exposes the URL inspection, capture, rebuild, and verification tools.
Clone a public URL after installing:
If you already have an older local plugin installed, overwrite it with:
You can also run the installer without a global install:
For MCP clients that can launch npm stdio servers:
For local smoke testing:
The MCP Registry identity is io.github.jongko54/web-embedding; server.json and package.json#mcpName are kept in sync for registry ownership verification.
The public remote MCP intake endpoint for Apps SDK Developer Mode is:
It exposes low-risk source-first routing tools such as URL inspection, embed candidate discovery, clone-mode classification, and embed snippet generation. Full browser capture, HAR replay, queues, bounded rebuilds, and one-pass clone execution remain local-first through the stdio MCP package.
Apps SDK review pages are hosted alongside the endpoint:
https://webembedding-jongkos-mcp.vercel.app/privacy.html,
https://webembedding-jongkos-mcp.vercel.app/terms.html, and
https://webembedding-jongkos-mcp.vercel.app/submission.html.
webEmbedding has two different execution boundaries:
http and https URLs, does not run Playwright, does not read local files, does not use browser profiles or storage state, and does not persist capture artifacts.output_dir or queue_root.storage_state_path or user_data_dir. webEmbedding does not collect credentials, perform login bypasses, or treat a public login shell as private app evidence.needs_session, or sent to manual review unless the user has explicit authorization and supplies the needed evidence.Local URL entrypoints reject non-HTTP schemes such as file:// so an agent cannot use clone/capture tools as a local file reader. Telemetry is disabled by default and, when enabled, excludes target URLs, local paths, captured HTML, screenshots, storage state, environment variables, API keys, and command output.
This repository includes marketplace metadata for the two local agent surfaces:
.agents/plugins/marketplace.json points to ./bundle/source-first-clone..claude-plugin/marketplace.json points to the same bundle and the bundle includes .claude-plugin/plugin.json.Claude Code users can add the marketplace from GitHub with:
AI auto-selection expectations and golden prompts live in docs/ai-distribution.md and evals/ai-selection/webembedding-golden-prompts.json.
Useful for testing without touching your real agent home:
Telemetry is disabled by default. On an interactive first install, web-embedding install asks once and defaults to No. Non-interactive installs such as CI and curl | bash do not prompt. If you opt in, web-embedding sends a small anonymous command-completion event to a JSON POST endpoint you control. It does not send target URLs, local paths, captured HTML, screenshots, storage state, environment variables, API keys, or command output.
Enable it during install:
Or manage it later:
Each event contains an anonymous install id, package version, command name, success/failure status, OS/runtime basics, and coarse option flags such as breakpoint_count or install_source.
Environment controls:
Run a local/self-hosted JSONL collector:
Summarize collected usage:
The summary includes install and clone executions, total command executions, unique anonymous install IDs, command counts, and version counts. See docs/telemetry.md for collector and analyzer details.
Inspect a URL and get route hints:
Run a safe preflight audit before capture or clone:
The audit reports whether the reference is ready for exact/embed reuse, needs local capture, needs an authenticated session, requires manual review, or should be blocked before any browser capture or filesystem output runs.
Run the full clone workflow:
Run a lightweight quality benchmark:
The benchmark prints compact rows for root, visual, and breakpoint scores. The full artifacts are written under the output directory.
A clone run can produce:
capture.jsonpipeline-run-manifest.jsondom/snapshot.jsondom/runtime.htmlstyles/computed-summary.jsonstyles/css-analysis.jsonnetwork/manifest.jsonnetwork/har.jsonnetwork/har-like.jsonnetwork/replay-report.jsonassets/inventory.jsoninteractions/states.jsoninteractions/trace.jsonscreenshots/runtime.pngsession/storage-state.jsonreproduction/plan.jsonreproduction/evidence-limitations.jsonreproduction/rebuild-prompt.txtreproduction/rebuild/starter.htmlreproduction/rebuild/starter.cssreproduction/rebuild/starter.tsxreproduction/rebuild/next-app/reproduction/self-verify/summary.jsonreproduction/self-verify/renderers/*/verification.jsonreproduction/self-verify/renderers/*/visual-qa.jsonreproduction/self-verify/renderers/*/breakpoints/*-verification.jsonRun the default small benchmark:
Run the universal route regression corpus and expectations gate:
Run a lightweight clone score gate:
Validate the committed benchmark evidence manifest:
Validate production pipeline gates:
Run the operational smokes individually:
Classify failure/action codes from a route report:
Find low-scoring persisted benchmark artifacts:
Run specific URLs:
Run a responsive benchmark:
bundle/source-first-clone
Installed plugin bundle, MCP server, and exact-clone intake skill.bundle/source-first-clone/mcp/source_first_clone
Capture, planning, rebuild, repair, and verification engine.bin/web-embedding.mjs
Node CLI wrapper.python/web_embedding/installer.py
Shared installer and command dispatcher.scripts/check_clone_quality_bench.py
URL clone quality benchmark helper.scripts/benchmark_routes.py
Universal route/capture-depth regression benchmark helper.scripts/check_benchmark_report.py
Benchmark expectation validator for exact, minimum, and contains-style checks.scripts/check_benchmark_evidence.py
Benchmark evidence manifest validator.scripts/check_job_queue_smoke.py
Filesystem async clone job queue smoke test.scripts/check_har_replay_smoke.py
Deterministic HAR replay engine smoke test.scripts/benchmark_authenticated_corpus.py
User-provided authenticated dashboard corpus runner.scripts/summarize_benchmark_scores.py
Utility for finding low or high scoring persisted benchmark artifacts under an output root.scripts/classify_pipeline_failures.py
Operational failure/action taxonomy summarizer for reports and capture artifacts.scripts/check_production_readiness.py
Production readiness gate validator for corpus, failure taxonomy, CI wiring, and policy docs.scripts/check_integration_smoke.py
Release, install, and URL-only clone smoke test.scripts/release_bundle.py
Release artifact builder.docs/
Architecture notes and universal benchmark documentation.The strongest claim for this project is:
A source-first website cloning engine that combines Playwright capture, HAR replay, MCP tools, and self-verification to rebuild iframe-blocked public pages with reproducible visual, DOM, style, interaction, and responsive scores.
Avoid treating the output as a legal or ownership bypass. The engine can reconstruct public page structure, but permission, licensing, and acceptable use still matter.
How can an AI coding agent clone a website from a URL?
Install the MCP server (npx -y web-embedding@latest mcp) and ask the agent to clone the URL. The agent calls clone_reference_url, which inspects the page, captures it in a real Chromium, picks reuse or rebuild, and returns the clone entrypoint with fidelity scores.
What does the clone look like on disk?
For pages that block iframes, snapshot/index.html plus snapshot/assets/ is a self-contained copy of the rendered page: stylesheets inlined from source (including CSS-in-JS and adoptedStyleSheets), open shadow roots as declarative shadow DOM, canvas pixels, form state, and localized images, fonts, and SVG sprites. Serve it over HTTP (python3 -m http.server); file:// blocks external SVG <use> references.
How is this different from SingleFile, screenshot-to-code, or open-lovable? SingleFile saves a page from a browser extension or CLI; webEmbedding uses the same class of DOM serialization but runs as an MCP tool, decides between embed reuse, snapshot, and rebuild, and verifies the result at three breakpoints. Screenshot-to-code and open-lovable generate new code from an image or scrape with an LLM; webEmbedding starts from the live DOM and CSS, so text, fonts, and layout come from the source instead of being re-imagined.
What can't it clone? Server behavior (logins, payments, search, real-time data), captcha- or bot-protected pages, closed shadow roots, and canvas/WebGL apps beyond a static frame. Authenticated pages need a user-provided browser session, and you still need the right to reproduce the page.
MIT
Source: README.md at commit e4b1ec8
Detect Hosted Runtime Capabilities
Report hosted Apps SDK readiness, read-only runtime capabilities, unsupported capture behavior, and the local stdio command.
Takes no parameters.
Inspect URL Reuse Route
Fetch a public or user-authorized URL and inspect title, metadata, frame policy, and likely source/embed candidates. Does not capture screenshots or persist artifacts.
urlrequiredtimeout_secondsDiscover Embed Candidates
Extract likely embed, preview, viewer, remix, and source URLs from a public or user-authorized page.
urlrequiredtimeout_secondsClassify Clone Mode
Decide whether a reference should be embedded, sourced, locally captured, bounded-rebuilt, or blocked before reproduction.
candidateslicense_textsite_profilesource_signalsexact_requestedGenerate Embed Snippet
Generate an iframe snippet for a known frameable and authorized URL. Does not verify frameability by itself.
urlrequiredtitleframeworkPlan Reproduction Path
Create a source-first plan that separates exact embed/source reuse from local capture and bounded rebuild work.
candidateslicense_textsite_profilecapture_bundlesource_signalsexact_requested100% of the applicable checks met
How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.
claude mcp add web-embedding -- npx -y web-embedding@latest mcp # Claude Codecodex mcp add web-embedding -- npx -y web-embedding@latest mcp # Codex CLInpm install -g web-embeddingweb-embedding installweb-embedding doctorweb-embedding clone \ --url https://developer.mozilla.org/en-US/ \ --output-dir ./.tmp/mdn-clone \ --wait-seconds 2 \ --timeout-seconds 35 \ --breakpoints mobile tabletweb-embedding install --forceweb-embedding doctornpx web-embedding install{ "mcpServers": { "source-first-clone": { "command": "npx", "args": ["-y", "web-embedding@latest", "mcp"] } }}npx web-embedding@latest mcphttps://webembedding-jongkos-mcp.vercel.app/mcp/plugin marketplace add jongko54/webEmbedding/plugin install source-first-clone@webembeddingcurl -fsSL https://github.com/jongko54/webEmbedding/releases/latest/download/install.sh | bashgit clone https://github.com/jongko54/webEmbedding.gitcd webEmbeddingnpm installnode ./bin/web-embedding.mjs installnode ./bin/web-embedding.mjs doctorpython3 python/web_embedding/installer.py install --target-home ./.tmp/homepython3 python/web_embedding/installer.py doctor --target-home ./.tmp/homepython3 python/web_embedding/installer.py uninstall --target-home ./.tmp/homeweb-embedding install --telemetry --telemetry-endpoint https://your-collector.example/eventsweb-embedding telemetry enable --endpoint https://your-collector.example/eventsweb-embedding telemetry statusweb-embedding telemetry disableweb-embedding telemetry reset-idWEB_EMBEDDING_TELEMETRY=1WEB_EMBEDDING_NO_TELEMETRY=1WEB_EMBEDDING_TELEMETRY_PROMPT=0WEB_EMBEDDING_TELEMETRY_ENDPOINT=https://your-collector.example/eventsWEB_EMBEDDING_TELEMETRY_LOG=./telemetry.jsonlnpm run telemetry:collector -- --host 127.0.0.1 --port 8765 --out ./telemetry.jsonlWEB_EMBEDDING_TELEMETRY=1 \WEB_EMBEDDING_TELEMETRY_ENDPOINT=http://127.0.0.1:8765/events \web-embedding doctornpm run telemetry:summarize -- ./telemetry.jsonlnode ./bin/web-embedding.mjs inspect \ --url https://developer.mozilla.org/en-US/node ./bin/web-embedding.mjs audit \ --url https://developer.mozilla.org/en-US/node ./bin/web-embedding.mjs clone \ --url https://developer.mozilla.org/en-US/ \ --output-dir ./.tmp/mdn-clone \ --wait-seconds 2 \ --timeout-seconds 35 \ --breakpoints mobile tabletpython3 scripts/check_clone_quality_bench.py \ https://developer.mozilla.org/en-US/ \ --output-root ./.tmp/clone-quality-bench \ --wait-seconds 1 \ --timeout-seconds 35 \ --breakpoints mobile tabletnode ./bin/web-embedding.mjs capabilitiesnode ./bin/web-embedding.mjs installnode ./bin/web-embedding.mjs doctornode ./bin/web-embedding.mjs uninstallnode ./bin/web-embedding.mjs pathsnode ./bin/web-embedding.mjs telemetry statusnode ./bin/web-embedding.mjs inspect --url https://www.mozilla.org/node ./bin/web-embedding.mjs audit --url https://www.mozilla.org/node ./bin/web-embedding.mjs capture \ --url https://www.mozilla.org/ \ --output-dir ./.tmp/capture-mozilla \ --breakpoints mobile tabletnode ./bin/web-embedding.mjs reproduce \ --url https://www.mozilla.org/ \ --output-dir ./.tmp/reproduce-mozilla \ --breakpoints mobile tabletnode ./bin/web-embedding.mjs clone \ --url https://www.mozilla.org/ \ --output-dir ./.tmp/clone-mozilla \ --breakpoints mobile tabletnode ./bin/web-embedding.mjs verify \ --reference-bundle ./.tmp/reference/capture.json \ --candidate-bundle ./.tmp/candidate/capture.jsonnpm run check:clone-bench:localnpm run check:benchmark-routes:localnpm run check:clone-score-gate:localnpm run check:benchmark-evidence:localnpm run check:production-readiness:localnpm run check:job-queue:localnpm run check:har-replay:localnpm run check:authenticated-corpus:localnpm run classify:pipeline-failures -- --report ./.tmp/universal-route-benchmark/universal-route-report.jsonnpm run summarize:benchmark-scores -- --root ./.tmp --min-score 60 --max-score 70python3 scripts/check_clone_quality_bench.py \ https://www.example.com \ https://www.mozilla.org/ \ --no-breakpointspython3 scripts/check_clone_quality_bench.py \ https://developer.mozilla.org/en-US/ \ --breakpoints mobile tabletpython3 -m py_compile \ bundle/source-first-clone/mcp/source_first_clone/*.py \ scripts/check_integration_smoke.py \ scripts/check_clone_quality_bench.pynpm run check:integration:localgit diff --check