Media Context Mcp

io.github.vishalguptax由 GitHub 帳號 vishalguptax 發布v0.1.4更新於 Oct 24, 2026

Local MCP server to analyze video, audio & images: frames, transcripts, on-screen text.

已驗證STDIO僅桌面檔案與儲存媒體與設計

概覽

AI 產生的概覽

本機 MCP 伺服器，把影片、音訊和圖片（檔案或連結）轉成模型可讀的上下文：取樣影格、逐字稿和畫面文字。

可以做什麼
  • 分析本機路徑或 http(s) 連結的影片、音訊和圖片，並自動辨識類型
  • 以聯絡表、單張靜態影格、場景切換影格或密集膠片條方式取樣影片影格，支援裁切、時間範圍和影格數上限
  • 對音訊或影片進行語音轉錄，可選擇 Whisper 模型大小
  • 以 OCR 擷取畫面文字，可設定語言和頁面分割方式
  • 追蹤畫面中的數字並回報附時間戳的回跳異常
  • 檢查本機已安裝且可用的輔助相依項目
適用情境
適合讓助理摘要螢幕錄影、讀出影片或截圖中顯示的錯誤、說明介面操作流程、轉錄會議或語音備忘，或從 YouTube、Vimeo 等連結取得內容而不必上傳媒體檔案。
執行需求
以本機程序透過 npx 啟動，需要 Node.js 18+，支援 Windows、macOS 或 Linux。需執行一次安裝指令來安裝本機輔助工具（取樣影格、連結抓取、OCR；語音轉錄為選用）。未宣告任何 API 金鑰或環境變數。
安裝前請注意
安裝指令會透過作業系統套件管理員安裝輔助軟體，請留意其安裝內容，並可用卸載選項移除。來自連結的媒體會下載到本機，受時長和檔案大小上限限制。分析在本機進行，README 稱不會上傳，但產生的影格和逐字稿會交給助理所用的模型。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 Media Context Mcp，將其新增到工作區。
  2. 為需要使用其工具的對話啟用該服務。

Desktop only，透過 STDIO。 STDIO 服務會啟動本機處理程序，因此需要 SourceWeft 桌面主機。

其他 MCP 客戶端

參照 儲存庫 中的啟動說明。

README

[media-context-mcp — local media analysis for AI assistants]

[npm version] [npm downloads] [license] [node]

Give your AI assistant eyes and ears.
Analyze any video, audio, or image — locally, right inside your editor.

Install  ·  Capabilities  ·  Modes  ·  Examples  ·  Tools  ·  Options  ·  Docs


LLMs read text and glance at a single image — but they can't watch a video or listen to audio. media-context-mcp closes that gap. Hand it a file or a link and it returns clean, model-ready context — keyframes, a transcript, or the text on screen — entirely on your machine. Nothing is uploaded.

[A 10-second clip turned into one contact sheet of keyframes]

A 10-second clip becomes one tidy contact sheet your model reads in order — not hundreds of stills.


🚀 Install

Two steps — add the server, then install the local helpers it uses.

1 · Add the server to your client

bash
# Claude Codeclaude mcp add media-context -- npx -y media-context-mcp

The launch command is always npx -y media-context-mcp. Pick your client:

Claude Desktop

Settings → Developer → Edit Config (claude_desktop_config.json):

json
{  "mcpServers": {    "media-context": { "command": "npx", "args": ["-y", "media-context-mcp"] }  }}
Cursor

~/.cursor/mcp.json (global) or .cursor/mcp.json (per-project):

json
{  "mcpServers": {    "media-context": { "command": "npx", "args": ["-y", "media-context-mcp"] }  }}
VS Code (GitHub Copilot, agent mode)

.vscode/mcp.json — VS Code uses the servers key:

json
{  "servers": {    "media-context": { "command": "npx", "args": ["-y", "media-context-mcp"] }  }}
Windsurf

~/.codeium/windsurf/mcp_config.json:

json
{  "mcpServers": {    "media-context": { "command": "npx", "args": ["-y", "media-context-mcp"] }  }}
Cline / Roo Code

cline_mcp_settings.json (the extension's MCP settings):

json
{  "mcpServers": {    "media-context": { "command": "npx", "args": ["-y", "media-context-mcp"] }  }}
Kiro

.kiro/settings/mcp.json (project) or ~/.kiro/settings/mcp.json (user):

json
{  "mcpServers": {    "media-context": { "command": "npx", "args": ["-y", "media-context-mcp"] }  }}
Gemini CLI

~/.gemini/settings.json:

json
{  "mcpServers": {    "media-context": { "command": "npx", "args": ["-y", "media-context-mcp"] }  }}
Zed

settings.json — Zed uses context_servers:

json
{  "context_servers": {    "media-context": { "command": { "path": "npx", "args": ["-y", "media-context-mcp"] } }  }}
Codex CLI

~/.codex/config.toml:

toml
[mcp_servers.media-context]command = "npx"args = ["-y", "media-context-mcp"]
JetBrains AI Assistant

Settings → Tools → AI Assistant → Model Context Protocol → Add, then use command npx with args -y media-context-mcp.

Tip: in Claude Code you can install it as a plugin instead — run /plugin marketplace add vishalguptax/media-context-mcp, then /plugin install media-context. To share with a team, install per-project: --scope project (writes .mcp.json) or commit a .cursor/mcp.json in the repo.

2 · Install the local helpers

One command sets up everything the server uses, via your OS package manager:

bash
npx media-context-mcp setup          # core: keyframes, links, on-screen textnpx media-context-mcp setup --audio  # also enable transcription

The server finds the helpers automatically afterward — no extra configuration. Run check_media_deps to see what's ready, and setup --uninstall to remove them. (Install by hand →)

3 · Ask

“Summarize demo.mp4.”

✨ Capabilities

VideoKeyframe overview, full-size stills, scene detection, or a dense filmstrip that catches split-second glitches
AudioSpeech turned into text — clips, voice notes, meetings, podcasts
ImagesThe picture, plus the exact text shown on screen
AnywhereLocal files or links — YouTube, Vimeo, and 1000+ sites
PrivateRuns on your machine. No API keys, no uploads
EfficientA long clip becomes a couple of images, not hundreds

🎞️ Modes

analyze_media auto-detects audio and images. For video, choose how frames are sampled:

ModeBest for
sheet (default)A cheap overview — frames tiled into one or two contact sheets
framesDetail on specific moments — individual full-size stills
scenesSlide decks & static screencasts — only scene-change frames
filmstripCatching a sub-second UI glitch — a dense, near-native-rate strip

💬 Examples

Just ask in plain language — the assistant picks the right options.

You askWhat you get
“Summarize demo.mp4.”A quick overview from sampled keyframes
“What error does bug.mp4 show at the end?”The exact on-screen text, read back
“Walk me through the UI flow in onboarding.mov.”Step-by-step from scene-change frames
“Transcribe standup.m4a and list action items.”A local transcript
“Summarize https://youtu.be/… with the transcript.”Fetched and transcribed
“Read the error in this screenshot crash.png.”The picture plus its exact text
“Find where the slider in ui.mp4 flickers ~0:06.”The exact frame of a sub-second glitch

🧰 Tools

ToolWhat it does
analyze_mediaTurn a video, audio, or image — file or URL — into model-readable context. Auto-detects the type and supports cropping, time windows, language, and sampling rate.
check_media_depsReport which capabilities are ready on this machine.

Every call runs locally and cleans up after itself.

⚙️ Options

Your assistant fills these in for you, but you can steer it (“use filmstrip mode”, “crop to the toolbar”).

Full analyze_media parameters
ParamDefaultDescription
source—Local file path (video/audio/image) or http(s) URL
context—A note framing the analysis; echoed atop the summary
detail—high = readable stills for screen recordings; low = cheap overview
modesheetsheet · frames · scenes · filmstrip
formatwebpwebp (smallest) · jpeg · png (crisp text)
maxFrames30Upper bound on sampled frames
grid5Tiles per row/column for contact-sheet modes
scale320Per-frame width in px — lower = fewer tokens
sceneThreshold0.4Scene-change sensitivity (scenes mode)
fpsautoExplicit sampling rate; pair high with filmstrip
crop—{x,y,width,height} (pixels, or 0–1 fractions) to zoom a region
stripRows18Tiles per image in filmstrip mode
startSec / endSec—Restrict to a time window
transcriptfalseAlso produce a transcript (video)
whisperModelsmalltiny · base · small · medium · large
ocrfalseExtract on-screen text
ocrLangengLanguage code(s), e.g. eng+deu
ocrPsm3Page-segmentation: 3 auto · 6 block · 11 sparse
detectJumpsfalseTrack an on-screen number and report jump-back glitches with timestamps
maxDurationSec3600Reject URL downloads longer than this
maxFileSizeMb500Abort a URL download past this size

Worked recipes for each are in the usage guide.

❓ FAQ

Can an LLM watch a video? Not directly — models take images and text, not video. This server turns the video into frames and a transcript it can read.

Does anything get uploaded? No. Everything runs on your machine; no keys, no cloud.

Which clients work? Any MCP client — Claude Code, Claude Desktop, Cursor, VS Code, Windsurf, Cline, Kiro, Gemini CLI, JetBrains, Zed, Codex.

Does it handle YouTube and other links? Yes.

How much does it cost? It's free and open source.

📋 Requirements

Node.js 18+, on Windows, macOS, or Linux. The one-time npx media-context-mcp setup installs everything else.

🛠️ Development

bash
npm installnpm run buildnpm test

Issues and PRs welcome — see the usage guide for the architecture.

📄 License

Apache-2.0 © Vishal Gupta

來源：README.md，提交 2cc68be

工具

0
SourceWeft 尚未在沙箱中啟動過該軟體包，因此其工具未知。

版本歷史

1
  1. v0.1.4最新Sep 16, 2026

評分

已滿足適用檢查項的 50%

該評分衡量此收錄條目的完整程度，依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價，也不表示伺服器安全或目前可用：可連通性是帶日期的檢查結果，評分也不包含安裝量或使用者評價。

  • 近 30 天內可連通25 分

    請保持端點能夠回應 MCP 握手；SourceWeft 每 30 天探測一次。

  • 已宣告認證方式10 分

    請在註冊中心條目中宣告憑證請求標頭，或保持端點能夠回應探測，以便判定其認證方式。

  • 已列出工具15 分

    請讓伺服器在無憑證時回應 tools/list，或發布可在沙箱中無憑證啟動的軟體包。

  • 描述必需15 分
  • 圖示10 分
  • 文件15 分
  • 授權條款10 分