
Openshorts
io.github.mutonby由 GitHub 帳號 mutonby 發布v1.0.0更新於 Oct 24, 2026
Turn long videos into viral vertical shorts and publish them to TikTok, Instagram and YouTube.
概覽
OpenShorts 把長影片剪成直式短影音並發佈到 TikTok、Instagram 和 YouTube,可透過託管 MCP 端點由 AI 助理操作。
- 可以做什麼
- 透過連結或上傳提交影片並啟動剪輯工作
- 查詢工作狀態、列出產生的片段並查看剩餘額度
- 為片段加上字幕、重新剪輯既有片段
- 將片段發佈或排程發佈到 TikTok、Instagram Reels 和 YouTube Shorts
- 適用情境
- 適合讓助理把播客、線上研討會或直播剪成 9:16 短影音並推送到社群平台,不必開啟網頁後台。也適合大量製作短影音的內容團隊與行銷代理商。
- 執行需求
- 遠端 MCP 端點 mcp.openshorts.app,使用 streamable HTTP。託管版需要 OpenShorts 帳號,並透過 OAuth 授權或以 Authorization 標頭傳送的 osk_ API 金鑰。自架執行個體在本機提供相同端點且不需金鑰,但需要 Docker 以及自己的 Gemini、fal.ai、ElevenLabs 和 Upload-Post 金鑰。
安裝
在 SourceWeft 中
- 開啟 儀表板中的 Openshorts,將其新增到工作區。
- 連接 所需的 憑證。它們會被私密儲存,絕不會在公開頁面上展示。
- 為需要使用其工具的對話啟用該服務。
Web executable,透過 Streamable HTTP。 遠端服務在工作區中設定後即可從網頁執行環境執行。
交給代理程式安裝
把這段提示詞貼上到 Claude Code、Codex、Cursor 等代理程式,或 SourceWeft 對話中。代理程式會讀取該伺服器的安裝指南,先向你展示發布者、端點和登入方式,經你同意後再把它新增到你的客戶端。金鑰不會寫進任何命令。
閱讀 https://sourceweft.com/mcp/io.github.mutonby%2Fopenshorts/install.md,並按其中說明把這個 MCP 伺服器接入我的客戶端。修改任何設定之前,先告訴我它的發布者、端點和登入方式,等我確認。不要把 API 金鑰寫進命令或我會提交的檔案;問我金鑰應從哪裡取得。其他 MCP 客戶端
把它新增到你客戶端的 mcpServers 設定中。 客戶端會在首次連接時完成 OAuth 登入。
{
"mcpServers": {
"openshorts": {
"type": "http",
"url": "https://mcp.openshorts.app/mcp"
}
}
}README
OpenShorts.app
The open-source OpusClip alternative. Turn long videos into viral 9:16 Shorts, TikToks and Reels. Self-host free (MIT) or use the hosted cloud.
[License: MIT] [Open Source] [PRs Welcome] [Docker] [GitHub stars] [Last Commit]
Open source AI video platform with 3 tools in one: Clip Generator, AI Shorts (UGC videos with AI actors), and YouTube Studio.
Real OpenShorts output, not a mock-up. Source: Turn the Tables with Dan and Shoshana Jordan, Heritage of Faith, licensed CC BY.
Two people on camera? OpenShorts stacks them instead of shrinking the wide shot, puts the captions on the seam where they cover nobody, and switches back to a face-tracked crop when the cut goes to one person. The AI picks the layout per video; nothing to configure.
Cloud version: don't want to run it yourself? OpenShorts Cloud is the same software on a GPU. Free plan: your first video is clipped whole up to 60 minutes, then 20 minutes a month, with a watermark and no credit card. Paid plans from $12/mo remove the watermark and add auto-posting and Autopilot (below).
Two ways to run it, same software either way:
Self-hosting is genuinely free and always will be. It costs you a machine, your own API keys and the time to keep it running. The hosted plans exist to cover that hardware and those keys.
Compared to Opus Clip, Klap, Vizard (public pricing pages, checked October 2026; full breakdown at openshorts.app/alternatives):
Video: the story behind OpenShorts Cloud
[Launching the paid plan of an open source app]
In Spanish. Click the image to watch on YouTube.
What's Inside
1. Clip Generator
Paste a YouTube link or upload a file. OpenShorts finds the strongest moments of a podcast, webinar, stream or interview and returns finished 9:16 clips: reframed, captioned, with a hook line, a virality score and titles for each platform.
[A clip with its viral score, titles and edit actions]
Every clip opens in a real editor: source and program monitors side by side with the full transcript. Click a word to set a cut, add segments, change the framing and re-render in seconds.
[The clip editor with source monitor, program monitor, transcript and segments]
2. Autopilot (Cloud)
Connect your YouTube channel and publish as usual. Every new video is clipped on its own, you get an email when the clips are ready, and with autopublish on the best ones go out to your socials (TikTok, Instagram, YouTube, Facebook, LinkedIn, Threads and Bluesky), one a day at the hour you pick. Paid plans only.
3. AI Shorts (UGC Video Creator)
Generate marketing videos with AI actors for any product or business. No camera, no studio, no influencer budget. Describe your product or paste a URL.
[The UGC gallery with AI actor videos]
- Two cost modes: Low Cost (
$0.65/video) and Premium ($2/video) - AI actors with lip-sync, voiceover, b-roll and TikTok-style subtitles
- Pick an avatar from the shared gallery or upload your own photo
- Every video lands in the public gallery (openshorts.app/gallery) with its own SEO page
4. YouTube Studio
AI titles (10 options with a refinement chat), thumbnails with your face over a background, descriptions with chapter timestamps, and one-click publishing to YouTube.
5. Inside Claude and ChatGPT
Add OpenShorts to Claude or ChatGPT with one URL and ask for clips in plain language: same pipeline, same minutes, no API key to manage. See Automate it.
[Connecting OpenShorts to an AI agent]
Key Features
Clip Generator
- Viral Moment Detection: Google Gemini 3.1 Flash-Lite ranks the transcript and scene boundaries to pick 3-15 moments of 15-60 seconds, each with a virality score
- Runs fully local if you want: point
LLM_BASE_URLat Ollama, LM Studio, vLLM or any OpenAI-compatible server and the moment picker runs on your own model, no Google key needed (see Run without a Google key) - Smart 9:16 Reframing: per scene: TRACK (MediaPipe + YOLOv8 face tracking), GENERAL (blurred background), SPLIT (two speakers stacked, captions on the seam) and SCREENCAST (screen over presenter); the layout is picked per video by Gemini or forced from the dashboard
- Captions: faster-whisper (or Parakeet on GPU) with word-level timestamps, several caption styles, burned into the clip
- Clip editor: word-level cuts, extra segments, framing changes and fast re-renders
- Hook overlays: an opening line written from what is said in the clip, editable in text, style, font and position
- AI Voice Dubbing: ElevenLabs, 30+ languages with voice cloning (bring your own ElevenLabs key, on the Cloud too)
- AI Video Effects: Gemini-generated FFmpeg filters
Social Auto-Publishing (via Upload-Post)
- Post a clip to TikTok, Instagram, YouTube, Facebook, LinkedIn, Threads and Bluesky at once, or schedule it for any date and time
- Schedule a week: spread a batch of clips across the coming days in one go
- Post analytics: views of the clips you published from OpenShorts, in the app
- On the Cloud it is wired up on every paid plan; self-hosted, paste your own Upload-Post key
- Only want to post videos you already have, without clipping? Use Upload-Post directly: TikTok, Instagram, YouTube, LinkedIn, Facebook, X, Threads, Pinterest, Bluesky and more, with a free plan, a REST API and an MCP server
AI Shorts Pipeline
- Analyze: Scrape website URL + web research, or generate from manual description
- Script: AI writes viral scripts (hook - problem - solution - CTA format)
- Actor: Generate AI actors with Flux 2 Pro or select from shared gallery
- Voice: ElevenLabs TTS voiceover (English/Spanish, male/female)
- Video: Talking head generation (Hailuo 2.3 Fast img2video + VEED Lipsync, or Kling Avatar v2 in Premium)
- B-roll: AI-generated visuals with Ken Burns effect
- Composite: FFmpeg final assembly with subtitles and hook overlays
- Publish: Direct posting to TikTok, Instagram Reels, YouTube Shorts via Upload-Post
Infrastructure
- S3-compatible storage for clip backup and the public gallery
- SEO gallery pages served by FastAPI with JSON-LD structured data
- Async job queue with configurable concurrency, and optional NVIDIA GPU rendering (NVENC)
Who Is This For?
- Content creators — Turn long videos into shorts automatically, publish to all platforms at once, or let Autopilot do it for every new upload
- Marketing agencies — Generate UGC videos for clients at scale, no actors or studios needed
- SaaS founders — Create product demos and marketing shorts from just a URL
- E-commerce brands — Product videos with AI actors for TikTok Shop, Instagram, YouTube
- Local businesses — Restaurants, gyms, real estate, coaching — affordable video marketing
- Developers — Self-host, customize the pipeline, integrate via API
AI Shorts Showcase
Videos generated with OpenShorts AI Shorts — no camera, no studio, no actors:
Browse all videos at openshorts.app/gallery
OpenShorts vs Competitors
How Much Does It Cost?
Self-hosting OpenShorts is free. You provide the machine and you only pay for the AI APIs you use, and most have generous free tiers:
Bottom line: You can clip videos for practically free with Gemini, and publish 10 videos/month to all social networks at zero cost with Upload-Post.
Don't want to run any of that? openshorts.app is the same software on our hardware: our NVIDIA GPU clips an 8-minute video in about 50 seconds instead of the 5 to 8 minutes it takes on a typical CPU, the Gemini key is included, and paid plans add auto-posting and Autopilot with nothing to set up. The free plan clips your first video whole up to 60 minutes, then 20 minutes a month, with a watermark and no credit card; paid plans start at $12/mo for 100 minutes without watermark.
Requirements
- Docker & Docker Compose
- Google Gemini API Key (Free — get it here) — required for all AI features
- fal.ai API Key (Pay-per-use) — required for AI Shorts (actor generation, video, lip-sync)
- ElevenLabs API Key (Free tier) — required for voiceover/dubbing
- Upload-Post API Key (free tier) — required for direct social posting
Getting Started
1. Clone
2. Configure (optional)
3. Launch
4. Open Dashboard
Navigate to http://localhost:5175
- Go to Settings and enter your API keys (Gemini, fal.ai, ElevenLabs, Upload-Post)
- Clip Generator: Upload a long-form video to generate viral shorts
- AI Shorts: Describe your product or paste a URL to generate UGC marketing videos
- YouTube Studio: Generate thumbnails, titles, and descriptions for YouTube
- UGC Gallery: Browse all generated videos and avatars
- AI Agent: Drop vertical videos in a folder and an agent skill picks, edits and queues clips for your approval
5. GPU acceleration (optional, NVIDIA)
The default image is CPU-only. With an NVIDIA card (any card with NVENC, e.g. RTX 4060) an 8-minute video clips in about a minute instead of 5 to 8. Nothing is passed through in the VM sense — the container just gets access to the host GPU.
Host: install the NVIDIA driver (nvidia-smi must work) and the NVIDIA Container Toolkit:
On Windows use Docker Desktop with the WSL2 backend and the Windows NVIDIA driver; no driver inside WSL.
Compose: create docker-compose.override.yml next to docker-compose.yml (picked up automatically). GPU: "1" adds cuBLAS/cuDNN and onnxruntime-gpu to the image (~2 GB); video is required for NVENC.
.env:
Verify:
The backend log on the first job reports the chosen encoder and transcription device. A CUDA error in whisper (e.g. VRAM exhausted) retries once on CPU automatically. 8 GB of VRAM is enough for large-v3-turbo fp16 plus the detection models.
6. Run without a Google key (local LLM, optional)
The only cloud call in the clip pipeline is the moment picker: it sends the transcript (never the video) to Gemini. Point it at any OpenAI-compatible server instead and the whole pipeline stays on your box:
Works with Ollama, LM Studio, vLLM, llama.cpp server, LocalAI and OpenRouter. The dashboard stops asking for a Gemini key when this is set. Two things to know:
- Context length. A scoring call carries three transcript windows
(~2-3k tokens) and the detail call up to ten (~5k on a long podcast).
Ollama defaults to a 4096-token context and truncates silently, so run it
with
OLLAMA_CONTEXT_LENGTH=16384(or setnum_ctxin a Modelfile); raiseLLM_SCORE_BATCHabove 3 only if your context allows it. 7-8B models return valid JSON reliably, 3B ones do not. - What still needs Gemini. Anything that has to look at frames: the
automatic layout picker (
AUTO_LAYOUT), the on-screen content detector and silent videos (no speech to clip by). Without a Gemini key those fall back to the plain face-tracking crop, and a silent video fails with a message that says so. Add a key alongsideLLM_BASE_URLand you get both.
Technical Pipeline
Clip Generator
- Ingest — YouTube URL (yt-dlp) or local upload
- Transcribe — faster-whisper (or Parakeet on GPU) with word-level timestamps
- Detect — PySceneDetect for scene boundaries
- Analyze — Gemini identifies 3-15 viral moments (15-60s each)
- Extract — FFmpeg precise clip cutting
- Reframe — AI vertical cropping with subject tracking
- Effects — Subtitles, hooks, AI video effects
- Publish — S3 backup + Upload-Post social distribution
AI Shorts
- Analyze — Website scraping + Gemini web research (or manual description)
- Script — Gemini generates viral scripts with segments
- Actor — Flux 2 Pro portrait generation (or gallery/upload)
- Voice — ElevenLabs TTS voiceover
- Video — Hailuo 2.3 Fast img2video + VEED Lipsync (Low Cost) or Kling Avatar v2 (Premium)
- B-roll — Flux 2 Pro image generation + Ken Burns effect
- Composite — FFmpeg assembly with ASS subtitles and hook overlays
- Gallery — Upload to public S3 with metadata for SEO pages
- Publish — Upload-Post to TikTok, Instagram, YouTube
Automate It: MCP Server, REST API and Webhooks
You don't need the dashboard. The whole pipeline is callable by AI agents and scripts.
MCP server (/mcp)
OpenShorts ships a built-in MCP server, so Claude, ChatGPT, Cursor or any MCP client can clip and publish videos for you:
claude.ai and ChatGPT: paste https://mcp.openshorts.app/mcp as a custom connector (Settings → Connectors) and approve the access on openshorts.app. The server does OAuth 2.1 with dynamic client registration, so there is no key to copy; the connection shows up under Account → API keys, where revoking it disconnects the app.
Tools: process_video (URL or upload_id; captions: false when the source already has subtitles, auto_hook: false to skip the hook line, burned by default like the dashboard), create_upload (hand the agent a local file: PUT the bytes, then process), get_job_status, list_clips, get_quota, add_subtitles, recut_clip, publish_clip. A prompt like "clip this podcast and schedule the best 3 to TikTok" is now a one-liner in your agent of choice.
REST API + API keys
Hosted accounts can mint osk_... API keys (account page). A key authenticates as you everywhere — same plan, same minutes, same job ownership:
Interactive docs at /docs (OpenAPI) on any instance.
Completion webhooks
Pass webhook_url (and optionally webhook_secret) to POST /api/process and you get exactly one POST when the job reaches a terminal state — no polling loops in your n8n / Zapier / cron pipelines:
With a secret, the body is signed: X-OpenShorts-Signature: sha256=<hmac-sha256(body)>.
CLI
The same API from the terminal, zero dependencies (cli/):
Agent skill
skills/openshorts/SKILL.md follows the open
Agent Skills standard, so it works in any
skill-capable agent:
n8n
An importable workflow (video URL in, published-ready clips out, no polling)
lives in examples/n8n/.
Tech Stack
Environment Variables
Server-side (.env):
Client-side (encrypted in localStorage):
Security & Performance
- Non-Root Execution: Containers run as dedicated
appuser - Concurrency Control: Semaphore-based job queue (
MAX_CONCURRENT_JOBS) - Auto-Cleanup: Old jobs are purged automatically (24h by default when self-hosted,
JOB_RETENTION_SECONDS) - Encrypted Keys: API keys encrypted client-side, never stored server-side
- Upload Validation: Image uploads validated for format and minimum size
- File Limits: 2GB upload limit protection
Social Media Setup (Upload-Post)
- Register: app.upload-post.com/login
- Create Profile: Go to Manage Users
- Connect Accounts: Link TikTok, Instagram, and/or YouTube
- Get API Key: Navigate to API Keys
- Use in OpenShorts: Paste the key in Settings
On OpenShorts Cloud none of this is needed: paid plans connect your socials from the app.
Star History
Contributions
Contributions are welcome! Whether it's adding new AI models, improving the lip-sync pipeline, or building new features — feel free to open a PR.
License
MIT License for the core application — OpenShorts is yours to use, modify, and scale.
Exception: the cloud/ directory (billing, managed keys, and the hosted-service infrastructure behind the optional BILLING_ENABLED flag) is source-available under the OpenShorts Commercial License. You can read it, modify it, and self-host it for personal or internal use, but you can't offer it to third parties as a paid/hosted service. Self-hosting the core app never requires this directory.
來源:README.md,提交 77340df
工具
0版本歷史
1- v1.0.0最新Sep 16, 2026
評分
已滿足適用檢查項的 85%
該評分衡量此收錄條目的完整程度,依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價,也不表示伺服器安全或目前可用:可連通性是帶日期的檢查結果,評分也不包含安裝量或使用者評價。
- 近 30 天內可連通必需25 分
- 已宣告認證方式必需10 分
- 已列出工具15 分
請讓伺服器在無憑證時回應 tools/list,或發布可在沙箱中無憑證啟動的軟體包。
- 描述必需15 分
- 圖示10 分
- 文件15 分
- 授權條款10 分