
Openshorts
io.github.mutonby由 GitHub 账号 mutonby 发布v1.0.0更新于 Oct 24, 2026
Turn long videos into viral vertical shorts and publish them to TikTok, Instagram and YouTube.
概览
OpenShorts 把长视频剪成竖屏短片并发布到 TikTok、Instagram 和 YouTube,可通过托管 MCP 端点由 AI 助手驱动。
- 可以做什么
- 通过链接或上传提交视频并启动剪辑任务
- 查询任务状态、列出生成的片段并查看剩余额度
- 为片段添加字幕、重新剪辑已有片段
- 将片段发布或定时发布到 TikTok、Instagram Reels 和 YouTube Shorts
- 适用场景
- 适合让助手把播客、网络研讨会或直播剪成 9:16 短片并推送到社交平台,无需打开网页控制台。也适合批量制作短视频的内容团队和营销机构。
- 运行要求
- 远程 MCP 端点 mcp.openshorts.app,使用 streamable HTTP。托管版需要 OpenShorts 账号,并通过 OAuth 授权或使用以 Authorization 请求头传递的 osk_ API 密钥。自托管实例在本地提供同一端点且无需密钥,但需要 Docker 以及自己的 Gemini、fal.ai、ElevenLabs 和 Upload-Post 密钥。
安装
在 SourceWeft 中
- 打开 控制台中的 Openshorts,将其添加到工作区。
- 连接 所需的 凭据。它们会被私密存储,绝不会在公开页面上展示。
- 为需要使用其工具的对话启用该服务。
Web executable,通过 Streamable HTTP。 远程服务在工作区中配置后即可从网页运行时运行。
交给智能体安装
把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体,或 SourceWeft 对话中。智能体会读取该服务器的安装指南,先向你展示发布者、端点和登录方式,经你同意后再把它添加到你的客户端。密钥不会写进任何命令。
阅读 https://sourceweft.com/mcp/io.github.mutonby%2Fopenshorts/install.md,并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前,先告诉我它的发布者、端点和登录方式,等我确认。不要把 API 密钥写进命令或我会提交的文件;问我密钥应从哪里获取。其他 MCP 客户端
把它添加到你客户端的 mcpServers 配置中。 客户端会在首次连接时完成 OAuth 登录。
{
"mcpServers": {
"openshorts": {
"type": "http",
"url": "https://mcp.openshorts.app/mcp"
}
}
}README
OpenShorts.app
The open-source OpusClip alternative. Turn long videos into viral 9:16 Shorts, TikToks and Reels. Self-host free (MIT) or use the hosted cloud.
[License: MIT] [Open Source] [PRs Welcome] [Docker] [GitHub stars] [Last Commit]
Open source AI video platform with 3 tools in one: Clip Generator, AI Shorts (UGC videos with AI actors), and YouTube Studio.
Real OpenShorts output, not a mock-up. Source: Turn the Tables with Dan and Shoshana Jordan, Heritage of Faith, licensed CC BY.
Two people on camera? OpenShorts stacks them instead of shrinking the wide shot, puts the captions on the seam where they cover nobody, and switches back to a face-tracked crop when the cut goes to one person. The AI picks the layout per video; nothing to configure.
Cloud version: don't want to run it yourself? OpenShorts Cloud is the same software on a GPU. Free plan: your first video is clipped whole up to 60 minutes, then 20 minutes a month, with a watermark and no credit card. Paid plans from $12/mo remove the watermark and add auto-posting and Autopilot (below).
Two ways to run it, same software either way:
Self-hosting is genuinely free and always will be. It costs you a machine, your own API keys and the time to keep it running. The hosted plans exist to cover that hardware and those keys.
Compared to Opus Clip, Klap, Vizard (public pricing pages, checked October 2026; full breakdown at openshorts.app/alternatives):
Video: the story behind OpenShorts Cloud
[Launching the paid plan of an open source app]
In Spanish. Click the image to watch on YouTube.
What's Inside
1. Clip Generator
Paste a YouTube link or upload a file. OpenShorts finds the strongest moments of a podcast, webinar, stream or interview and returns finished 9:16 clips: reframed, captioned, with a hook line, a virality score and titles for each platform.
[A clip with its viral score, titles and edit actions]
Every clip opens in a real editor: source and program monitors side by side with the full transcript. Click a word to set a cut, add segments, change the framing and re-render in seconds.
[The clip editor with source monitor, program monitor, transcript and segments]
2. Autopilot (Cloud)
Connect your YouTube channel and publish as usual. Every new video is clipped on its own, you get an email when the clips are ready, and with autopublish on the best ones go out to your socials (TikTok, Instagram, YouTube, Facebook, LinkedIn, Threads and Bluesky), one a day at the hour you pick. Paid plans only.
3. AI Shorts (UGC Video Creator)
Generate marketing videos with AI actors for any product or business. No camera, no studio, no influencer budget. Describe your product or paste a URL.
[The UGC gallery with AI actor videos]
- Two cost modes: Low Cost (
$0.65/video) and Premium ($2/video) - AI actors with lip-sync, voiceover, b-roll and TikTok-style subtitles
- Pick an avatar from the shared gallery or upload your own photo
- Every video lands in the public gallery (openshorts.app/gallery) with its own SEO page
4. YouTube Studio
AI titles (10 options with a refinement chat), thumbnails with your face over a background, descriptions with chapter timestamps, and one-click publishing to YouTube.
5. Inside Claude and ChatGPT
Add OpenShorts to Claude or ChatGPT with one URL and ask for clips in plain language: same pipeline, same minutes, no API key to manage. See Automate it.
[Connecting OpenShorts to an AI agent]
Key Features
Clip Generator
- Viral Moment Detection: Google Gemini 3.1 Flash-Lite ranks the transcript and scene boundaries to pick 3-15 moments of 15-60 seconds, each with a virality score
- Runs fully local if you want: point
LLM_BASE_URLat Ollama, LM Studio, vLLM or any OpenAI-compatible server and the moment picker runs on your own model, no Google key needed (see Run without a Google key) - Smart 9:16 Reframing: per scene: TRACK (MediaPipe + YOLOv8 face tracking), GENERAL (blurred background), SPLIT (two speakers stacked, captions on the seam) and SCREENCAST (screen over presenter); the layout is picked per video by Gemini or forced from the dashboard
- Captions: faster-whisper (or Parakeet on GPU) with word-level timestamps, several caption styles, burned into the clip
- Clip editor: word-level cuts, extra segments, framing changes and fast re-renders
- Hook overlays: an opening line written from what is said in the clip, editable in text, style, font and position
- AI Voice Dubbing: ElevenLabs, 30+ languages with voice cloning (bring your own ElevenLabs key, on the Cloud too)
- AI Video Effects: Gemini-generated FFmpeg filters
Social Auto-Publishing (via Upload-Post)
- Post a clip to TikTok, Instagram, YouTube, Facebook, LinkedIn, Threads and Bluesky at once, or schedule it for any date and time
- Schedule a week: spread a batch of clips across the coming days in one go
- Post analytics: views of the clips you published from OpenShorts, in the app
- On the Cloud it is wired up on every paid plan; self-hosted, paste your own Upload-Post key
- Only want to post videos you already have, without clipping? Use Upload-Post directly: TikTok, Instagram, YouTube, LinkedIn, Facebook, X, Threads, Pinterest, Bluesky and more, with a free plan, a REST API and an MCP server
AI Shorts Pipeline
- Analyze: Scrape website URL + web research, or generate from manual description
- Script: AI writes viral scripts (hook - problem - solution - CTA format)
- Actor: Generate AI actors with Flux 2 Pro or select from shared gallery
- Voice: ElevenLabs TTS voiceover (English/Spanish, male/female)
- Video: Talking head generation (Hailuo 2.3 Fast img2video + VEED Lipsync, or Kling Avatar v2 in Premium)
- B-roll: AI-generated visuals with Ken Burns effect
- Composite: FFmpeg final assembly with subtitles and hook overlays
- Publish: Direct posting to TikTok, Instagram Reels, YouTube Shorts via Upload-Post
Infrastructure
- S3-compatible storage for clip backup and the public gallery
- SEO gallery pages served by FastAPI with JSON-LD structured data
- Async job queue with configurable concurrency, and optional NVIDIA GPU rendering (NVENC)
Who Is This For?
- Content creators — Turn long videos into shorts automatically, publish to all platforms at once, or let Autopilot do it for every new upload
- Marketing agencies — Generate UGC videos for clients at scale, no actors or studios needed
- SaaS founders — Create product demos and marketing shorts from just a URL
- E-commerce brands — Product videos with AI actors for TikTok Shop, Instagram, YouTube
- Local businesses — Restaurants, gyms, real estate, coaching — affordable video marketing
- Developers — Self-host, customize the pipeline, integrate via API
AI Shorts Showcase
Videos generated with OpenShorts AI Shorts — no camera, no studio, no actors:
Browse all videos at openshorts.app/gallery
OpenShorts vs Competitors
How Much Does It Cost?
Self-hosting OpenShorts is free. You provide the machine and you only pay for the AI APIs you use, and most have generous free tiers:
Bottom line: You can clip videos for practically free with Gemini, and publish 10 videos/month to all social networks at zero cost with Upload-Post.
Don't want to run any of that? openshorts.app is the same software on our hardware: our NVIDIA GPU clips an 8-minute video in about 50 seconds instead of the 5 to 8 minutes it takes on a typical CPU, the Gemini key is included, and paid plans add auto-posting and Autopilot with nothing to set up. The free plan clips your first video whole up to 60 minutes, then 20 minutes a month, with a watermark and no credit card; paid plans start at $12/mo for 100 minutes without watermark.
Requirements
- Docker & Docker Compose
- Google Gemini API Key (Free — get it here) — required for all AI features
- fal.ai API Key (Pay-per-use) — required for AI Shorts (actor generation, video, lip-sync)
- ElevenLabs API Key (Free tier) — required for voiceover/dubbing
- Upload-Post API Key (free tier) — required for direct social posting
Getting Started
1. Clone
2. Configure (optional)
3. Launch
4. Open Dashboard
Navigate to http://localhost:5175
- Go to Settings and enter your API keys (Gemini, fal.ai, ElevenLabs, Upload-Post)
- Clip Generator: Upload a long-form video to generate viral shorts
- AI Shorts: Describe your product or paste a URL to generate UGC marketing videos
- YouTube Studio: Generate thumbnails, titles, and descriptions for YouTube
- UGC Gallery: Browse all generated videos and avatars
- AI Agent: Drop vertical videos in a folder and an agent skill picks, edits and queues clips for your approval
5. GPU acceleration (optional, NVIDIA)
The default image is CPU-only. With an NVIDIA card (any card with NVENC, e.g. RTX 4060) an 8-minute video clips in about a minute instead of 5 to 8. Nothing is passed through in the VM sense — the container just gets access to the host GPU.
Host: install the NVIDIA driver (nvidia-smi must work) and the NVIDIA Container Toolkit:
On Windows use Docker Desktop with the WSL2 backend and the Windows NVIDIA driver; no driver inside WSL.
Compose: create docker-compose.override.yml next to docker-compose.yml (picked up automatically). GPU: "1" adds cuBLAS/cuDNN and onnxruntime-gpu to the image (~2 GB); video is required for NVENC.
.env:
Verify:
The backend log on the first job reports the chosen encoder and transcription device. A CUDA error in whisper (e.g. VRAM exhausted) retries once on CPU automatically. 8 GB of VRAM is enough for large-v3-turbo fp16 plus the detection models.
6. Run without a Google key (local LLM, optional)
The only cloud call in the clip pipeline is the moment picker: it sends the transcript (never the video) to Gemini. Point it at any OpenAI-compatible server instead and the whole pipeline stays on your box:
Works with Ollama, LM Studio, vLLM, llama.cpp server, LocalAI and OpenRouter. The dashboard stops asking for a Gemini key when this is set. Two things to know:
- Context length. A scoring call carries three transcript windows
(~2-3k tokens) and the detail call up to ten (~5k on a long podcast).
Ollama defaults to a 4096-token context and truncates silently, so run it
with
OLLAMA_CONTEXT_LENGTH=16384(or setnum_ctxin a Modelfile); raiseLLM_SCORE_BATCHabove 3 only if your context allows it. 7-8B models return valid JSON reliably, 3B ones do not. - What still needs Gemini. Anything that has to look at frames: the
automatic layout picker (
AUTO_LAYOUT), the on-screen content detector and silent videos (no speech to clip by). Without a Gemini key those fall back to the plain face-tracking crop, and a silent video fails with a message that says so. Add a key alongsideLLM_BASE_URLand you get both.
Technical Pipeline
Clip Generator
- Ingest — YouTube URL (yt-dlp) or local upload
- Transcribe — faster-whisper (or Parakeet on GPU) with word-level timestamps
- Detect — PySceneDetect for scene boundaries
- Analyze — Gemini identifies 3-15 viral moments (15-60s each)
- Extract — FFmpeg precise clip cutting
- Reframe — AI vertical cropping with subject tracking
- Effects — Subtitles, hooks, AI video effects
- Publish — S3 backup + Upload-Post social distribution
AI Shorts
- Analyze — Website scraping + Gemini web research (or manual description)
- Script — Gemini generates viral scripts with segments
- Actor — Flux 2 Pro portrait generation (or gallery/upload)
- Voice — ElevenLabs TTS voiceover
- Video — Hailuo 2.3 Fast img2video + VEED Lipsync (Low Cost) or Kling Avatar v2 (Premium)
- B-roll — Flux 2 Pro image generation + Ken Burns effect
- Composite — FFmpeg assembly with ASS subtitles and hook overlays
- Gallery — Upload to public S3 with metadata for SEO pages
- Publish — Upload-Post to TikTok, Instagram, YouTube
Automate It: MCP Server, REST API and Webhooks
You don't need the dashboard. The whole pipeline is callable by AI agents and scripts.
MCP server (/mcp)
OpenShorts ships a built-in MCP server, so Claude, ChatGPT, Cursor or any MCP client can clip and publish videos for you:
claude.ai and ChatGPT: paste https://mcp.openshorts.app/mcp as a custom connector (Settings → Connectors) and approve the access on openshorts.app. The server does OAuth 2.1 with dynamic client registration, so there is no key to copy; the connection shows up under Account → API keys, where revoking it disconnects the app.
Tools: process_video (URL or upload_id; captions: false when the source already has subtitles, auto_hook: false to skip the hook line, burned by default like the dashboard), create_upload (hand the agent a local file: PUT the bytes, then process), get_job_status, list_clips, get_quota, add_subtitles, recut_clip, publish_clip. A prompt like "clip this podcast and schedule the best 3 to TikTok" is now a one-liner in your agent of choice.
REST API + API keys
Hosted accounts can mint osk_... API keys (account page). A key authenticates as you everywhere — same plan, same minutes, same job ownership:
Interactive docs at /docs (OpenAPI) on any instance.
Completion webhooks
Pass webhook_url (and optionally webhook_secret) to POST /api/process and you get exactly one POST when the job reaches a terminal state — no polling loops in your n8n / Zapier / cron pipelines:
With a secret, the body is signed: X-OpenShorts-Signature: sha256=<hmac-sha256(body)>.
CLI
The same API from the terminal, zero dependencies (cli/):
Agent skill
skills/openshorts/SKILL.md follows the open
Agent Skills standard, so it works in any
skill-capable agent:
n8n
An importable workflow (video URL in, published-ready clips out, no polling)
lives in examples/n8n/.
Tech Stack
Environment Variables
Server-side (.env):
Client-side (encrypted in localStorage):
Security & Performance
- Non-Root Execution: Containers run as dedicated
appuser - Concurrency Control: Semaphore-based job queue (
MAX_CONCURRENT_JOBS) - Auto-Cleanup: Old jobs are purged automatically (24h by default when self-hosted,
JOB_RETENTION_SECONDS) - Encrypted Keys: API keys encrypted client-side, never stored server-side
- Upload Validation: Image uploads validated for format and minimum size
- File Limits: 2GB upload limit protection
Social Media Setup (Upload-Post)
- Register: app.upload-post.com/login
- Create Profile: Go to Manage Users
- Connect Accounts: Link TikTok, Instagram, and/or YouTube
- Get API Key: Navigate to API Keys
- Use in OpenShorts: Paste the key in Settings
On OpenShorts Cloud none of this is needed: paid plans connect your socials from the app.
Star History
Contributions
Contributions are welcome! Whether it's adding new AI models, improving the lip-sync pipeline, or building new features — feel free to open a PR.
License
MIT License for the core application — OpenShorts is yours to use, modify, and scale.
Exception: the cloud/ directory (billing, managed keys, and the hosted-service infrastructure behind the optional BILLING_ENABLED flag) is source-available under the OpenShorts Commercial License. You can read it, modify it, and self-host it for personal or internal use, but you can't offer it to third parties as a paid/hosted service. Self-hosting the core app never requires this directory.
来源:README.md,提交 77340df
工具
0版本历史
1- v1.0.0最新Sep 16, 2026
评分
已满足适用检查项的 85%
该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。
- 近 30 天内可连通必需25 分
- 已声明认证方式必需10 分
- 已列出工具15 分
请让服务器在无凭据时响应 tools/list,或发布可在沙箱中无凭据启动的软件包。
- 描述必需15 分
- 图标10 分
- 文档15 分
- 许可证10 分