
Livepilot
io.github.dreamrec由 GitHub 帳號 dreamrec 發布v1.10.4更新於 Oct 25, 2026
317-tool agentic MCP production system for Ableton Live 12 — device atlas, sample engine, composer
概覽
一個本機 MCP 伺服器,讓 AI 助理控制 Ableton Live 12——播放控制、音軌、片段、裝置、混音、取樣與編曲規劃。
- 可以做什麼
- 控制 Live 專案:播放控制、音軌、片段、MIDI 音符、場景、混音與編曲自動化,並提供復原與診斷工具。載入與編輯裝置和預設,可檢索涵蓋數千個 Ableton 裝置與鏈路的圖集。在 Ableton 資料庫、本機資料夾與 Splice 中搜尋並評分取樣,再規劃 warp、切片與效果流程。把文字提示轉成編曲方案或完整曲目,並執行分析、評估與混音評論工具。可選用 Max for Live 橋接讀取頻譜與深層裝置資料。
- 適用情境
- 適合在桌機使用 Ableton Live 12 製作音樂、並希望助理以自然語言建立、編輯、混音或分析專案,或規劃編曲與取樣流程而不必手動點選 DAW 的使用者。
- 執行需求
- 以本機程序執行(npm 套件 livepilot),需要桌機環境並安裝 Ableton Live 12;伺服器透過 TCP 埠 9878 與 Live 內的遠端腳本通訊。可選的 Max for Live 橋接使用 UDP 9880 與 OSC 9881。Splice 功能需 Splice 桌面應用程式執行;不需 API 金鑰。
安裝
在 SourceWeft 中
- 開啟 儀表板中的 Livepilot,將其新增到工作區。
- 為需要使用其工具的對話啟用該服務。
Desktop only,透過 STDIO。 STDIO 服務會啟動本機處理程序,因此需要 SourceWeft 桌面主機。
其他 MCP 客戶端
參照 儲存庫 中的啟動說明。
README
[CI] [npm version] [npm downloads] [License] [Latest Release]
Make the change. Hear what happened. Keep what works.
LivePilot connects an AI client to Ableton Live 12. Sketch ideas, edit the set,
compare versions, and learn from the choices you keep.
474 tools · 57 domains · macOS + Windows
[!NOTE] LivePilot works with any MCP client, including Claude Code, Claude Desktop, Codex, Cursor, VS Code, and Windsurf. Changes inside the Live set use Ableton's undo stack. Downloads, saved memory, library scans, and installer changes happen outside the set and cannot be undone from Ableton.
[!WARNING] LivePilot is moving quickly. Pin a version for repeatable studio or live-performance setups, and check the changelog before updating.
Start Here
The setup wizard installs the Ableton Remote Script, creates the Python environment, copies the Max for Live Analyzer, and checks the connection:
Using Claude Desktop? Download the latest livepilot-<version>.mcpb from
Releases and double-click it.
See Install for client-specific setup and manual options.
What's New in v1.30.0
LivePilot now spends far less context describing itself and gives clearer answers about what it actually knows.
- A focused first contact. Normal sessions advertise 28 useful entry points instead of sending all 474 schemas up front. The rest remain searchable and directly callable.
- Options that mean something. Decorative Composer, Atlas, and routing parameters are gone; sample roles and material filters now change the result; unsupported abstract events fail with concrete guidance instead of disappearing silently.
- Evidence with a label. Mix and evaluation reports separate measured audio, setup-derived heuristics, and artistic judgment. “Less bright” and other reduction goals now score in the right direction.
- Depth when it earns its keep. Quick creative requests take a quick path. Three-way exploration, broad memory reads, and full critic passes are reserved for real ambiguity.
- More resilient sessions. Startup no longer waits on optional services, ambiguous network failures do not replay destructive edits, and project memory follows the Live set rather than ordinary edits inside it.
Previous release v1.29.0 introduced learned perceptual taste, honest confidence gates, optional CLAP distance, and named Arrangement locators.
Full details in the CHANGELOG.
What LivePilot Does
LivePilot works at two levels: exact control when you know what you want, and informed help when you do not.
Under the hood: a 5,264-device atlas, 683 mapped drum kits, 29 sample-processing techniques, 44 semantic moves, real-time and offline listening, and 12 planning and evaluation systems. The sections below show how each part works.
Two Ways to Talk to LivePilot
Start with the language that fits the moment. Both routes reach the same tool surface.
Route A — Artist / aesthetic shorthand
"Sound like J Dilla." "Make this feel more like Burial." "BoC-style pads."
Use a producer or genre as shorthand for rhythm, density, space, texture, and device choices. LivePilot translates the reference into techniques rather than pretending to clone someone's identity.
Route B — Direct musical intent
"Push the snare 4 ms early, keep the kick on-grid, add ±2 ms timing variation to the hats, and cut 3 dB around 380 Hz on the snare."
When the detail matters, name it: notes, milliseconds, dB, frequency, modulation depth, envelope shape, send level, automation curve, scale degree, or voice leading.
Mixing the routes
Most sessions use both. Start broad, listen, then get specific where the track needs it.
Architecture
How the pieces connect
Remote Script (remote_script/LivePilot/) — A Python ControlSurface that runs inside Ableton's process. Listens on TCP 9878. All Live Object Model calls execute on Ableton's main thread via schedule_message. Detects Ableton version at startup and enables four capability tiers: Core (12.0+), Enhanced Arrangement (12.1.10+), Full Intelligence (12.3+), Collaborative (12.4+).
MCP Server (mcp_server/) — Python FastMCP server. Validates inputs, routes commands to the Remote Script over TCP, manages the M4L bridge, and runs the atlas, sample engine, composer, planning, and evaluation systems. This is what your AI client connects to.
M4L Bridge (m4l_device/) — Optional Max for Live Audio Effect on the master track. Provides deep LOM access through Max's LiveAPI that the ControlSurface API can't reach. UDP 9880 (M4L to server) carries spectral data and LiveAPI responses. OSC 9881 (server to M4L) sends commands. The 38 spectral/analyzer tools strictly require the bridge; device and sample tools that call the bridge also have graceful fallbacks, so core functionality works without it. Backed by 32 bridge commands for hidden parameters, Simpler internals, warp markers, display values, and Simpler warp / Compressor sidechain writes that live on child objects Python can't reach.
Device Atlas (mcp_server/atlas/) — In-memory indexed JSON database. 5264 devices with browser URIs (bundled baseline), 120 enriched with YAML sonic profiles (mood, genre, texture, recommended chains). 7 indexes: by_id, by_name, by_uri, by_category, by_tag, by_genre, by_pack. Reverse-index device_techniques_index.json powers atlas_techniques_for_device (146 cross-references across 58 devices). Device and preset choices resolve against the atlas before loading, which reduces guessed names and dead ends. v1.22.0+: run scan_full_library after install to index your packs, User Library, and plugins into ~/.livepilot/atlas/device_atlas.json — your personal atlas overrides the baseline and survives npm updates.
Sample Engine (mcp_server/sample_engine/) — Searches three sources simultaneously: BrowserSource (Ableton's library), SpliceSource (local Splice catalog via SQLite), FilesystemSource (user directories). Every result passes through a 6-critic fitness battery (key, tempo, spectral, genre, mood, technical). 29 processing techniques (Surgeon precision vs. Alchemist experimentation). Builds complete sample processing plans with warp, slice, and effect recommendations.
Splice Client (mcp_server/splice_client/) — Searches Splice's catalog through two layers: the local SQLite database (sounds.db, already-downloaded samples) and the live gRPC API (full catalog, including samples you haven't downloaded yet). The gRPC client auto-detects Splice's dynamic port via port.conf, handles self-signed TLS, and enforces a 5-credit safety floor before any download. Per-call timeouts (5–10s) prevent a hung Splice process from stalling the MCP event loop. Graceful fallback to SQL-only if grpcio isn't installed. No API key needed — authentication comes from the running Splice desktop app.
Composer (mcp_server/composer/) — Prompt-to-plan pipeline. Parses natural language ("dark minimal techno 128bpm with industrial textures") into a CompositionIntent (genre, mood, tempo, key). Plans layers using role templates (kick, bass, percussion, texture, lead, pad, fx). Compiles to a step-by-step plan of tool calls that the agent executes. Does not execute autonomously — returns the plan. 4 genre defaults (house, techno, trap, ambient) — genres outside this set fall back to a neutral layer plan.
Corpus (mcp_server/corpus/) — Parsed device-knowledge markdown converted to queryable Python structures: EmotionalRecipe, GenreChain, PhysicalModelRecipe, AutomationGesture. Feeds Wonder Mode, Sound Design critics, and the Composer with structured production references at runtime.
Execution Router (mcp_server/runtime/execution_router.py) — Classifies each step in a multi-step plan as remote_command (TCP to Ableton), bridge_command (OSC to M4L), or mcp_tool (internal), then dispatches it through the correct channel.
How LivePilot Makes Decisions
Tools make the edit. These 12 systems help decide what to try, what to protect, what to compare, and what to remember.
SongBrain — What the Song Is
Builds a real-time model of the session: identity core (what defines this track), sacred elements (what must not be casually damaged), section purposes (what each part is doing emotionally), energy arc (where the song is heading). Detects identity drift when edits pull the track away from what made it work.
Taste Graph — What You Like
Learns your production preferences across sessions. Tracks which move families you keep vs. undo, which devices you gravitate toward, how experimental you want suggestions (novelty band), and which dimensions you avoid. Every accept/reject updates the graph. Two producers using the same tools get different recommendations.
Semantic Moves — Musical Actions, Not Parameters
44 high-level intents across 7 families (mix, arrangement, transition, sound_design, performance, device_creation, sample) — "add contrast," "tighten the low end," "make kick and bass lock," "sample vocal ghost," "destroy then rebuild." Each move compiles into a concrete tool sequence with risk level, target dimensions, and protection thresholds. Analyzer-gated moves (tighten_low_end, make_kick_bass_lock) mark their spectrum pre-reads as optional so the plan continues even when the analyzer isn't available. The plan shows its tradeoffs before anything changes.
Wonder Mode — Stuck-Rescue Workflow
When a session is stuck — repeated undos, overpolished loops, no structural progress — Wonder Mode activates:
- Diagnose — classify the stuckness (loop trap? missing contrast? identity unclear?)
- Generate — find semantic moves that address the diagnosis, enforcing real distinctness
- Preview — apply each variant, capture, undo. Hear before committing
- Commit or Reject — choice recorded into taste and session continuity
Creative Engines
Hook Hunter
Identifies the most salient musical idea — ranks candidates by recurrence across scenes, motif salience, and section placement (payoff-section boost). Tracks whether hooks are developed, neglected, or undermined, and flags when a transition fails to deliver expected payoff. Rhythm-side ranking is currently heuristic (drum-track detection + clip reuse); true onset-based rhythmic features are on the roadmap.
Session Continuity
Maintains creative threads ("the chorus needs more lift") and turn resolutions across the session. When you return to a project: "Last time, you kept the filter sweep for the bridge. The chorus lift thread is still open."
Evaluation Loop
Every engine follows: measure before → act → measure after → compare. If a change made things worse (more masking, lost headroom, identity drift), the system flags it before you move on.
Tools
LivePilot has 474 tools across 57 domains, but it no longer sends that entire
schema to the AI on every connection. The default producer profile exposes a
focused 26-tool production loop plus search_tools and call_tool; every other
tool remains searchable and directly callable by name. This keeps the initial
catalog under 40 KB while preserving the full system.
Use LIVEPILOT_TOOL_PROFILE=composition, mixing, or sampling to pin more
domain tools. Set LIVEPILOT_TOOL_PROFILE=full for legacy clients or catalog
diagnostics. Highlights below — full catalog here.
Core Ableton Control — highlights
M4L Bridge — 38 analyzer tools [optional], 32 bridge commands
The M4L Analyzer sits on the master track. UDP 9880 carries spectral data to the server. OSC 9881 sends commands back. The ensure_analyzer_on_master pre-flight (v1.20.3) loads the analyzer idempotently when an audio-dependent decision needs it.
[!TIP] Most tools work without the analyzer — it adds 38 spectral/analyzer tools (frequency, loudness, perception, Simpler, warp) and closes the feedback loop.
Device Atlas — 13 tools
The atlas is an in-memory indexed database of Ableton's entire device library.
v1.23.0 — User-local extensions: Drop YAML files at ~/.livepilot/atlas-overlays/<namespace>/ to extend the atlas with custom hardware libraries, signature chains, or technique recipes — survives npm updates. See docs/EXTENSION_API.md.
v1.23.4 — Pack-Atlas Phases C/D/E/F: Six new corpus-driven orchestration tools turn the 3,917 parsed pack sidecars + 104 demo .als parses into actionable artifacts — find similar presets, transplant aesthetics across BPM/scale/genre, narrate a demo, extract a track's chain as a runnable plan, bootstrap pack-coherent compositions, run any of 15 cross-pack workflow recipes. All execution is dry-run by default — returns plans, doesn't auto-mutate the session.
User Corpus — 14 tools [v1.23.4+]
Why this exists. The factory atlas covers what Ableton ships. Most studios also have third-party plugins, Max for Live devices, custom racks, presets, and sample packs. The corpus builder indexes that local library so recommendations can use tools you actually own.
The corpus builder turns what is installed on your machine into searchable production context:
The result lives at ~/.livepilot/atlas-overlays/user/plugins/<plugin_id>/identity.yaml and is available to atlas_search, atlas_chain_suggest, atlas_macro_fingerprint, and atlas_describe_chain alongside the factory atlas. Every result names its source (factory_atlas or user_overlay:user), so you can see whether a recommendation comes from Ableton stock or your own gear.
Why this matters. A static index goes stale when your library changes. Re-scan after adding a plugin or rack and LivePilot can consider it alongside Ableton's factory devices.
Quick start:
See docs/USER_CORPUS_GUIDE.md for full walk-through, docs/PLUGIN_KNOWLEDGE_ENGINE.md for engine internals, and livepilot/skills/livepilot-corpus-builder/SKILL.md for the agent skill that drives the pipeline.
Sample Engine — 23 tools
Search Ableton, local folders, and Splice together, then rank results against the musical role instead of returning a pile of filenames.
Splice Integration
LivePilot reads Splice's local SQLite database to search your downloaded samples with full metadata. No API key needed — it reads the database file directly.
What it does:
- Searches your downloaded Splice samples with key, BPM, genre, and tag metadata
- Integrates as a third source alongside Ableton's browser and filesystem scanning
- Works without a Splice subscription — any previously downloaded samples are searchable
How it works: The Sample Engine's SpliceSource reads ~/Library/Application Support/com.splice.Splice/users/default/*/sounds.db — Splice's local SQLite catalog of downloaded samples. Read-only, no network calls.
Requirements: Splice desktop app running (the MCP server talks to it over gRPC at a dynamic port advertised via port.conf, with self-signed TLS). For fully offline search, previously-downloaded samples are always searchable via the local SQLite fallback even if the Splice app isn't running.
Composer — three modes (v1.25.0)
Prompt-to-plan composition workflow. Three modes share the same safety checks: reconnect the bridge, load the analyzer when needed, set monitoring correctly on new tracks, and return to Arrangement View after the build. The work stays visible as a sequence of tool calls.
fast mode — compose_fast_apply
Quick loop sketch. Single scene in session view. Intended for roughing out ideas quickly.
- Hunt order: curated
.adgchains from the browser first, atlas devices second, bare instruments only as last resort - Drum-role pitch repair included (Simpler default root vs. MIDI 36 offset)
- 4 genre defaults: house, techno, trap, ambient (unknown genres fall back to a neutral layer plan)
- Invoke with: "Make me a [genre] loop at [tempo] BPM"
full mode — compose_full_apply
Full track with song form: intro, verse, hook, breakdown, outro. Uses a two-phase LLM-creative brief flow — the LLM authors the form (sections, track list, per-section variants); the framework supplies the vocabulary (device hunt order, MIDI generation rules, arrangement conventions).
- Per-section MIDI variants prevent repeated tiles across the arrangement
- Native arrangement clips via
create_native_arrangement_clip(one clip per section, looped to fill section length) - Zombie-track cleanup in postflight (removes tracks with no clips and no instrument device)
- Drum-role pitch repair ported from fast mode
- Atlas anchors: role-level device knowledge is supplied through
KnowledgePack.atlas_anchors, which consults the indexed atlas rather than filename matching. The olderatlas_candidates_per_rolefield is a deprecated legacy stub, kept empty for back-compat. - Invoke with: "Write a full [genre] track at [tempo] BPM" or "Build a full arrangement"
develop mode — develop_apply
Extends an existing 8-bar loop without disturbing the seed material.
- Introspects the existing session (classifies tracks by name and content)
- Pulls artist and stylistic references from the user prompt
- Writes per-track variants and new supporting layers alongside the seed
- Invoke with: "Develop this loop" or "Extend what's here into a longer idea"
KnowledgePack scaffolding (v1.25.0)
All three modes share a KnowledgePack that provides structured creative context at runtime:
event_lexicon— 42 structural events across 7 categories (drum density, harmonic, texture, vocal, rhythm feel, tension, fx gesture)genre_context— parses the 15-genregenre-vocabularies.mdat load timeartist_context— parses the ~25-producerartist-vocabularies.mdat load timeatlas_anchors— indexed-atlas device anchors per role (replaced the legacyatlas_candidates_per_rolestub)
Core composer tools
compose— plan a multi-layer composition from text prompt (entry point, mode-agnostic)compose_fast_apply— execute fast mode directlycompose_full_apply— execute full mode directlydevelop_apply— execute develop mode directlyaugment_with_samples— plan sample-based layers for an existing sessionget_composition_plan— dry-run preview (see the plan without credit checks)
Device Forge — 3 tools
Generate M4L audio effect devices from gen~ templates and install them into Ableton's browser.
Planning, Evaluation, and Learning — 79 tools
These tools read the session, diagnose problems, plan changes, compare results, and carry useful context into the next decision.
Install
Claude Desktop: one-click install
Download the latest livepilot-<version>.mcpb from the Releases page and double-click it.
Claude Desktop installs everything automatically. Then:
- Open Ableton Live 12
- Preferences → Link, Tempo & MIDI → Control Surface → LivePilot
- Start chatting
[!TIP] The Desktop Extension auto-installs the Remote Script and M4L Analyzer on first launch.
Terminal: one-command setup
Runs the full setup wizard: checks Python, installs the Remote Script, creates the Python environment, copies the M4L Analyzer, and tests the Ableton connection.
Manual: Step by Step
1. Remote Script
Restart Ableton → Preferences → Link, Tempo & MIDI → Control Surface → LivePilot
2. MCP Client
Claude Code — pick one (installing both registers the MCP server twice and collides on port 9878):
Codex App:
Claude Desktop (macOS) — ~/Library/Application Support/Claude/claude_desktop_config.json:
Claude Desktop (Windows):
%APPDATA%\Claude\claude_desktop_config.json:
Cursor — .cursor/mcp.json:
VS Code — .vscode/mcp.json:
3. M4L Analyzer (optional — adds 38 tools)
Drag LivePilot_Analyzer.amxd onto the master track for real-time spectral analysis.
The --setup wizard and Desktop Extension install both the device and its sibling bridge script automatically. From v1.20.3, your AI client can also call ensure_analyzer_on_master — an idempotent pre-flight that loads the device if missing and no-ops otherwise. Creative workflows call it only when the decision or verification needs audio evidence.
Important: The Analyzer must be the LAST device on the master track — after all effects (EQ, Compressor, Utility) so it reads the final output signal. The pre-flight tool reports
is_last_on_master: booland warns if the invariant is broken.
4. Splice (optional — adds sample catalog)
If you have Splice installed with downloaded samples, the Sample Engine can search them with full metadata (key, BPM, genre, tags) via the local SQLite database.
No API key, no configuration — the Sample Engine reads Splice's sounds.db file directly.
Without Splice, the Sample Engine still searches Ableton's browser and your filesystem.
Verify
Plugin
Codex App
Claude Code
Producer Agent — handles longer jobs in visible stages: reads the session, checks what you kept, searches the library, proposes a plan, applies edits, and listens back. You stay in charge of what remains in the set.
Core Skill — keeps the work disciplined: search before loading, measure before and after, preserve undo, and verify every change.
CLI
Compatibility
Version tiers:
- Core (12.0+): All session tools, mixing, devices, MIDI, theory, generative, memory
- Enhanced Arrangement (12.1.10+): Native arrangement clips, arrangement automation
- Full Intelligence (12.3+):
insert_device_native, complete device insertion pipeline - Collaborative (12.4+):
replace_sample_nativeand newer sample-editing routes that bypass the M4L fallback when Live exposes a native LOM path
Development
See CONTRIBUTING.md for architecture details, code guidelines, and how to add tools.
Documentation
Community
- Discussions — questions, ideas, show & tell
- Bug reports
- Feature requests
- Contributing guide
- Security policy
Support
LivePilot is source-available under the Business Source License 1.1. If it earns a place in your sessions, you can support its continued development:
Sponsorship funds deeper Ableton coverage, cross-platform testing, and maintained technique libraries. Sponsors also get early builds and direct support.
BSL-1.1 — Pilot Studio
Sister projects: TDPilot (TouchDesigner) · ComfyPilot (ComfyUI)
來源:README.md,提交 d2e0a7a
工具
0版本歷史
1- v1.10.4最新Sep 16, 2026
評分
已滿足適用檢查項的 40%
該評分衡量此收錄條目的完整程度,依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價,也不表示伺服器安全或目前可用:可連通性是帶日期的檢查結果,評分也不包含安裝量或使用者評價。
- 近 30 天內可連通25 分
請保持端點能夠回應 MCP 握手;SourceWeft 每 30 天探測一次。
- 已宣告認證方式10 分
請在註冊中心條目中宣告憑證請求標頭,或保持端點能夠回應探測,以便判定其認證方式。
- 已列出工具15 分
請讓伺服器在無憑證時回應 tools/list,或發布可在沙箱中無憑證啟動的軟體包。
- 描述必需15 分
- 圖示10 分
- 文件15 分
- 授權條款10 分
請在儲存庫或註冊中心條目中宣告授權條款。