NeuroStack

[PyPI] [npm] [License] [CI] [MCP]

A local retrieval layer and optimizer for the Markdown knowledge base you already have.

NeuroStack indexes a folder of .md files (Obsidian, Logseq, Notion exports, plain Markdown) into one SQLite database with full-text search, embeddings and a wiki-link graph. Any MCP client can then search it, walk the graph and save memories. A query returns ranked evidence with note paths, and your AI does the reasoning, so no model runs while you wait. Between queries NeuroStack keeps the knowledge base accurate. It flags notes that have gone stale, harvests decisions and root causes from your AI sessions, merges recurring memories into learnings, and queues the proven ones to become notes. Indexing never changes your files, and optional MCP write tools let a client edit notes through your git history.

Works with Claude, Cursor, Windsurf, Gemini CLI, VS Code, Codex and any other client that supports MCP.

60-second start

npm install -g neurostack          # installneurostack init                    # pick your notes folder, press Enter for the rest/save                              # in omp or Claude Code, keep what this session learnedneurostack doctor                  # check that everything works

The steps below explain each part and how to connect other AI clients.

Your notes, in your control

By default, NeuroStack is a read-only indexing layer:

• Indexing, search, summaries, and graph analysis never modify your Markdown files
• All index data lives in NeuroStack's own separate database
• To remove it completely, run neurostack uninstall. Your notes stay untouched.
• Nothing ever leaves your machine, unless you configure a third-party LLM provider for summaries and embeddings

If your vault is a git repo, four opt-in MCP write tools let an AI client author and edit notes for you: vault_write_file, vault_delete_file, plus vault_read_file / vault_list_files. Every write commits and pushes to your git remote with a descriptive message, so every change is visible in git log, revertable with git revert, and serialised under a per-vault lock. Writes hard-reject invalid frontmatter, paths outside the vault, and hidden directories (.git, .obsidian, …). Because the tools are exposed to any client talking to neurostack serve, gate them at the transport (auth, tunnel, LAN only) if you put the MCP endpoint on the public internet.

Who this is for

You do not need to be a developer. If you take notes in Markdown, or can export your notes as Markdown from Obsidian, Notion, Bear, or Roam, NeuroStack works for you.

Get started in three steps

You will need Node.js installed (most computers already have it). The npm package handles the Python setup for you.

Step 1. Install

npm install -g neurostack

Step 2. Set up (takes about two minutes)

neurostack init

The setup wizard asks which vault folder to index, which mode to run (Lite or Full), and which profession pack to apply. Then it finishes the install for you. It adds the NeuroStack hook to omp or Claude Code if you have them, so /save keeps what a session learned. It sets up the AI that turns saved sessions into memories, using the same model as your summaries. If no model answers yet, it leaves that off and tells you so. It also installs one background timer that keeps the index tidy, and a failed background job shows up as a desktop notification. Press Enter at each question to take the default. At the end it runs neurostack doctor and shows what to try first.

Step 3. Connect to your AI

For Claude Desktop:

neurostack setup-desktop

For Claude Code:

claude mcp add neurostack -- neurostack serve

For Cursor, Windsurf, Gemini CLI, or VS Code:

neurostack setup-client cursor      # or: windsurf, gemini, vscode

Done. Open a new conversation and ask your AI about something from your notes.

neurostack init --mode lite ~/my-notes --yes    # lite modeneurostack init --mode full ~/my-notes --yes    # full mode

# PyPIpipx install neurostackpip install neurostack        # inside a venvuv tool install neurostack
# One-line scriptcurl -fsSL https://raw.githubusercontent.com/raphasouthall/neurostack/main/install.sh | bash
# Lite mode (no ML deps)curl -fsSL https://raw.githubusercontent.com/raphasouthall/neurostack/main/install.sh | NEUROSTACK_MODE=lite bash

What it does

[How NeuroStack works: vault, index, serve, clients, and the optimizer loop]

• Hybrid search (FTS5 keyword + semantic) with tiered depth, so a client can fetch triples, summaries or full notes by token budget.
• Ranked evidence with note paths and excerpts over the CLI, MCP, or an OpenAI-compatible API, for your AI to cite and reason over.
• Stale detection. A note that keeps surfacing in contexts where it no longer fits is flagged and demoted in later results.
• Session harvest. A timer scans Claude Code, Codex, Gemini and omp transcripts and saves decisions, bugs, conventions and learnings as memories with TTLs.
• Synthesis and promotion. Recurring memories become learnings; a promotion queue lists which ones are ready to become notes.
• Wiki-link graph with PageRank, community detection, gap and bridge analysis.
• Read-only by default. Opt-in write tools commit and push every change to your git remote.

Design

Philosophy

1. Your files stay yours. The index lives in its own database, so deleting it leaves your notes exactly as they were.
2. NeuroStack returns evidence and your AI reasons over it. No tool answers questions, and tests/test_no_answering.py keeps it that way.
3. Removing a memory moves it to an archive that search cannot reach, and you can restore it later.
4. NeuroStack redacts secrets from text a model wrote, such as harvested summaries. It stores what you or your agent saved on purpose word for word.
5. Ranking changes get measured first. neurostack eval switches off usage learning while it runs, so one pass cannot skew the next.

Mental model

NeuroStack holds two layers and one loop.

The vault is your Markdown. NeuroStack reads it, splits it into chunks, embeds them, summarises each note, extracts facts as triples and builds the link graph. Note status and tags live in NeuroStack's own note_metadata table, so it never needs to edit your frontmatter.

The memory layer holds what agents learn, typed as observations, decisions, conventions, learnings, bugs or context. These rows belong to NeuroStack and carry an optional workspace and an optional expiry.

The optimizer loop runs on a timer and connects the two. A memory usually starts in an AI session, becomes a learning when it keeps recurring, and becomes a note once no existing note covers it.

Architecture

flowchart LR    V[/"Markdown vault<br/>never modified"/] --> IX["index<br/>chunk, embed, summarise,<br/>triples, link graph"]    IX --> DB[("neurostack.db<br/>SQLite + FTS5")]    S[/"AI session transcripts"/] --> H["harvest"]    A["MCP client or CLI"] -->|vault_remember| DB    H --> DB    DB --> R["search, tiered, context,<br/>graph, brief"]    R --> A    DB --> J["timer jobs<br/>synthesize, promotion,<br/>decay, communities"]    J --> DB    J -->|opt-in, git commit| V    DB --> UI["neurostack ui<br/>read-only dashboard"]

One OS timer runs neurostack run-due every minute, and that command runs each due job in turn. neurostack serve exposes 33 MCP tools over stdio or HTTP, and neurostack api serves the same retrieval as an OpenAI-compatible API.

Data model

A memory row stores its content, tags, type, workspace, source agent, embedding and expiry. It also records embed_pending when the embedder was down, so neurostack backfill can embed it later, plus revision_count and merged_from for edits and merges. A second database, sessions.db, indexes raw session transcripts for neurostack sessions search.

Write mechanics

1. Deliberate saves. vault_remember and neurostack memories add store the text as written, embed it once, then report any near-duplicate above 0.85 similarity without refusing the save. If embedding fails, the row still saves and gets flagged for backfill.
2. Harvest. The index LLM reads each session message and keeps decisions, root causes, rules and facts. A second pass reads the session as a whole and saves up to 3 final conclusions tagged session-verdict. The judge model then picks each memory's type. Harvest redacts secrets, skips anything above 0.88 similarity to a live memory, and records how many messages of each session it has read.
3. Synthesis. Observations at least 7 days old that cluster at 0.75 similarity or higher (one anchor plus 3 or more others) become one learning. The originals stay, tagged superseded_by:<id>.
4. Removal. Forget, the losing side of a merge, expiry and prune all go through one helper that copies the row into memories_archive with a reason and a timestamp, then deletes it from the live table. Search checks expiry before it runs, so an expired memory never shows up.
5. Vault writes. Only the opt-in tools (vault_write_file, vault_delete_file) and the promotion job touch the vault, and each one commits and pushes to git.

Read mechanics

1. Hybrid search. NeuroStack runs keyword search and embedding search separately, takes the top 50 chunks from each, and merges the two lists by reciprocal rank (k = 60). A chunk found by only one search still competes. It then adds a convergence bonus, a 1.4× boost for the caller's context, usage hotness and co-occurrence, and demotes notes flagged as stale.
2. Diversity. Results keep one chunk per note, and similar notes suppress each other, so one long note cannot fill the result list.
3. Tiered depth. A client asks for triples (about 15 tokens), summaries (about 75) or full notes (about 300), or lets auto escalate only when the cheaper tier misses.
4. Context assembly. vault_context splits its token budget into 40% memories, 20% triples, 30% summaries and 10% sessions, so no single source crowds out the rest.
5. Hard limits. Every search returns at most top_k results. No retrieval path calls an LLM unless you pass rerank=True (see below).

Optional reranking. vault_search(rerank=True) asks the judge model to score each whole-note result against your query and returns the judge's order. On 76 real search clicks it raised MRR from 0.503 to 0.652, top-1 hits from 34% to 49% and top-3 hits from 57% to 75% (paired permutation p=0.004). Each search costs about $0.0004 and adds about 0.4 s. It works with depth="full" or reference_only=True and raises an error at the other depths. If the judge fails, you get the normal order back.

Usage makes a note easier to find again. It never marks a note as true.

Known limits

• Harvested memories do not record their workspace yet, so a workspace-scoped search misses them.
• A harvested memory does not link back to the session and message it came from.
• A forgotten memory can come back if a later session says the same thing, because the duplicate check reads only live memories.
• Editing a memory replaces its text, and only revision_count shows that it changed.

External services

Lite mode needs none of these. Everything below is opt-in and set in ~/.config/neurostack/config.toml, and each one has a matching NEUROSTACK_* env var. When a service is missing, the feature that needs it switches off and the rest keeps working.

Only the embedder and the index LLM see your note text. The judge sees queries, memories and the notes being ranked or checked. Point every URL at localhost to keep all data on your machine.

What makes it different

NeuroStack is not a replacement for Obsidian, Notion, or any note-taking app. It sits on top of what you already use and adds what they don't have.

Stale detection is the part other tools lack. When a note keeps appearing in contexts where it no longer fits, such as a deprecated API or a superseded paper, NeuroStack flags it and demotes it in later results.

Profession packs

When you run neurostack init, you choose a profession pack. Each one configures NeuroStack with templates, folder structures, and AI guidance suited to how your profession actually uses notes.

Apply a pack to an existing vault without losing any notes:

neurostack scaffold researcher ~/my-notes    # or: writer, student, developer, devops, data-scientist

You can also import an existing Markdown directory:

neurostack onboard ~/my-notes

How retrieval works

Most memory tools give your AI a wall of text and let it figure out what's relevant. NeuroStack is tiered. It starts with the cheapest retrieval that answers the question and escalates only when it needs to.

Simple factual questions resolve at ~15 tokens. Deep dives get full context. Your AI spends its attention budget where it matters.

Your AI remembers decisions

Across sessions, your AI can save and retrieve typed memories: observations, decisions, conventions, learnings, bugs. When you start a new session, those memories are surfaced automatically.

"We decided to keep authentication stateless." "The thesis framing shifted from consolidation to complementary learning systems." "Elena's surname changed from Vasquez to Reyes in the chapter 7 revision."

These aren't just notes. They're things your AI remembers you decided together. They survive /clear. They survive closing the terminal. They survive switching machines.

neurostack memories add "revised thesis framing to CLS, not just consolidation" --type decision --tags "thesis,neuroscience"neurostack memories search "thesis direction"

Learns from your AI sessions

NeuroStack scans your past AI conversations on a timer, extracts the decisions, observations and learnings, and saves them as memories. You do not have to write them down yourself.

neurostack harvest --sessions 5          # extract insights from last 5 sessionsneurostack schedule install              # one timer runs due jobs every minute

Supports Claude Code, VS Code, Codex CLI, Aider, and Gemini CLI session formats.

Keeps itself current

Your vault changes. NeuroStack watches it.

neurostack watch     # auto-index on vault changes

The index updates as you write and stale detection runs continuously, so you do not maintain it by hand.

Scheduling

NeuroStack runs its background jobs from one OS timer. The timer calls neurostack run-due once a minute, and run-due works out which jobs are due and runs them one at a time. neurostack init installs the timer for you. Installing it records each daily job as just run, so the jobs start at their next scheduled time instead of all at once. The commands below manage it by hand.

neurostack schedule install   # install or overwrite the timerneurostack schedule status    # show whether the timer is activeneurostack schedule remove    # remove the timer

schedule install uses the scheduler your OS already ships:

The timer calls the neurostack executable it finds on your PATH at install time, so run schedule install again after you move or reinstall NeuroStack. All three subcommands accept --json.

A systemd user timer runs only while you have a login session. On a headless Linux server, or when you run NeuroStack as root, enable lingering for that user so the timer keeps running after you log out:

sudo loginctl enable-linger <user>

neurostack doctor shows when each job last ran.

Checkpoints with a laptop and a server

/save on the laptop uploads the session transcript to the server's queue. The server's checkpoint-worker job turns it into memories within a minute, and harvest-worker does the same for transcripts harvest-scan uploads every 30 minutes. Each host reads its own file.

On the laptop, ~/.config/neurostack/client.toml names the server. Its checkpoint_command turns on harvest-scan and serves any hook checkpoint --run you start by hand:

url = "http://my-server:8001/mcp"checkpoint_command = "claude -p --model haiku"

The hook waits up to context_timeout_s (15 s) for the session brief and per-prompt context, and up to timeout_s (5 s) on each tool call, so a server that is down never stalls every tool call.

On the server, ~/.config/neurostack/config.toml holds the command the workers pipe each checkpoint prompt through. Any command that reads the prompt on stdin and prints the model's reply works, so it can call an OpenAI-compatible endpoint or a local proxy:

checkpoint_command = '''jq -Rs '{model: "qwen/qwen3-30b-a3b", messages: [{role: "user", content: .}]}' \  | curl -s https://openrouter.ai/api/v1/chat/completions \      -H "Authorization: Bearer $OPENROUTER_API_KEY" -H "Content-Type: application/json" -d @- \  | jq -r '.choices[0].message.content' '''checkpoint_timeout_s = 300     # per checkpointcheckpoint_max_messages = 40   # largest window one checkpoint summarizes, 0 for no cap

NEUROSTACK_CHECKPOINT_COMMAND, NEUROSTACK_CHECKPOINT_TIMEOUT_S and NEUROSTACK_CHECKPOINT_MAX_MESSAGES override them. With no checkpoint_command in config.toml, neurostack jobs shows both workers off and says why.

Dashboard

neurostack ui serves a read-only dashboard at http://127.0.0.1:8765. It shows six pages. Overview has index coverage, communities, recent notes and memory counts. Automations lists every scheduled job with its last run, next run and 14-run history, and you can click a job to see its runs. Graph draws the top notes by PageRank, and clicking a node opens its summary and links. Memories lists memories with type tabs and search. Search runs note and memory searches with every option the vault_search and vault_memories tools take: mode, depth, result count, workspace, context boost, max tokens, judge rerank and reference-only for notes, and type, workspace and count for memories. A search there embeds the query, so it needs the embedder, and it does not count as note usage. Each note result has a Best result button that stores the search and the note as a label. Tuning runs weight tuning on those labels and on the ones the feedback loop inferred: it tunes on half, scores the other half, and Apply makes the winning weights the ones every search uses, only when they rank the unseen half better. Revert goes back to config.toml. Applying and marking are the dashboard's only writes.

It needs no extra install and makes no model calls. Pass --port to change the port and --open to open a browser. On any address other than localhost, create a login first with neurostack ui user add NAME, which prompts for a password of at least 8 characters (--password-stdin reads it from a pipe). The page then shows a sign-in form, and a session lasts 30 days. neurostack ui user list shows the users and neurostack ui user remove NAME deletes one and ends their sessions.

What changes day-to-day

How your vault is stored

~/your-vault/                           # your Markdown files (not modified by indexing; AI clients can edit via opt-in MCP write tools)~/.config/neurostack/config.toml        # configuration~/.local/share/neurostack/    neurostack.db                       # SQLite + FTS5 knowledge graph    sessions.db                         # session transcript index

NeuroStack reads your vault. By default it writes nothing back, and all index data lives in its own SQLite databases. The opt-in MCP write tools (vault_write_file / vault_delete_file) are the one exception: they create or edit .md files in the vault and commit + push the change to your git remote on the spot.

Memory write-back (opt-in)

Memories live in SQLite by default, so they're invisible in Obsidian and vanish if the database is lost. Turn on write-back to persist qualifying memories as markdown files you own:

[writeback]enabled = true                 # opt-in; default falsepath = ".neurostack"           # quarantine dir, relative to vault_rootinclude_observations = false   # also write the noisier observation/context types

• Files land under {vault_root}/.neurostack/memories/<type>/<YYYY-MM>/<uuid>.md. NeuroStack only ever writes inside that one directory, so your own notes stay untouched.
• Only persistent (no-TTL) decision / convention / learning / bug memories are written; ephemeral (TTL) memories never are.
• The database stays the source of truth; files are readable exports. vault_remember / vault_update_memory / vault_forget / vault_merge keep the files in step automatically.
• The directory self-ignores via its own .gitignore so memories stay out of git until you opt in (delete that file to version them). NeuroStack never commits on your behalf.
• neurostack migrate write-back [--dry-run] exports existing memories; neurostack sync reconciles files against the DB (the DB wins on conflict).

# Setupneurostack init                          # one-command setup: deps, vault, indexneurostack init --mode full ~/brain      # non-interactive full modeneurostack onboard ~/my-notes            # import existing Markdown notesneurostack scaffold researcher           # apply a profession packneurostack scaffold --list               # see all packsneurostack update                        # pull latest source + re-sync depsneurostack uninstall                     # complete removal
# Search & retrievalneurostack search "query"                # hybrid searchneurostack tiered "query"                # tiered: triples -> summaries -> fullneurostack triples "query"               # knowledge graph triplesneurostack summary "note.md"             # AI-generated note summaryneurostack related "note.md"             # semantically similar notesneurostack graph "note.md"               # wiki-link neighborhoodneurostack communities query "topic"     # GraphRAG across topic clustersneurostack context "task" --budget 2000  # task-scoped context recoveryneurostack brief                         # session briefing
# Maintenanceneurostack index                         # build/rebuild knowledge graphneurostack watch                         # auto-index on vault changesneurostack decay                         # excitability reportneurostack prediction-errors             # stale note detectionneurostack backfill [summaries|triples|all]neurostack communities build             # rebuild topic clustersneurostack reembed-chunks                # re-embed all chunksneurostack export --include triples -o dump.json  # dump index data as JSON
# Memoriesneurostack memories add "text" --type observationneurostack memories search "query"neurostack memories listneurostack memories update <id> --content "revised"neurostack memories merge <target> <source>neurostack memories forget <id>neurostack memories prune --expired
# Sessionsneurostack harvest --sessions 5          # extract session insightsneurostack sessions search "query"       # search transcripts
# Scheduled jobs: one OS timer (systemd, launchd, or Task Scheduler) runs `neurostack run-due`neurostack schedule install              # install or overwrite the timerneurostack schedule status               # is the timer active?neurostack schedule removeneurostack run-due                       # what the timer calls: run each due job onceneurostack jobs                          # schedule, last run, and next due per job
# Harness hooks (session brief, auto-RAG, trigger memories, checkpoints)neurostack hooks install --harness claude   # or: ompneurostack hooks status
# Trigger memories: did the warnings change anything?neurostack triggers stats                # fired, followed, ignored per memory (30d)neurostack triggers stats --days 7
# Checkpoint: manual only — a harness never fires one on its own (issue #176).# `/save` (both harnesses) queues a request instead of running one directly:neurostack hook enqueue --harness claude    # or: omp — uploads the transcript to the server's queueneurostack hook checkpoint --run --session <id>  # run one checkpoint by hand on this hostneurostack hook checkpoint --save               # a model's JSON reply on stdin

# Client setupneurostack setup-client cursor           # or: windsurf, gemini, vscode, claude-codeneurostack setup-client --listneurostack setup-desktop                 # Claude Desktop
# Diagnosticsneurostack stats                         # index healthneurostack doctor                        # validate all subsystemsneurostack demo                          # interactive demo with sample vault

FAQ

Does it modify my vault files? Not by default. Indexing, search, summaries, and every read tool leave your files untouched, and all index data lives in NeuroStack's own SQLite databases. Four opt-in MCP write tools (vault_write_file, vault_delete_file, plus vault_read_file / vault_list_files) let an AI client author and edit notes; every write commits and pushes to your git remote, so changes are tracked and revertable. If your vault is not a git repo, the file is still written to disk but the commit step is skipped. Separately, opt-in memory write-back persists memories as markdown, but only inside the quarantined .neurostack/ directory, away from your own notes.

Do I need a GPU? No. Lite mode has zero ML dependencies. Full mode runs on CPU but summarization is slow without a GPU.

Do I need to know Python? No. The npm package handles everything. You never touch a virtualenv.

How large a vault can it handle? Tested with ~5,000 notes. FTS5 search stays fast at any size.

Can I use it without an AI client? Yes. The CLI works standalone and pipes into any LLM.

Is my vault private? Yes. Nothing leaves your machine, unless you point Full mode at a third-party LLM provider instead of local Ollama. In that case the text you index goes to that provider under its own policy.

What AI clients does it work with? Claude Code, Claude Desktop, Cursor, Windsurf, Gemini CLI, VS Code, Codex and any other client that supports MCP.

Requirements

• Linux, macOS, or Windows
• Lite mode: Node.js + Python 3.11+. No GPU or Ollama required.
• Full mode: Ollama with nomic-embed-text and a summary model. GPU or 6+ core CPU recommended.

Get started

npm install -g neurostackneurostack init

neurostack init picks a tier, installs dependencies, indexes the vault and configures your MCP client.

• Contributing: CONTRIBUTING.md
• GitHub: github.com/raphasouthall/neurostack
• Sponsor: GitHub Sponsors | Buy me a coffee

Apache-2.0, see LICENSE. No GPL dependencies.