Code Factory

Code Factory

Current release

Code Factory core 0.49.6 · VS Code and Open VSX 1.3.3 · JetBrains 1.3.4

Release and downloads · Four annotated UI screenshots

The exposed N443-38 replay measured 88.24% decided actionable precision (30/34) versus 85.71% on the same observed cases. It returned 37 of 38 cases and retained all 30 original true positives. The original sealed first-pass reference was 83.33% on decided labels (30/36) and 78.95% counting all 38 selected cases. Two blind AI reviewers supplied the labels. Case ledger

Your agent handed you a change. Now you need to decide what to accept. Code Factory brings the findings, source context and recorded checks into one review trail. Inspect a finding, choose the repair, and rerun the affected checks. You keep the evidence with the change and the decision in your hands. Start with one command:

python -m pip install factoryline-code-factoryfactory scan --root .

Your workflow: scan → review the findings → repair → run your tests and the affected checks again. The basic scan reads eligible Python source; it does not run your project. Missing evidence is INCOMPLETE, not a clean bill of health.

The Python source budget defaults to 2,000 files. factory scan --max-files 1000 sets a smaller per-run budget; over-budget scans stop explicitly without silently dropping files. This runtime budget is separate from CF's own architecture caps. Human output includes finding locations and audited/discovered source counts. Exit 0 means no blocking finding or failed check; advisories and missing evidence may remain. Exit 2 means blocked or invalid analysis. A clean Python static result does not establish runtime coverage or release approval. Use --static-only for the Python-only path; the default also orchestrates other applicable evidence lanes. JavaScript, shell and other language audits require external workers.

Want a visual workspace? Run factory studio --root .. Need options? factory --help shows the short path; factory --help-all shows all commands. Start with the quick guide.

Keep pytest, mutation testing, CodeQL, Semgrep and your review checklist. CF adds test-quality findings and source-bound local evidence alongside them. A basic scan needs no adoption ceremony, signing keys, tenant setup or Docker. Native worker execution has separate setup and safety requirements.

Code Factory is the product. Its internal engines and advanced governance features are optional workflows, not prerequisites for reviewing your code.

Starting from an idea?

Describe your idea to your coding agent and create PRD.md. The optional beginner guide helps turn it into concrete acceptance checks. For an existing repository, start with the scan above.

From an idea to a reviewable change

For a new builder, start with an idea and make the expected behavior concrete. For an experienced developer, start with the repository or proposed diff.

The complete factory

• FactoryLine coordinates local audits, evidence, and review decisions.
• ForgeLine builds scoped changes and challenges their checks.
• SpecLine defines the intent, requirements, and acceptance criteria those checks must prove.

Run a basic scan when you want a quick local review.

What’s new in 0.49.6

1. Pre-PR review. factory change pre-pr <manifest> combines candidate source, planned checks, oracle evidence, and feature verification in one receipt. Add --execute to run the declared checks.
2. Repair continuity. factory senior fix returns NO_PROGRESS for a repeated failed candidate and STEP_BACK when the round budget is spent. The default budget stops before a fourth round.
3. Incident intake. Reviewed incidents produce source-bound regression packets marked EXPOSED_NOT_EXECUTED. Replay evidence records what was exercised.
4. Scan evidence. Native scans bind collection receipts before sealing. Collection drift marks the evidence incomplete and requires a fresh seal.
5. CLI and editors. factory home prints a local invitation to star the repo. Editor releases are VS Code and Open VSX 1.3.3 and JetBrains 1.3.4.

Product walkthrough

The captures use a fictional workspace. Its one-file scan reports a planted security finding with complete source coverage and incomplete overall evidence.

[Factory Studio Product Mission draft with intent and review callouts]

[Graph Ops guide for choosing the next proof]

[Graph Ops local scan with source coverage and incomplete evidence]

[Expanded Graph Ops finding with its source line and rationale]

Try the free local core on your own repository. If it helps, a GitHub star makes it easier to discover; fork it to improve a rule or contribute a reproducible positive and negative example. Reports of missed issues and false alarms are useful contributions too.

Code Factory + ForgeLine (CF/FL) is a robust, local-first code-audit factory. It starts by collecting local software review evidence for the candidate change. It connects requirements, architecture checks, Python AST security analysis, behavioral test evidence, workflow integrity, specialty AI review, and actionable repair. Its receipts support review; the tool does not certify software, guarantee that defects are absent, or approve a release.

Product naming: Code Factory is the product and ForgeLine is its audit and architecture engine. SpecLine, HSF, and Prestige are advanced internal lanes that appear only when a project declares the corresponding scope; they are not separate products a new user must learn before running a scan.

Add deeper audit lanes

factory scan --root . --deep

Deep mode orchestrates architecture, Python security and test-oracle checks, workflow integrity, requirements, runtime coverage, and dependency evidence. Languages including TypeScript/JSX, Go, Rust, Java, C/C++, C#, Ruby, PHP and Swift are inventoried explicitly; missing native analysis remains unmeasured.

For authorized native execution, use:

factory scan --root . --deep --worker-config .factory/worker-config.json --json

The configuration contains workspace-relative manifest, authorization, and trust_root paths plus manifest_sha256 and trust_root_sha256 pins. This invokes the existing signed Docker worker engine for configured CodeQL, Semgrep, secrets, dependency, container, runtime and fuzz lanes. Unsigned plans are rejected. Completed workers still require independent agent review; missing evidence and review cannot produce a passing verdict. Native execution requires its configured images and tooling and can take longer than a minute. Each unresolved lane includes its next action. Receipt presence alone is not verification, and no scan claims to detect every defect.

Package metadata now uses Production/Stable, starting with this source update. That release-status label is separate from detection accuracy, independent benchmark results, and provider publication.

In an interactive terminal, factory optionally makes one plain PyPI version check and caches the result for up to 24 hours, then prints a notice when a newer version is available. It never downloads or installs the update. The check is quiet in CI, JSON output, server/MCP, help, version, and non-interactive runs; set FACTORY_DISABLE_UPDATE_CHECK=1 to turn it off. The optional request does not include a project path, account identifier, or usage data. All audit and proof commands remain local unless an operator explicitly uses a separate provider integration.

Run repository commands from the project being reviewed. factory guide is a read-only orientation; it does not run tests or agents.

Inspect this repository

These commands show the current architecture policy, the bounded static security scan, and the runtime-audit setup:

factory architecture health --root . --jsonfactory audit security --root . --jsonfactory runtime-audit status --root . --json

factory audit security checks a limited set of source patterns. It is not a penetration test. The runtime audit needs a separately reviewed plan and its own environment evidence. A status of NOT_RUN or a clean static scan is not a complete project audit.

To display individual tests in Graph Ops, run your suite with a JUnit report at .factory/test-reports/pytest.xml (for example, python -m pytest --junitxml=.factory/test-reports/pytest.xml). The local Studio reads the report and labels its candidate binding UNBOUND; it does not infer that those results still apply after source changes.

The prior snapshot's repository self-audit receipt records A (97.9/100) and 1,055/1,085 functions attributed to test intent (97.24%). That static measurement applies to its recorded source digest and is describes static test-intent attribution for that snapshot.

ForgeLine 0.10.8 computes Python complexity for public module functions and public class methods in its recorded metrics.scope.code_files; names starting with _ are excluded. Its AST metric counts branches, boolean alternatives, exception handlers, with, and assertions. Ruff C901 uses a different McCabe metric and also checks private functions. CI therefore runs python -m ruff check --select C901 factoryline tests separately at limit 10. The ForgeLine maximum must not be read as the maximum of every Python function. CI also checks action and reusable workflow references for immutable commit pins; the generic workflow evidence validator alone does not inspect those refs.

Release controls

Candidate preflight requires release-cadence admission and strict architecture health. Protected main requires CI and a separate specialty AI source review; the coordinator records that assessment, separately from test evidence. It is not a second human approval. Provider publication and marketplace approval are separate outcomes. See release channels.

Architecture health checks growth budgets. ForgeLine's repository inventory and feature QA are separate checks. The current gap review records historical parser behavior. CF requires ForgeLine 0.10.8 and checks real MJS, TS, and TSX feature QA during factory doctor --strict. Static signals are neither executed coverage nor a security certification.

More detail

• Engineering review workflow
• GitHub Proof Review
• Commercial availability and limits
• Audit condition inventory
• Runtime assurance limits
• Release channels and publication evidence
• Changelog
• Documentation index

Updated video preview

60-second CF/FL audit and repair walkthrough — October 8, 2026. Silent captions, current Graph Ops captures, bounded scanner improvements and agent repair evidence requirements. The source render is in videos/code-factory-proof-of-survival/remotion.

Earlier native agent-harness preview

The examples below describe the earlier 0.48.1 development preview.

The native harness keeps incident checkpoints for recovery, binds review context shards to source, and compares candidate repairs without applying them. Budgeted Jev triage keeps unprocessed incidents visible as pending, not assessed. Parallel audits are opt-in and require a signed policy declaring work non-mutating and resource-safe; serial remains the default, and the declaration does not prove isolation. Optional activation experiments call only hooks explicitly registered by the caller. Their observations are experimental, not model certification or accuracy evidence. The source taxonomy and manifest define the same routes for Junie while keeping execution and identity limits visible.

Native scanner changes introduced in core 0.49.0

Fixed: native scanner controls require vulnerable and safe results bound to image, profile and source hashes. Missing evidence remains incomplete. Test-intent auditing recognizes argument/await assertions, expected-exception failure checks and invoked local assertion helpers. Direct local serialization round-trips in tests retain informational findings and custom-reducer warnings. Changed: agents use one factory scan --deep overview and explicitly configured native workers selected for the project's languages and risks. JavaScript/Actions workers verify bundled compiled queries rather than rebuilding them, and receipt discovery skips explicit file checks for unrelated logs. Added: CodeQL JavaScript/TypeScript interprocedural analysis, GitHub Actions security-extended analysis, and ten Python/JavaScript/TypeScript Semgrep rules including local taint tracking. CodeQL controls require native flow evidence; Semgrep community output does not establish cross-file coverage. The external-source regression corpus includes upstream cases from requests, Rich and Click. These source fixtures exercise supported regression cases; runtime verification remains a separate step.

Code Factory is a robust code audit factory with Production/Stable package metadata. This source preview does not establish new marketplace publication, runtime verification of every repository, or measured detection accuracy.

Smaller models, stronger quality workflows

CF/FL is designed to guide smaller LLMs toward frontier-like coding performance through deterministic workflows, independent audits and evidence-driven repair. Sealed task packets keep requirements, scope and acceptance checks explicit. This is the design objective; model parity and cost savings require a paired benchmark and are not established by the current attribution metric.