Benchmark Model
modular/skills/benchmark-modelby modularb9b3a8e86700No license200 starsListed Oct 8, 2026Updated Oct 8, 2026Repository updated today
Benchmark a model served on MAX with the `max benchmark` command: measure throughput (tokens/sec), latency (TTFT, TPOT, inter-token latency), and GPU utilization by driving load against a running `max serve` endpoint. Use this whenever the user wants to benchmark, load-test, or measure the performance of a MAX model, get tokens-per-second / TTFT / TPOT numbers, run a concurrency or request-rate sweep, compare latency vs throughput, size a deployment, or produce benchmark JSON, even if they don't say "benchmark" by name. Also use when a `max benchmark` run fails to connect or reports zero/garbage numbers.
Only the file list is public. File contents are available once the skill is installed in a workspace.
| Path | Size | Type |
|---|---|---|
| references/flags.md | 6.3 KB | text/markdown |
| references/metrics.md | 4.4 KB | text/markdown |
| references/troubleshooting.md | 2.4 KB | text/markdown |
| SKILL.md | 8 KB | text/markdown |
Source and attribution
Source:modular/skillsinbenchmark-modelat commitb9b3a8e
License: No license
Content belongs to its original authors. SourceWeft indexes it from a public repository.
More from modular/skills
Mojo Syntax
modular
Guides writing and reviewing Mojo code with current syntax, replacing obsolete pretrained patterns.
New Modular Project
modular
Guides creation of a new Mojo or MAX project, choosing an environment manager and channel.
Mojo Gpu Fundamentals
modular
Teaches how to write Mojo GPU kernels, correcting CUDA-based assumptions about syntax, memory and launches.
More in DevOps & Cloud
Playwright Devops
microsoft
DevOps workflows for Playwright: analyze GitHub Actions failures for the last commit on main and fetch failed job logs.
M5 Onboard
anthropics
Provisions M5Stack ESP32 boards by detecting them on USB, flashing UIFlow 2.0 firmware, and installing a MicroPython app bundle.
Yeet
openai
Stages, commits, pushes, and opens or updates a GitHub pull request in one flow using the GitHub CLI.
Runbook
anthropics
Creates or updates step-by-step operational runbooks for recurring tasks, including troubleshooting, rollback and escalation.
Incident Response
anthropics
Guides an incident response workflow: severity triage, status updates, mitigation tracking, and blameless postmortems.
Deploy Checklist
anthropics
Generates a pre-deployment readiness checklist covering pre-deploy, deploy, post-deploy and rollback triggers.