This file is byte-identical to the first copy the registry indexed, one of 4 indexed copies. Same content hash, so the same checks give both the same grade.
benchmark-checklist from nightly-labs/openbot is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.
Vet a perf measurement (limiter, tuning, limits, errors, repeatability, relevance, and whether the work happened) before you report or act on it. Use when you run a benchmark or report a speedup or regression you measured.
Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.
What the file says
# Benchmark checklist
Use this when you produce a performance number: a PR's before and after, a regression claim, a hillclimb harness, or a library or config choice. Answer each question with evidence from a run, not a guess about the code.
For a quick ballpark the user asked for, one run is enough. Still check questions 4 and 7, and say that it is one run. Skip the rest unless that run looks wrong. A choice between options is never a ballpark.
## Before you run anything
- Write down the claim you expect to make, in the words you would ship ("export is 30% faster at p50 on the 60k-row dataset"). The questions test that sentence.
- Read the measurement script. Note what it times, counts, and ignores.
- Check the load average with `uptime` and the core count with `nproc`. If the machine is busy, find out what is running. If you cannot stop it, interleave the sides so both see the same noise, and say so in the report.
## The questions
…
The line at the top of this page pins the label git:20261013.9e6954c, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.
A 17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
pass: Frontmatter block present
pass: Frontmatter declares a name
pass: Frontmatter declares a description
pass: Size between 200 bytes and 200 KB (5002 bytes)
pass: No zero-width or bidi control characters
pass: No instruction hidden inside an HTML comment
pass: No link to an exfiltration or paste host
pass: No credential-shaped string
pass: No instruction to send local credentials anywhere
pass: No text hidden with inline styles
pass: No prompt-injection phrasing
pass: No curl or wget piped into a shell
pass: No recursive delete of root, home or parent
pass: No instruction to read or print local credentials
pass: No base64 blob over 200 characters
pass: No link to a raw IP address
pass: No script tag
Source
GitHub
nightly-labs/openbot · 5,267 stars · license a license file GitHub does not identify · pushed 2026-11-04 · branch main
API
GET https://markdownregistry.com/api/v1/artifacts/art_5hxjph5433y5alcr
GET https://markdownregistry.com/api/v1/resolve?ref=nightly-labs/openbot/benchmark-checklist
GET https://markdownregistry.com/api/v1/blob/ba109e96c8f6c1c391baccf19e5d11e14370df7b3f2605e1572cd565a6c0fca0
Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.
nightly-labs/openbot · .agents/skills/babysit/SKILL.md · Babysit a pull request through the NorbiAI review loop until no valid issue remains. Fix valid findings, rebut false…
nightly-labs/openbot · .agents/skills/biome-anti-slop/SKILL.md · Install and configure vendored Biome anti-slop GritQL rules in a local TypeScript or JavaScript repository. Use when a…
nightly-labs/openbot · .agents/skills/prototype/SKILL.md · Build several different design directions (3 by default) for a feature or issue as Storybook stories, show them to the…
nightly-labs/openbot · .agents/skills/release-upgrade-safety/SKILL.md · Audit a pending OpenBot release for upgrade and data-loss hazards before the version is bumped or tagged. Use when…
nightly-labs/openbot · .agents/skills/ship/SKILL.md · Ship the current branch to main. Review the diff, fix findings, open the pull request, babysit the NorbiAI review and…
nightly-labs/openbot · .agents/skills/signal-deploy/SKILL.md · Check and deploy Signal (the `remote-api` service in `remote/`) to production from a release tag. Use when asked to…
nightly-labs/openbot · .agents/skills/smoke-and-ship/SKILL.md · Smoke test the current branch, then ship it to main only when all smoke items pass. Use when the user asks to smoke and…
nightly-labs/openbot · .agents/skills/smoke/SKILL.md · Start one or more local OpenBot dev instances and smoke test the features that the current changes or a pull request…
nightly-labs/openbot · .agents/skills/triage/SKILL.md · Triage one GitHub issue or bug report. Decide if it is valid, find the root cause, and fix it. Push back with evidence…
nightly-labs/openbot · .agents/skills/zaidan/SKILL.md · Install and configure the Zaidan component registry in an existing SolidJS codebase, and recommend Zaidan components…
cursor/plugins · harness/pstack/claude-code/skills/benchmark-checklist/SKILL.md · Vet a perf measurement (limiter, tuning, limits, errors, repeatability, relevance, and whether the work happened)…
cursor/plugins · pstack/skills/benchmark-checklist/SKILL.md · Vet a perf measurement (limiter, tuning, limits, errors, repeatability, relevance, and whether the work happened)…
michael-denyer/pstack-claude · plugins/pstack/skills/benchmark-checklist/SKILL.md · Vet a perf measurement (limiter, tuning, limits, errors, repeatability, relevance, and whether the work happened)…
backnotprop/pstack · skills/benchmark-checklist/SKILL.md · Vet a perf measurement (limiter, tuning, limits, errors, repeatability, relevance, and whether the work happened)…
theonlyfusioncube/potetos-for-everyone · skills/benchmark-checklist/SKILL.md · Vet a perf measurement (limiter, tuning, limits, errors, repeatability, relevance, and whether the work happened)…
creedants/pstack-t3 · skills/benchmark-checklist/SKILL.md · Vet a perf measurement (limiter, tuning, limits, errors, repeatability, relevance, and whether the work happened)…
painhardcore/pstack · skills/benchmark-checklist/SKILL.md · Vet a perf measurement (limiter, tuning, limits, errors, repeatability, relevance, and whether the work happened)…
arjitj2/open-pstack · plugins/pstack/skills/benchmark-checklist/SKILL.md · Vet a perf measurement (limiter, tuning, limits, errors, repeatability, relevance, and whether the work happened)…
