benchflow-experiment-review SKILL.md skillA

benchflow-experiment-review from benchflow-ai/benchflow is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add benchflow-ai/benchflow/benchflow-experiment-review@git:20260822.656ec91

Pins git:20260822.656ec91 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
benchflow-ai/benchflow
Path
.agents/skills/benchflow-experiment-review/SKILL.md
Versions recorded
5
Latest version
git:20260822.656ec91, committed Aug 22, 2026
First version recorded
Jun 15, 2026
Size
16,144 bytes
Repository stars
359
License
Apache-2.0

Review Benchflow or SkillsBench task-run trajectories and integration-test Benchflow code changes. Use this skill whenever the user asks to audit traj health, failed or timed-out runs, healthy pass/fail/timeout status, no-skill leakage, skill loading, reward hacking, verifier isolation, metadata completeness, token usage, timing, Daytona-vs-Docker parity, path/root handling, coverage gaps, Docker/Daytona failures, or release-readiness of benchmark data.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Benchflow Experiment Review

Use this skill to decide whether a Benchflow run trial is clean enough to
publish or whether a Benchflow code change is safe to use for new experiments.
The standard is: a clean sandbox with only task-needed resources, every agent
behavior logged, no verifier leakage, and a final score or healthy failure.

## Portability

This skill is intentionally harness-portable. Install or copy the entire
`benchflow-experiment-review/` directory into the active harness's skill root,
keeping `SKILL.md`, `scripts/`, `references/`, `evals/`, and optional
`agents/` metadata together. Use the same review procedure regardless of
whether the harness loads skills from `.claude/skills`, `.codex/skills`,
OpenHands/Gemini/pi-agent skill roots, or another compatible `SKILL.md`
directory.

## Operating Rule

Do not accept aggregate counts alone. Enumerate the intended matrix by
`task_id`, harness, model, skill mode, trial id, sandbox type, run root, and
source/ref. Mark each slot as healthy, missing, duplicate, stale, or unhealthy.

Healthy run outcomes are:

- `pass`: agent completed and verifier produced a valid score.
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add benchflow-ai/benchflow/benchflow-experiment-review@sha256:fb5fcc4b0728ef0e

The line at the top of this page pins the label git:20260822.656ec91, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_6nrwudujhyoyilxh.svg)](https://markdownregistry.com/a/art_6nrwudujhyoyilxh)

3 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 5 versions of this file, between Jun 15, 2026 and Aug 22, 2026, about one every 17 days.

versioncommittedcommitsizeaudit
git:20260822.656ec91 latest2026-08-22 656ec91 16,144 BA view · diff
git:20260627.bdf797d2026-06-27 bdf797d 15,515 BA view · diff
git:20260627.0d9dc0a2026-06-27 0d9dc0a 15,363 BA view · diff
git:20260621.db462e62026-06-21 db462e6 14,248 BA view · diff
git:20260615.17f2a622026-06-15 17f2a62 12,214 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (16144 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

benchflow-ai/benchflow · 359 stars · license Apache-2.0 · pushed 2026-10-30 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_6nrwudujhyoyilxh
GET https://markdownregistry.com/api/v1/resolve?ref=benchflow-ai/benchflow/benchflow-experiment-review
GET https://markdownregistry.com/api/v1/blob/fb5fcc4b0728ef0efe3155f1627c4fccd16b59ceb67bb1c18bd9ec326d2a0708

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from benchflow-ai/benchflow

benchflow-traj-upload-ops SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow-traj-upload-ops/SKILL.md · Operate, test, troubleshoot, and explain `bench traj upload` for public or trusted-direct trajectory contributions…
git:20260816.b67af9e · audit A · 359 stars
benchflow-traj-upload SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow-traj-upload/SKILL.md · Find a local Claude Code or Codex session, open the BenchFlow trajectory viewer, and submit it after the user reviews…
git:20260816.96b1e65 · audit A · 359 stars
benchflow SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow/SKILL.md · Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an…
git:20260920.6b99a10 · audit A · 359 stars
benchflow SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow/tasks/benchflow-knowledge/environment/benchflow/SKILL.md · Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an…
git:20260706.2ea084b · audit A · 359 stars
benchflow SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow/tasks/create-simple-task/environment/benchflow/SKILL.md · Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an…
git:20260706.2ea084b · audit A · 359 stars
skill-creator SKILL.md skill
benchflow-ai/benchflow · .agents/skills/skill-creator/SKILL.md · Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a…
git:20260816.6398f31 · audit A · 359 stars
task-creator SKILL.md skill
benchflow-ai/benchflow · .agents/skills/task-creator/SKILL.md · SkillsBench task authoring — walk a contributor from idea to submission-ready task following CONTRIBUTING.md and the…
git:20260815.898de30 · audit A · 359 stars
task-review SKILL.md skill
benchflow-ai/benchflow · .agents/skills/task-review/SKILL.md · SkillsBench task PR review — classifies the task track (standard / research / multimodal), runs static policy checks…
git:20260815.898de30 · audit A · 359 stars
thermo-nuclear-code-quality-review SKILL.md skill
benchflow-ai/benchflow · .agents/skills/thermo-nuclear-code-quality-review/SKILL.md · Run an extremely strict maintainability review for abstraction quality, giant files, and spaghetti-condition growth…
git:20260815.898de30 · audit A · 359 stars
AGENTS.md AGENTS.md file
benchflow-ai/benchflow · AGENTS.md
git:20260816.6398f31 · audit A · 359 stars
CLAUDE.md CLAUDE.md file
benchflow-ai/benchflow · CLAUDE.md
git:20260515.7f58eb1 · audit B · 359 stars
independent-review SKILL.md skill
benchflow-ai/benchflow · benchmarks/followup-bench/SKILL.md · Incorporate feedback from an independent code reviewer to improve your solution. The reviewer is a different agent that…
git:20260420.eb5b1af · audit A · 359 stars

Every file in benchflow-ai/benchflow

Browse by kind, by grade A, or by owner.