benchflow SKILL.md skillA

benchflow from benchflow-ai/benchflow is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add benchflow-ai/benchflow/benchflow@git:20260920.6b99a10

Pins git:20260920.6b99a10 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
benchflow-ai/benchflow
Path
.agents/skills/benchflow/SKILL.md
Versions recorded
5
Latest version
git:20260920.6b99a10, committed Sep 20, 2026
First version recorded
Jun 15, 2026
Size
7,679 bytes
Repository stars
359
License
Apache-2.0

Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an AI coding agent, run a benchmark suite, create tasks, view trajectories, or compare agent performance.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# BenchFlow — Agent Benchmarking

BenchFlow runs AI coding agents against tasks in sandboxed environments and
scores their output via ACP (Agent Communication Protocol).

Arguments passed: `$ARGUMENTS`

---

## Dispatch on arguments

### No args or `status` — show current state

1. Check if benchflow is installed: `uv tool list | grep benchflow`
2. Check if API keys are set (GEMINI_API_KEY, ANTHROPIC_API_KEY, etc.)
3. Check available agents: `bench agent list`
4. Show recent eval results if any exist under `jobs/` (the default `--jobs-dir`)
5. Point to next action based on state

### `run <task-path>` — run a single task

```bash
bench eval run \
  --tasks-dir <task-path> \
  --agent gemini \
  --model gemini-3.1-flash-lite-preview \
  --sandbox daytona
```

Or via Python SDK:
```python
import asyncio
import benchflow as bf
from benchflow import RolloutConfig, Scene
from benchflow._utils.benchmark_repos import resolve_source

async def main():
    config = RolloutConfig(
        task_path=resolve_source("benchflow-ai/skillsbench", path="tasks/edit-pdf"),
        scenes=[Scene.single(agent="gemini", model="gemini-3.1-flash-lite-preview")],
        environment="daytona",
    )
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add benchflow-ai/benchflow/benchflow@sha256:a03940e5eeaf1487

The line at the top of this page pins the label git:20260920.6b99a10, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_vdr3cr7o5cpln246.svg)](https://markdownregistry.com/a/art_vdr3cr7o5cpln246)

4 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 5 versions of this file, between Jun 15, 2026 and Sep 20, 2026, about one every 24 days.

versioncommittedcommitsizeaudit
git:20260920.6b99a10 latest2026-09-20 6b99a10 7,679 BA view · diff
git:20260710.2c120e02026-07-10 2c120e0 7,569 BA view · diff
git:20260706.2ea084b2026-07-06 2ea084b 7,612 BA view · diff
git:20260616.e2e4abf2026-06-16 e2e4abf 7,622 BA view · diff
git:20260615.17f2a622026-06-15 17f2a62 7,637 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (7679 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

benchflow-ai/benchflow · 359 stars · license Apache-2.0 · pushed 2026-10-30 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_vdr3cr7o5cpln246
GET https://markdownregistry.com/api/v1/resolve?ref=benchflow-ai/benchflow/benchflow
GET https://markdownregistry.com/api/v1/blob/a03940e5eeaf1487a3cd20660553df85d7ab46d69ed12a5b471471e6048ed9d4

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from benchflow-ai/benchflow

benchflow-experiment-review SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow-experiment-review/SKILL.md · Review Benchflow or SkillsBench task-run trajectories and integration-test Benchflow code changes. Use this skill…
git:20260822.656ec91 · audit A · 359 stars
benchflow-traj-upload-ops SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow-traj-upload-ops/SKILL.md · Operate, test, troubleshoot, and explain `bench traj upload` for public or trusted-direct trajectory contributions…
git:20260816.b67af9e · audit A · 359 stars
benchflow-traj-upload SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow-traj-upload/SKILL.md · Find a local Claude Code or Codex session, open the BenchFlow trajectory viewer, and submit it after the user reviews…
git:20260816.96b1e65 · audit A · 359 stars
benchflow SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow/tasks/benchflow-knowledge/environment/benchflow/SKILL.md · Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an…
git:20260706.2ea084b · audit A · 359 stars
benchflow SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow/tasks/create-simple-task/environment/benchflow/SKILL.md · Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an…
git:20260706.2ea084b · audit A · 359 stars
skill-creator SKILL.md skill
benchflow-ai/benchflow · .agents/skills/skill-creator/SKILL.md · Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a…
git:20260816.6398f31 · audit A · 359 stars
task-creator SKILL.md skill
benchflow-ai/benchflow · .agents/skills/task-creator/SKILL.md · SkillsBench task authoring — walk a contributor from idea to submission-ready task following CONTRIBUTING.md and the…
git:20260815.898de30 · audit A · 359 stars
task-review SKILL.md skill
benchflow-ai/benchflow · .agents/skills/task-review/SKILL.md · SkillsBench task PR review — classifies the task track (standard / research / multimodal), runs static policy checks…
git:20260815.898de30 · audit A · 359 stars
thermo-nuclear-code-quality-review SKILL.md skill
benchflow-ai/benchflow · .agents/skills/thermo-nuclear-code-quality-review/SKILL.md · Run an extremely strict maintainability review for abstraction quality, giant files, and spaghetti-condition growth…
git:20260815.898de30 · audit A · 359 stars
AGENTS.md AGENTS.md file
benchflow-ai/benchflow · AGENTS.md
git:20260816.6398f31 · audit A · 359 stars
CLAUDE.md CLAUDE.md file
benchflow-ai/benchflow · CLAUDE.md
git:20260515.7f58eb1 · audit B · 359 stars
independent-review SKILL.md skill
benchflow-ai/benchflow · benchmarks/followup-bench/SKILL.md · Incorporate feedback from an independent code reviewer to improve your solution. The reviewer is a different agent that…
git:20260420.eb5b1af · audit A · 359 stars

Every file in benchflow-ai/benchflow

Other files named benchflow

benchflow SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow/tasks/create-simple-task/environment/benchflow/SKILL.md · Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an…
git:20260706.2ea084b · audit A · 359 stars
benchflow SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow/tasks/benchflow-knowledge/environment/benchflow/SKILL.md · Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an…
git:20260706.2ea084b · audit A · 359 stars

Browse by kind, by grade A, or by owner.