benchflow SKILL.md skillA

This file is byte-identical to the first copy the registry indexed. Same content hash, so the same checks give both the same grade.

benchflow from benchflow-ai/benchflow is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add benchflow-ai/benchflow/benchflow@git:20260706.2ea084b

Pins git:20260706.2ea084b in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
benchflow-ai/benchflow
Path
.agents/skills/benchflow/tasks/benchflow-knowledge/environment/benchflow/SKILL.md
Versions recorded
3
Latest version
git:20260706.2ea084b, committed Jul 6, 2026
First version recorded
Jun 15, 2026
Size
5,990 bytes
Repository stars
359
License
Apache-2.0

Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an AI coding agent, run a benchmark suite, create tasks, view trajectories, or compare agent performance.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# BenchFlow — Agent Benchmarking

BenchFlow runs AI coding agents against tasks in sandboxed environments and
scores their output. It combines Harbor (environments, verifier) with ACP
(multi-turn agent communication).

Arguments passed: `$ARGUMENTS`

---

## Dispatch on arguments

### No args or `status` — show current state

1. Check if benchflow is installed: `uv tool list | grep benchflow`
2. Check if `.env` exists with API keys
3. Check available agents: `benchflow agents`
4. Show recent job results if any exist in `jobs/`
5. Point to next action based on state

### `eval run --tasks-dir <task-path>` — run a task

```bash
source .env
bench eval run --tasks-dir <task-path> --agent claude-agent-acp --sandbox daytona --model claude-haiku-4-5-20251001
```

Or via SDK:
```python
import asyncio
from benchflow import SDK

async def main():
    sdk = SDK()
    result = await sdk.run(
        task_path="<task-path>",
        agent="claude-agent-acp",
        model="claude-haiku-4-5-20251001",
        environment="daytona",
    )
    print(f"Reward: {result.rewards}, Tools: {result.n_tool_calls}")

asyncio.run(main())
```
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add benchflow-ai/benchflow/benchflow@sha256:81b2e2b959fd6662

The line at the top of this page pins the label git:20260706.2ea084b, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_sli3f7flbymjephm.svg)](https://markdownregistry.com/a/art_sli3f7flbymjephm)

3 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 3 versions of this file, between Jun 15, 2026 and Jul 6, 2026, about one every 11 days.

versioncommittedcommitsizeaudit
git:20260706.2ea084b latest2026-07-06 2ea084b 5,990 BA view · diff
git:20260616.e2e4abf2026-06-16 e2e4abf 5,962 BA view · diff
git:20260615.17f2a622026-06-15 17f2a62 5,968 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (5990 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

benchflow-ai/benchflow · 359 stars · license Apache-2.0 · pushed 2026-10-30 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_sli3f7flbymjephm
GET https://markdownregistry.com/api/v1/resolve?ref=benchflow-ai/benchflow/benchflow
GET https://markdownregistry.com/api/v1/blob/81b2e2b959fd66620ad51ea0e69a917c263ce865eface0469ef35ef1ffa63590

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from benchflow-ai/benchflow

benchflow-experiment-review SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow-experiment-review/SKILL.md · Review Benchflow or SkillsBench task-run trajectories and integration-test Benchflow code changes. Use this skill…
git:20260822.656ec91 · audit A · 359 stars
benchflow-traj-upload-ops SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow-traj-upload-ops/SKILL.md · Operate, test, troubleshoot, and explain `bench traj upload` for public or trusted-direct trajectory contributions…
git:20260816.b67af9e · audit A · 359 stars
benchflow-traj-upload SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow-traj-upload/SKILL.md · Find a local Claude Code or Codex session, open the BenchFlow trajectory viewer, and submit it after the user reviews…
git:20260816.96b1e65 · audit A · 359 stars
benchflow SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow/SKILL.md · Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an…
git:20260920.6b99a10 · audit A · 359 stars
benchflow SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow/tasks/create-simple-task/environment/benchflow/SKILL.md · Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an…
git:20260706.2ea084b · audit A · 359 stars
skill-creator SKILL.md skill
benchflow-ai/benchflow · .agents/skills/skill-creator/SKILL.md · Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a…
git:20260816.6398f31 · audit A · 359 stars
task-creator SKILL.md skill
benchflow-ai/benchflow · .agents/skills/task-creator/SKILL.md · SkillsBench task authoring — walk a contributor from idea to submission-ready task following CONTRIBUTING.md and the…
git:20260815.898de30 · audit A · 359 stars
task-review SKILL.md skill
benchflow-ai/benchflow · .agents/skills/task-review/SKILL.md · SkillsBench task PR review — classifies the task track (standard / research / multimodal), runs static policy checks…
git:20260815.898de30 · audit A · 359 stars
thermo-nuclear-code-quality-review SKILL.md skill
benchflow-ai/benchflow · .agents/skills/thermo-nuclear-code-quality-review/SKILL.md · Run an extremely strict maintainability review for abstraction quality, giant files, and spaghetti-condition growth…
git:20260815.898de30 · audit A · 359 stars
AGENTS.md AGENTS.md file
benchflow-ai/benchflow · AGENTS.md
git:20260816.6398f31 · audit A · 359 stars
CLAUDE.md CLAUDE.md file
benchflow-ai/benchflow · CLAUDE.md
git:20260515.7f58eb1 · audit B · 359 stars
independent-review SKILL.md skill
benchflow-ai/benchflow · benchmarks/followup-bench/SKILL.md · Incorporate feedback from an independent code reviewer to improve your solution. The reviewer is a different agent that…
git:20260420.eb5b1af · audit A · 359 stars

Every file in benchflow-ai/benchflow

Other files named benchflow

benchflow SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow/tasks/create-simple-task/environment/benchflow/SKILL.md · Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an…
git:20260706.2ea084b · audit A · 359 stars
benchflow SKILL.md skill
benchflow-ai/benchflow · .agents/skills/benchflow/SKILL.md · Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an…
git:20260920.6b99a10 · audit A · 359 stars

Browse by kind, by grade A, or by owner.