reproduce-benchmark SKILL.md skillA
reproduce-benchmark from pantheon-org/tekhne is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.
mdr add pantheon-org/tekhne/reproduce-benchmark@git:20261002.e6369eePins git:20261002.e6369ee in mdr.lock. Pin the fingerprint instead.
- Audit grade
- A, 17 of 17 checks passed
- Kind
- SKILL.md skill
- Repository
- pantheon-org/tekhne
- Path
skills/documentation/research/reproduce-benchmark/SKILL.md- Versions recorded
- 3
- Latest version
- git:20261002.e6369ee, committed Oct 2, 2026
- First version recorded
- Apr 9, 2026
- Size
- 7,211 bytes
- Repository stars
- 10
- License
- MIT
Reproduce and verify the benchmark claims of a tool or paper already triaged in the research repo. Locates the benchmark harness, runs it, and records verified vs. reported figures in benchmarks/sources/{slug}-repro.md. Triggers: reproduce benchmark, verify claims, run benchmark, check benchmark, benchmark reproduction, verify numbers.
Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.
What the file says
# Reproduce Benchmark
Run a tool's or paper's benchmark harness and record what could and could not be verified.
## When to Use
- User asks to reproduce or verify benchmark claims for a triaged tool or paper
- Following up on a triage or analysis where self-reported metrics need independent verification
- User provides a slug, reference path, or analysis path and says "run the benchmark"
## When Not to Use
- The subject has not yet been triaged — run `triage-tool` or `triage-paper` first
- A repro file already exists in `benchmarks/sources/` — report it and offer to re-run instead
- The benchmark requires live external services or paid APIs that are unavailable — set outcome to `unverified` and document the blocker
## Recommended MCP Servers
If the benchmark harness or reported figures need to be looked up from the original paper, prefer these MCPs over `WebFetch`:
```json
{
"mcpServers": {
"semantic-scholar": {
"type": "stdio",
"command": "uvx",
"args": ["semantic-scholar-fastmcp"]
},
"google-scholar": {
"type": "stdio",
"command": "uvx",
"args": ["google_scholar_mcp_server"]
}
}
}
```
…Read the whole file at its exact version.
How to install
mdr add pantheon-org/tekhne/reproduce-benchmark@sha256:6999e36ab10a0c6bThe line at the top of this page pins the label git:20261002.e6369ee, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.
[](https://markdownregistry.com/a/art_w3xm5dfexjuwjs4s)
1 badge image fetches in 30 days. What the badge shows.
Versions
The registry has recorded 3 versions of this file, between Apr 9, 2026 and Oct 2, 2026, about one every 88 days.
| version | committed | commit | size | audit | |
|---|---|---|---|---|---|
| git:20261002.e6369ee latest | 2026-10-02 | e6369ee | 7,211 B | A | view · diff |
| git:20260409.2b689ef | 2026-04-09 | 2b689ef | 6,848 B | A | view · diff |
| git:20260409.90aa06b | 2026-04-09 | 90aa06b | 6,365 B | A | view |
Audit of the latest version
- pass: Frontmatter block present
- pass: Frontmatter declares a name
- pass: Frontmatter declares a description
- pass: Size between 200 bytes and 200 KB (7211 bytes)
- pass: No zero-width or bidi control characters
- pass: No instruction hidden inside an HTML comment
- pass: No link to an exfiltration or paste host
- pass: No credential-shaped string
- pass: No instruction to send local credentials anywhere
- pass: No text hidden with inline styles
- pass: No prompt-injection phrasing
- pass: No curl or wget piped into a shell
- pass: No recursive delete of root, home or parent
- pass: No instruction to read or print local credentials
- pass: No base64 blob over 200 characters
- pass: No link to a raw IP address
- pass: No script tag
Source
pantheon-org/tekhne · 10 stars · license MIT · pushed 2026-10-21 · branch main
API
GET https://markdownregistry.com/api/v1/artifacts/art_w3xm5dfexjuwjs4s GET https://markdownregistry.com/api/v1/resolve?ref=pantheon-org/tekhne/reproduce-benchmark GET https://markdownregistry.com/api/v1/blob/6999e36ab10a0c6bae38a190dcecc3c5890b0efed38359a4bed12ba354a67358
Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.
Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.