benchmark-paper-template SKILL.md skillA

This file is byte-identical to the first copy the registry indexed, one of 4 indexed copies. Same content hash, so the same checks give both the same grade.

benchmark-paper-template from hkustdial/supervisor-skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add hkustdial/supervisor-skills/benchmark-paper-template@git:20260704.6800d4d

Pins git:20260704.6800d4d in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
hkustdial/supervisor-skills
Path
skills/benchmark-paper-template/SKILL.md
Versions recorded
1
Latest version
git:20260704.6800d4d, committed Jul 4, 2026
Size
11,184 bytes
Repository stars
12,931
License
a license file GitHub does not identify

Structures Benchmark and Evaluation papers using the five-pillar framework (Research Gap, Construction Pipeline, Evaluation Framework, Empirical Findings, optional Companion Method). Returns a completeness audit, a six-part Introduction logic chain, a Section 2-7 skeleton, and a pre-submission checklist. Use when writing a benchmark paper, structuring a benchmark paper, checking whether a benchmark idea is substantive, drafting a benchmark Introduction, or planning the data-construction…

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Benchmark Paper Template

## Overview

A Benchmark paper does not win by proposing a new algorithm. It wins by defining a new evaluation dimension and shipping a construction pipeline that makes the measurement high-quality, scalable, and reproducible. This skill scaffolds the five pillars a reviewer checks, then gives you a six-part Introduction chain, a Section 2-7 skeleton, and a pre-submission checklist. Stage-specific depth lives in seven reference files under `references/`.

## Core capabilities

1. **Five-pillar completeness audit**: is the Research Gap articulated? Is the Construction Pipeline principled? Is the Evaluation Framework fine-grained? Do the Empirical Findings reveal capability boundaries? Is a Companion Method warranted?
2. **Introduction six-part logic chain**: Background + Running Example, Existing-Benchmark Limitations (no more than three), Research Questions, Design Considerations, Our Proposal, Contributions.
3. **Section skeleton for §2 to §7**: Task and Design Goals, Construction Pipeline, Optional Companion Method, Experiments organized by RQ, Discussion and Research Opportunities, Related Work with benchmark comparison table, Conclusion.
…

Read the whole file at its exact version.

How to install

No tool to install first
claude plugin marketplace add https://markdownregistry.com/mp/a/art_rawypxmqb2iia2yk/daa63e695d0dccd317517b90b92d0f7e3f1f67f104ee5971ad6e9b5c120d3095.json

Then /plugin install benchmark-paper-template@markdownregistry-rawypxmqb2iia2yk in Claude Code. It installs git:20260704.6800d4d, the one graded A here, pinned to the commit it was graded at, and leaves it there.

The exact contents, by fingerprint
mdr add hkustdial/supervisor-skills/benchmark-paper-template@sha256:daa63e695d0dccd3

The line at the top of this page pins the label git:20260704.6800d4d, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_rawypxmqb2iia2yk.svg)](https://markdownregistry.com/a/art_rawypxmqb2iia2yk)

2 badge image fetches in 30 days. What the badge shows.

Ask from your agent
claude mcp add --transport http markdownregistry https://markdownregistry.com/mcp/registry

Then ask it: what changed in hkustdial/supervisor-skills/benchmark-paper-template since the version I have? It reads every saved version here, no key and no account. Any agent that speaks MCP can add it.

Got a copy of benchmark-paper-template from somewhere else? Ask it: where did my benchmark-paper-template come from, and what was changed? It names the public original, the version yours is closest to and every changed line. The text is not kept.

Versions

The registry has recorded 1 version of this file, committed on Jul 4, 2026.

Watch this file (sign in, one email per new version)

versioncommittedcommitsizeaudit
git:20260704.6800d4d latest2026-07-04 6800d4d 11,184 BA view

Copies

Copies in other repositories

3 files in 1 other repository hold the exact bytes of one of this file's versions, each committed after this file had them: all of them hold the newest version.

A copy does not update when this file does. Whoever holds one can learn which version it is with the Check your copy box below, or by asking their agent. Matched on exact bytes and commit dates only.

Keep it current by itself, install once

Committed this skill to a repository? Install the markdownregistry skill updates app on it, or on all of them. When the registry saves a newer version, a pull request brings your copy to it within minutes, the newest version first, then what changed and any check it newly trips. A copy you edited is never touched, and nothing is deleted.

Install on GitHub

It asks to read and write contents and pull requests, and to read metadata. No workflow file, no Actions setting, nothing runs on your runners. Uninstall it and everything the registry kept about your repository is deleted.

Keep it current by itself

Committed this skill to a repository? Add one workflow file, and when a newer version is saved, a pull request brings your copy to it, the newest version first, then what changed and any check it newly trips. A copy you edited is never touched, and nothing is deleted.

mkdir -p .github/workflows && curl -fsSL https://markdownregistry.com/ci/skill-updates.yml -o .github/workflows/skill-updates.yml

It runs daily on GitHub Actions, no key and no account. Read the workflow before you add it.

Check a whole project

From the root of your project, one line hashes each installed skill's SKILL.md, your AGENTS.md and your CLAUDE.md, and asks the registry once. Only the fingerprints and paths are sent.

sha256sum .claude/skills/*/SKILL.md AGENTS.md CLAUDE.md | curl -s --data-binary @- https://markdownregistry.com/api/v1/check-copies

In CI, add --fail-with-body: the answer is 409 when any file is behind, so the step fails and still prints which files.

sha256sum .claude/skills/*/SKILL.md AGENTS.md CLAUDE.md | curl -s --fail-with-body --data-binary @- https://markdownregistry.com/api/v1/check-copies

No sha256sum on your machine? shasum -a 256 prints the same lines.

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (11184 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

hkustdial/supervisor-skills · 12,931 stars · license a license file GitHub does not identify · pushed 2026-11-05 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_rawypxmqb2iia2yk
GET https://markdownregistry.com/api/v1/resolve?ref=hkustdial/supervisor-skills/benchmark-paper-template
GET https://markdownregistry.com/api/v1/blob/daa63e695d0dccd317517b90b92d0f7e3f1f67f104ee5971ad6e9b5c120d3095

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from hkustdial/supervisor-skills

llms.txt llms.txt file
hkustdial/supervisor-skills · llms.txt
git:20260716.1bb65a3 · audit A · 12,931 stars
deep-research SKILL.md skill
hkustdial/supervisor-skills · skills/deep-research/SKILL.md · Runs a deep, survey-grade literature investigation on a research topic: freezes research questions, searches from…
git:20260704.6800d4d · audit A · 12,931 stars
drawio-reconstruction SKILL.md skill
hkustdial/supervisor-skills · skills/drawio-reconstruction/SKILL.md · Reconstructs reference images into high-fidelity, editable Draw.io files with rendered previews: native Draw.io…
git:20260716.1bb65a3 · audit A · 12,931 stars
figure-designer SKILL.md skill
hkustdial/supervisor-skills · skills/figure-designer/SKILL.md · Advises on the design of the three core figures in a technical paper: the Motivated Example (Figure 1), the Solution…
git:20260704.6800d4d · audit A · 12,931 stars
idea-evaluator SKILL.md skill
hkustdial/supervisor-skills · skills/idea-evaluator/SKILL.md · Evaluates a preliminary research idea against a five-dimension framework (Higher, Faster, Stronger, Cheaper, Broader)…
git:20260704.6800d4d · audit A · 12,931 stars
intro-drafter SKILL.md skill
hkustdial/supervisor-skills · skills/intro-drafter/SKILL.md · Drafts the Introduction prose for a technical paper, guided internally by a six-paragraph flowchart: background and…
git:20260704.6800d4d · audit A · 12,931 stars
paper-polish SKILL.md skill
hkustdial/supervisor-skills · skills/paper-polish/SKILL.md · Polishes existing academic prose while preserving the author's meaning: grammar and flow repair, tone calibration…
git:20260704.6800d4d · audit A · 12,931 stars
paper-writer SKILL.md skill
hkustdial/supervisor-skills · skills/paper-writer/SKILL.md · Drafts publishable paper prose from the author's own materials, from a single paragraph to a full manuscript, across…
git:20260704.6800d4d · audit A · 12,931 stars
pre-submission-reviewer SKILL.md skill
hkustdial/supervisor-skills · skills/pre-submission-reviewer/SKILL.md · Runs a pre-submission review of a technical paper across five dimensions: macro logic, writing details, English…
git:20260704.6800d4d · audit A · 12,931 stars
rebuttal-guidance SKILL.md skill
hkustdial/supervisor-skills · skills/rebuttal-guidance/SKILL.md · Provides actionable peer-review rebuttal guidance (not full rebuttal prose) using conditional persuasion P(Z|X,Y)…
git:20260905.198c46c · audit A · 12,931 stars
tech-paper-template SKILL.md skill
hkustdial/supervisor-skills · skills/tech-paper-template/SKILL.md · Structures a technical paper's full logical skeleton using a thinking-template table (research background, limitations…
git:20260704.6800d4d · audit A · 12,931 stars
vibe-research-workflow SKILL.md skill
hkustdial/supervisor-skills · skills/vibe-research-workflow/SKILL.md · Guides AI-assisted research across three sub-flows, Vibe Coding, Vibe Figure, and Vibe Writing, with behavioural rules…
git:20260704.6800d4d · audit A · 12,931 stars

Every file in hkustdial/supervisor-skills

Other files named benchmark-paper-template

benchmark-paper-template SKILL.md skill
yichen-zju/claude-for-research · claude/skills/benchmark-paper-template/SKILL.md · Structures Benchmark and Evaluation papers using the five-pillar framework (Research Gap, Construction Pipeline…
git:20261014.9f2a5e0 · audit A · 12 stars
benchmark-paper-template SKILL.md skill
yichen-zju/claude-for-research · skills/benchmark-paper-template/SKILL.md · Structures Benchmark and Evaluation papers using the five-pillar framework (Research Gap, Construction Pipeline…
git:20261001.fde7ef9 · audit A · 12 stars
benchmark-paper-template SKILL.md skill
yichen-zju/claude-for-research · codex/skills/benchmark-paper-template/SKILL.md · Structures Benchmark and Evaluation papers using the five-pillar framework (Research Gap, Construction Pipeline…
git:20261014.9f2a5e0 · audit A · 12 stars

Browse by kind, by grade A, or by owner.