Eval-Driven Skill Design SKILL.md skillA
Eval-Driven Skill Design from s977043/river-review is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.
mdr add s977043/river-review/Eval-Driven Skill Design@v0.2.0Pins v0.2.0 in mdr.lock. Pin the fingerprint instead.
- Audit grade
- A, 17 of 17 checks passed
- Kind
- SKILL.md skill
- Repository
- s977043/river-review
- Path
skills/upstream/eval-driven-skill-design/SKILL.md- Versions recorded
- 4
- Latest version
- v0.2.0, committed Oct 5, 2026
- First version recorded
- Jun 29, 2026
- Size
- 10,625 bytes
- Repository stars
- 7
- License
- MIT
新規・変更 skill の fixture/eval と、WITH/WITHOUT の paired ablation による限界寄与の評価可能性を確認し、activation と effectiveness を分離して案内する。.
Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.
What the file says
## Pattern declaration
Primary pattern: Reviewer
Secondary patterns: Tool Wrapper
Why: skill 追加・重要変更時に happy-path / guard fixture、eval 配線、paired ablation の評価可能性を診断し、存在・発火と実効性を混同しないための educator スキル。fixture-only / docs-only PR では起動しない。
## Goal / 目的
- 新規 `skills/**/SKILL.md` を追加する PR が **検出ケース (happy-path) と抑制ケース (guard) のペア** を fixture として持つことを確認する。
- `eval/promptfoo.yaml` 相当の評価設定または `tests/fixtures/repo-wide-eval/` への登録が用意されているかを確認する。
- 欠けている場合は `npm run eval:fixtures` / `npm run eval:repo-context` をどう通すかを案内する。
- 新規・重要変更された skill について、同じ case / runtime / model / effort で **WITH skill と WITHOUT skill（または旧版 baseline と candidate）** を比較できるか確認する。
- `installed` / `selected` / `fired` を effectiveness の証拠にせず、寄与が不明なら `INCONCLUSIVE` として追加 Evidence を要求する。
## Guidance
### Eval cycle 全体像 (#688 で整備済)
```text
new SKILL.md
├─ fixtures/
│ ├─ <NN>-happy.md # 検出されるべき diff（必須 1 件以上）
│ └─ <NN>-guard.md # 検出してはいけない diff（必須 1 件以上）
├─ golden/<NN>-*.md # promptfoo similar 評価用の代表出力
├─ prompt/{system,user}.md # promptfoo prompts:
└─ eval/promptfoo.yaml # contains / not-contains / llm-rubric / similar
```
…Read the whole file at its exact version.
How to install
mdr add s977043/river-review/Eval-Driven Skill Design@sha256:3b7b2f9197c0f37bThe line at the top of this page pins the label v0.2.0, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.
[](https://markdownregistry.com/a/art_6zd3gzqqp4wazgue)
4 badge image fetches in 30 days. What the badge shows.
Versions
The registry has recorded 4 versions of this file, between Jun 29, 2026 and Oct 5, 2026, about one every 33 days.
| version | committed | commit | size | audit | |
|---|---|---|---|---|---|
| v0.2.0 latest | 2026-10-05 | 4277a1a | 10,625 B | A | view · diff |
| v0.1.0 | 2026-07-01 | 3696771 | 7,702 B | A | view · diff |
| v0.1.0 | 2026-06-29 | 45e66bc | 7,719 B | A | view · diff |
| v0.1.0 | 2026-06-29 | b988700 | 7,735 B | A | view |
Audit of the latest version
- pass: Frontmatter block present
- pass: Frontmatter declares a name
- pass: Frontmatter declares a description
- pass: Size between 200 bytes and 200 KB (10625 bytes)
- pass: No zero-width or bidi control characters
- pass: No instruction hidden inside an HTML comment
- pass: No link to an exfiltration or paste host
- pass: No credential-shaped string
- pass: No instruction to send local credentials anywhere
- pass: No text hidden with inline styles
- pass: No prompt-injection phrasing
- pass: No curl or wget piped into a shell
- pass: No recursive delete of root, home or parent
- pass: No instruction to read or print local credentials
- pass: No base64 blob over 200 characters
- pass: No link to a raw IP address
- pass: No script tag
Source
s977043/river-review · 7 stars · license MIT · pushed 2026-11-08 · branch main
API
GET https://markdownregistry.com/api/v1/artifacts/art_6zd3gzqqp4wazgue GET https://markdownregistry.com/api/v1/resolve?ref=s977043/river-review/Eval-Driven Skill Design GET https://markdownregistry.com/api/v1/blob/3b7b2f9197c0f37bcb720bc361ba4e95ec214c15f92f59c01ca17b63d6a69c3d
Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.
Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.