eval-harness SKILL.md skillA

eval-harness from affaan-m/ecc is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add affaan-m/ecc/eval-harness@git:20260918.c752aac

Pins git:20260918.c752aac in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
affaan-m/ecc
Path
.agents/skills/eval-harness/SKILL.md
Versions recorded
4
Latest version
git:20260918.c752aac, committed Sep 18, 2026
First version recorded
Feb 25, 2026
Size
5,610 bytes
Repository stars
284,510
License
MIT

Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles. Use when a Claude Code workflow needs a formal eval before it is trusted or changed.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Eval Harness Skill

A formal evaluation framework for Claude Code sessions, implementing eval-driven development (EDD) principles.

## When to Activate

- Setting up eval-driven development (EDD) for AI-assisted workflows
- Defining pass/fail criteria for Claude Code task completion
- Measuring agent reliability with pass@k metrics
- Creating regression test suites for prompt or agent changes
- Benchmarking agent performance across model versions

## Philosophy

Eval-Driven Development treats evals as the "unit tests of AI development":
- Define expected behavior BEFORE implementation
- Run evals continuously during development
- Track regressions with each change
- Use pass@k metrics for reliability measurement

## Eval Types

### Capability Evals
Test if Claude can do something it couldn't before:
```markdown
[CAPABILITY EVAL: feature-name]
Task: Description of what Claude should accomplish
Success Criteria:
  - [ ] Criterion 1
  - [ ] Criterion 2
  - [ ] Criterion 3
Expected Output: Description of expected result
```

### Regression Evals
Ensure changes don't break existing functionality:
```markdown
[REGRESSION EVAL: feature-name]
Baseline: SHA or checkpoint name
Tests:
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add affaan-m/ecc/eval-harness@sha256:49a5a10975860bb2

The line at the top of this page pins the label git:20260918.c752aac, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_2w42hvwfjz54rcvv.svg)](https://markdownregistry.com/a/art_2w42hvwfjz54rcvv)

6 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 4 versions of this file, between Feb 25, 2026 and Sep 18, 2026, about one every 68 days.

versioncommittedcommitsizeaudit
git:20260918.c752aac latest2026-09-18 c752aac 5,610 BA view · diff
git:20260812.d29cf652026-08-12 d29cf65 5,597 BA view · diff
git:20260429.d89f8d82026-04-29 d89f8d8 5,511 BA view · diff
git:20260225.d70bab82026-02-25 d70bab8 5,515 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (5610 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

affaan-m/ecc · 284,510 stars · license MIT · pushed 2026-10-20 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_2w42hvwfjz54rcvv
GET https://markdownregistry.com/api/v1/resolve?ref=affaan-m/ecc/eval-harness
GET https://markdownregistry.com/api/v1/blob/49a5a10975860bb2d7e3c4e260ff19b6580e43f5fbc7770b32dece02dde48e49

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from affaan-m/ecc

agent-introspection-debugging SKILL.md skill
affaan-m/ecc · .agents/skills/agent-introspection-debugging/SKILL.md · Structured self-debugging workflow for AI agent failures using capture, diagnosis, contained recovery, and…
git:20260918.c752aac · audit A · 284,510 stars
agent-sort SKILL.md skill
affaan-m/ecc · .agents/skills/agent-sort/SKILL.md · Build an evidence-backed ECC install plan for a specific repo by sorting skills, commands, rules, hooks, and extras…
git:20260918.c752aac · audit A · 284,510 stars
api-design SKILL.md skill
affaan-m/ecc · .agents/skills/api-design/SKILL.md · REST API design patterns including resource naming, status codes, pagination, filtering, error responses, versioning…
git:20260918.c752aac · audit A · 284,510 stars
article-writing SKILL.md skill
affaan-m/ecc · .agents/skills/article-writing/SKILL.md · Write articles, guides, blog posts, tutorials, newsletter issues, and other long-form content in a distinctive voice…
git:20260918.c752aac · audit A · 284,510 stars
backend-patterns SKILL.md skill
affaan-m/ecc · .agents/skills/backend-patterns/SKILL.md · Backend architecture patterns, API design, database optimization, and server-side best practices for Node.js, Express…
git:20260918.c752aac · audit A · 284,510 stars
benchmark-methodology SKILL.md skill
affaan-m/ecc · .agents/skills/benchmark-methodology/SKILL.md · Use after competitive-platform-analysis has produced a tiered competitor set. Scores each competitor across nine…
git:20260918.c752aac · audit A · 284,510 stars
brand-discovery SKILL.md skill
affaan-m/ecc · .agents/skills/brand-discovery/SKILL.md · Use when a brand needs to discover or articulate its identity through structured multi-session interviews. Covers…
git:20260918.c752aac · audit A · 284,510 stars
brand-voice SKILL.md skill
affaan-m/ecc · .agents/skills/brand-voice/SKILL.md · Build a source-derived writing style profile from real posts, essays, launch notes, docs, or site copy, then reuse that…
git:20260918.c752aac · audit A · 284,510 stars
bun-runtime SKILL.md skill
affaan-m/ecc · .agents/skills/bun-runtime/SKILL.md · Bun as runtime, package manager, bundler, and test runner. When to choose Bun vs Node, migration notes, and Vercel…
git:20260928.48decd0 · audit B · 284,510 stars
change-impact SKILL.md skill
affaan-m/ecc · .agents/skills/change-impact/SKILL.md · Perform evidence-backed impact analysis before changing code, data, interfaces, or governance documents, then compare…
git:20261002.4f08958 · audit A · 284,510 stars
coding-standards SKILL.md skill
affaan-m/ecc · .agents/skills/coding-standards/SKILL.md · Baseline cross-project coding conventions for naming, readability, immutability, and code-quality review. Use detailed…
git:20260918.c752aac · audit A · 284,510 stars
competitive-platform-analysis SKILL.md skill
affaan-m/ecc · .agents/skills/competitive-platform-analysis/SKILL.md · Use when scoping a competitive landscape — identifying, categorising, and score-filtering a competitor set before any…
git:20260918.c752aac · audit A · 284,510 stars

Every file in affaan-m/ecc

Other files named eval-harness

eval-harness SKILL.md skill
affaan-m/ecc · docs/es/skills/eval-harness/SKILL.md · Framework formal de evaluación para sesiones de Claude Code que implementa principios de desarrollo orientado a evals…
git:20260607.ac0f11c · audit A · 284,510 stars
eval-harness SKILL.md skill
a5c-ai/babysitter · library/methodologies/everything-claude-code/skills/eval-harness/SKILL.md · Evaluation harness for testing agent and skill quality through structured benchmarks, regression tests, and quality…
git:20260601.da7723a · audit A · 1,862 stars
eval-harness SKILL.md skill
hashgraph-online/awesome-codex-plugins · plugins/Colin4k1024/tsp/skills/eval-harness/SKILL.md · 正式评估框架,实现 eval-driven development (EDD) 原则。 用于定义 pass/fail 标准、测量 pass@k 指标、创建回归测试套件。
git:20260512.6523792 · audit A · 1,352 stars
eval-harness SKILL.md skill
jikig-ai/soleur · plugins/soleur/skills/eval-harness/SKILL.md · This skill provides a promptfoo eval harness that measures whether a Soleur skill or agent edit actually improves…
git:20261003.57e28a5 · audit A · 19 stars
eval-harness SKILL.md skill
miaodx/roboclaws · skills/eval-harness/SKILL.md · Select and run Roboclaws validation, product, eval-suite, and live-agent eval rows from a plan, diff, or explicit…
git:20260928.2b353eb · audit A · 6 stars

Browse by kind, by grade A, or by owner.