Home / reidemeister94 / development-skills · skills/eval-regression/SKILL.md · GitHub

eval-regression skillA

eval-regression is agent-read markdown (skill) from reidemeister94/development-skills: Check skill routing or behavior, investigate a regression, or compare plugin changes with a base commit..

Indexed from public GitHub and served as immutable, content-addressed versions. Install it pinned to an exact SHA-256 with the mdr CLI, and every file is verified against the hash recorded here before it reaches your agent. The deterministic audit below grades the latest version, and the same file always earns the same grade.

What the file says

# Eval regression

Use deterministic repository tests first. Stop when the target has no behavioral diff.

Resolve the plugin from the argument or cwd. Its catalog is `evals/evals.json`; the runner is `scripts/run_evals.py` in this skill.
Require the user to choose agent, model, and effort. Never select a costly model or high effort silently.

## Normal check

1. Select cases by changed paths with `--changed-from <base>`, or name them with `--case`. Do not select the full catalog implicitly.
2. Run the command without `--run`. The runner prints cases, modes, repeats, sessions, timeout, and maximum duration without starting an agent.
3. An approved plan that names this exact run already authorizes it. For a standalone eval, present the run plan and stop once.
4. After approval, repeat the same command with `--run`. Default to candidate-only, one run per case, 180 seconds, and four sessions maximum.
5. Report every failed assertion, timeout, non-zero exit, duration, and token count. Missing evidence is inconclusive.

## Escalation

- Compare base and candidate only when the user asks, or when a failed candidate check needs a baseline.
…

Read the whole file at its exact version.

How to install

Latest version
mdr add reidemeister94/development-skills/eval-regression@git:20260919.a9f7da5
Exact content
mdr add reidemeister94/development-skills/eval-regression@sha256:9673f8120b24ea4c

Pin to a label to follow the author's releases, or to a sha256 to freeze the exact bytes forever. Either way the resolved hash is written to mdr.lock, and mdr install reproduces it on any machine.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_qubgpqnzdwagjbwe.svg)](https://markdownregistry.com/a/art_qubgpqnzdwagjbwe)

1 badge views in 30 days

Versions

versioncommittedcommitsizeaudit
git:20260919.a9f7da5 latest2026-09-19 a9f7da5 2,298 BA view · diff
git:20260724.ba2c70f2026-07-24 ba2c70f 2,427 BA view · diff
git:20260713.d2107012026-07-13 d210701 1,699 BA view · diff
git:20260617.174aad82026-06-17 174aad8 4,784 BA view · diff
git:20260323.6a51c162026-03-23 6a51c16 11,407 BA view

Audit of the latest version

A  17 of 17 checks passed. Deterministic, no model, same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (2298 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

reidemeister94/development-skills · 12 stars · license MIT · pushed 2026-09-20 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_qubgpqnzdwagjbwe
GET https://markdownregistry.com/api/v1/resolve?ref=reidemeister94/development-skills/eval-regression
GET https://markdownregistry.com/api/v1/blob/9673f8120b24ea4c6c8a77c4f3aabe6e350e4ab00d2ad2d10502d4337ec704a8

Your agent does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

More from reidemeister94/development-skills

AGENTS.md agents
reidemeister94/development-skills · AGENTS.md
git:20260919.a9f7da5 · audit A · 12 stars
CLAUDE.md claude
reidemeister94/development-skills · CLAUDE.md
git:20260517.21d6bf8 · audit B · 12 stars
ai-agent-bench skill
reidemeister94/development-skills · skills/ai-agent-bench/SKILL.md · Compare Claude Code and Codex on the same code task, with isolated worktrees, common checks, time, and cost.
git:20260919.a9f7da5 · audit A · 12 stars
align-docs skill
reidemeister94/development-skills · skills/align-docs/SKILL.md · Align stale repository docs and task records; use --clean for a full documentation cleanup.
git:20260919.a9f7da5 · audit A · 12 stars
best-practices skill
reidemeister94/development-skills · skills/best-practices/SKILL.md · Research current practices or compare approaches using primary evidence and the user's constraints.
git:20260919.a9f7da5 · audit A · 12 stars
brainstorming skill
reidemeister94/development-skills · skills/brainstorming/SKILL.md · Use when the user wants to brainstorm, choose an approach, design something, or clarify an ambiguous or consequential…
git:20260919.a9f7da5 · audit A · 12 stars
bro skill
reidemeister94/development-skills · skills/bro/SKILL.md · Use when the user says an explanation was unclear, too technical, or full of jargon, or asks for plain language.
git:20260919.a9f7da5 · audit A · 12 stars
changelog skill
reidemeister94/development-skills · skills/changelog/SKILL.md · Add CHANGELOG.md entries, derive them from commits, or cut a Keep a Changelog and SemVer release.
git:20260724.ba2c70f · audit A · 12 stars
commit skill
reidemeister94/development-skills · skills/commit/SKILL.md · Create a user-requested Conventional Commit from the staged changes.
git:20260919.a9f7da5 · audit A · 12 stars
create-test skill
reidemeister94/development-skills · skills/create-test/SKILL.md · Define or implement regression proof: test strategy, black-box or integration tests, KPIs, thresholds, audits, or…
git:20260919.a9f7da5 · audit A · 12 stars
explain-diff skill
reidemeister94/development-skills · skills/explain-diff/SKILL.md · Explain a code change, its reasons, effects, trade-offs, and verification limits.
git:20260919.a9f7da5 · audit A · 12 stars
handoff skill
reidemeister94/development-skills · skills/handoff/SKILL.md · Create a self-contained temporary handoff document when the user asks to transfer the session to a new chat or runs…
git:20260919.a9f7da5 · audit A · 12 stars

Every file in reidemeister94/development-skills

Browse by kind, by grade A, or by owner.