eval-compare SKILL.md skillA
eval-compare from xsyetopz/dotclaude is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.
mdr add xsyetopz/dotclaude/eval-compare@git:20261016.cf14a26Pins git:20261016.cf14a26 in mdr.lock. Pin the fingerprint instead.
- Audit grade
- A, 17 of 17 checks passed
- Kind
- SKILL.md skill
- Repository
- xsyetopz/dotclaude
- Path
plugins/claudetto-lab/skills/eval-compare/SKILL.md- Versions recorded
- 1
- Latest version
- git:20261016.cf14a26, committed Oct 16, 2026
- Size
- 2,122 bytes
- Repository stars
- 3
- License
- MIT
Compares the eval scores of two plugin folders, such as a plugin and a variant of it. Use when the user wants to know whether a change to a plugin raises or lowers its eval score.
Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.
What the file says
<task> Compare the eval scores of two plugin folders for the user. </task> <procedure> Each run costs money and takes minutes, so confirm the two folders with the user before the run. 1. Find the two plugin folders. Each one has a `.claude-plugin/plugin.json` file and an `evals/` folder. If the user names a git ref instead of a folder, ask for a folder, or tell the user to check out the ref in a `git worktree`, because the command reads folders and not refs. 2. Run the comparison: ```bash claudetto-eval-compare A B ``` Replace `A` and `B` with the two folders. Add `claude plugin eval` options after them when the user asks for them. The command adds `--max-cost-usd 5` for each run when the options set no bound. The command adds no `--scaffold` and no `--allow-tools`, because they run the scripts and the tools of the suite as the user. If the cases need them, ask the user before you add them, and name the folders whose suites will run. The skill grants no tool, so Claude Code asks the user before each run. If a run stops at the cost bound, tell the user, and do not raise the bound without the user. 3. Read the two result tables. …
Read the whole file at its exact version.
How to install
mdr add xsyetopz/dotclaude/eval-compare@sha256:b25a85ddbf0c7aa1The line at the top of this page pins the label git:20261016.cf14a26, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.
[](https://markdownregistry.com/a/art_l24jvpcocrm5p7yz)
2 badge image fetches in 30 days. What the badge shows.
Versions
The registry has recorded 1 version of this file, committed on Oct 16, 2026.
Audit of the latest version
- pass: Frontmatter block present
- pass: Frontmatter declares a name
- pass: Frontmatter declares a description
- pass: Size between 200 bytes and 200 KB (2122 bytes)
- pass: No zero-width or bidi control characters
- pass: No instruction hidden inside an HTML comment
- pass: No link to an exfiltration or paste host
- pass: No credential-shaped string
- pass: No instruction to send local credentials anywhere
- pass: No text hidden with inline styles
- pass: No prompt-injection phrasing
- pass: No curl or wget piped into a shell
- pass: No recursive delete of root, home or parent
- pass: No instruction to read or print local credentials
- pass: No base64 blob over 200 characters
- pass: No link to a raw IP address
- pass: No script tag
Source
xsyetopz/dotclaude · 3 stars · license MIT · pushed 2026-10-19 · branch main
API
GET https://markdownregistry.com/api/v1/artifacts/art_l24jvpcocrm5p7yz GET https://markdownregistry.com/api/v1/resolve?ref=xsyetopz/dotclaude/eval-compare GET https://markdownregistry.com/api/v1/blob/b25a85ddbf0c7aa19e378b52c9fb2a90022331b1c7d13910694f8f5e6756d9e1
Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.
Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.
More from xsyetopz/dotclaude
Every file in xsyetopz/dotclaude