llm-evaluation-design SKILL.md skillA
llm-evaluation-design from naodeng/awesome-qa-skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.
mdr add naodeng/awesome-qa-skills/llm-evaluation-design@v1.0.0Pins v1.0.0 in mdr.lock. Pin the fingerprint instead.
- Audit grade
- A, 17 of 17 checks passed
- Kind
- SKILL.md skill
- Repository
- naodeng/awesome-qa-skills
- Path
skills/en/testing-types/llm-evaluation-design/SKILL.md- Versions recorded
- 3
- Latest version
- v1.0.0, committed Oct 29, 2026
- First version recorded
- Aug 29, 2026
- Size
- 3,595 bytes
- Repository stars
- 301
- License
- a license file GitHub does not identify
Use this skill when you need to design LLM evaluation datasets, judges, metrics, and human-review boundaries; triggers include llm evaluation design.
Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.
What the file says
# LLM Evaluation Design ## When to Use - Use this skill when you need to design repeatable evaluations for LLM systems across capability, safety, reliability, and business value. - Use it to review an existing plan, result, or evidence set and produce actionable improvements. - Use it when context is incomplete but a bounded first pass is still valuable. ## Output Format Options - Default to Markdown for review, execution, and incremental refinement. - When the user requests tables, CSV, JSON, or ticket fields, preserve risk, evidence, priority, and boundary information. - For machine-consumed output, confirm the schema, enums, and required fields first. ## How to Use 1. Read and follow `prompts/llm-evaluation-design.md`, including its input contract, execution rules, minimum coverage, and output order. 2. Add only context that changes the decision: scope, environment, version, constraints, evidence, and success criteria. 3. Audit the input, then separate confirmed facts, working assumptions, and open questions. 4. Rank by risk and evidence strength, and produce an artifact that can be executed or reviewed directly. …
Read the whole file at its exact version.
How to install
mdr add naodeng/awesome-qa-skills/llm-evaluation-design@sha256:4e0634216269489cThe line at the top of this page pins the label v1.0.0, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.
[](https://markdownregistry.com/a/art_7khe6on2lcc2wrth)
3 badge image fetches in 30 days. What the badge shows.
Versions
The registry has recorded 3 versions of this file, between Aug 29, 2026 and Oct 29, 2026, about one every 30 days.
| version | committed | commit | size | audit | |
|---|---|---|---|---|---|
| v1.0.0 latest | 2026-10-29 | 1d0d58f | 3,595 B | A | view · diff |
| git:20260829.175e380 | 2026-08-29 | 175e380 | 3,289 B | A | view · diff |
| git:20260829.30ae153 | 2026-08-29 | 30ae153 | 354 B | A | view |
Audit of the latest version
- pass: Frontmatter block present
- pass: Frontmatter declares a name
- pass: Frontmatter declares a description
- pass: Size between 200 bytes and 200 KB (3595 bytes)
- pass: No zero-width or bidi control characters
- pass: No instruction hidden inside an HTML comment
- pass: No link to an exfiltration or paste host
- pass: No credential-shaped string
- pass: No instruction to send local credentials anywhere
- pass: No text hidden with inline styles
- pass: No prompt-injection phrasing
- pass: No curl or wget piped into a shell
- pass: No recursive delete of root, home or parent
- pass: No instruction to read or print local credentials
- pass: No base64 blob over 200 characters
- pass: No link to a raw IP address
- pass: No script tag
Source
naodeng/awesome-qa-skills · 301 stars · license a license file GitHub does not identify · pushed 2026-11-06 · branch main
API
GET https://markdownregistry.com/api/v1/artifacts/art_7khe6on2lcc2wrth GET https://markdownregistry.com/api/v1/resolve?ref=naodeng/awesome-qa-skills/llm-evaluation-design GET https://markdownregistry.com/api/v1/blob/4e0634216269489c9096f1a9a6516f115b939d5460b779ec333ab0ee14a76ac8
Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.
Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.