llm-evaluation SKILL.md skillA

llm-evaluation from nicholas-greenwood/agentic-engineering-skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add nicholas-greenwood/agentic-engineering-skills/llm-evaluation@git:20261027.5707fc6

Pins git:20261027.5707fc6 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
nicholas-greenwood/agentic-engineering-skills
Path
llm-evaluation/SKILL.md
Versions recorded
1
Latest version
git:20261027.5707fc6, committed Oct 27, 2026
Size
3,538 bytes
Repository stars
3
License
MIT

use when evaluating LLMs, prompts or workflows.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

evaluate the production workflow with frozen inputs and saved evidence

use paired arms for comparisons; for a single configuration, apply this workflow against frozen references, omitting comparator and pairing requirements

## choose the runner

search the repository for maintained evaluation runners and current workflow guidance before building another harness; treat archived evaluations as historical evidence

inspect the matching runner's executable entry point, fixtures and scoring, and read any associated protocol before invoking it. reuse or adapt it when it fits; old budgets and release gates do not authorise a new run

## freeze before running

save a short manifest and its artifacts in the task's evidence directory:

- question, evaluated configuration(s), baseline/candidate comparison when applicable, scoring rubric, analysis method, uncertainty handling and decision rule/threshold when applicable
- exact case ids, provenance, references/labels, target cohort, selection criteria/method and repetitions; label captured, synthetic and reconstructed inputs distinctly
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add nicholas-greenwood/agentic-engineering-skills/llm-evaluation@sha256:759419153821de2f

The line at the top of this page pins the label git:20261027.5707fc6, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_tcyaixhhiydv2l4f.svg)](https://markdownregistry.com/a/art_tcyaixhhiydv2l4f)

3 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 1 version of this file, committed on Oct 27, 2026.

versioncommittedcommitsizeaudit
git:20261027.5707fc6 latest2026-10-27 5707fc6 3,538 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (3538 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

nicholas-greenwood/agentic-engineering-skills · 3 stars · license MIT · pushed 2026-11-07 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_tcyaixhhiydv2l4f
GET https://markdownregistry.com/api/v1/resolve?ref=nicholas-greenwood/agentic-engineering-skills/llm-evaluation
GET https://markdownregistry.com/api/v1/blob/759419153821de2f54e2eec10ca59d2ce2e2e696d8e8bc30e118b8128838bee0

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from nicholas-greenwood/agentic-engineering-skills

AGENTS.md AGENTS.md file
nicholas-greenwood/agentic-engineering-skills · AGENTS.md
git:20261027.18c3e07 · audit A · 3 stars
agent-browser-diff SKILL.md skill
nicholas-greenwood/agentic-engineering-skills · agent-browser-diff/SKILL.md · use when you need to verify code changes preserve UI appearance
git:20261029.4ede94a · audit A · 3 stars
ai-code-review-catalog SKILL.md skill
nicholas-greenwood/agentic-engineering-skills · ai-code-review-catalog/SKILL.md · available code reviewers, review prompts and model routing
git:20261105.38b36df · audit A · 3 stars
claude-parallel-writers SKILL.md skill
nicholas-greenwood/agentic-engineering-skills · claude-parallel-writers/SKILL.md · run parallel claude code writers, such as PR owners or dependency workers, as desktop sessions in their own worktrees…
git:20261103.0e28fa2 · audit A · 3 stars
cross-harness-sub-agent SKILL.md skill
nicholas-greenwood/agentic-engineering-skills · cross-harness-sub-agent/SKILL.md · spawn a cross harness sub-agent
git:20261020.a5a8115 · audit A · 3 stars
helper-sub-agents SKILL.md skill
nicholas-greenwood/agentic-engineering-skills · helper-sub-agents/SKILL.md · shared rules for the helper sub-agents an orchestrating skill spawns
git:20261029.d5c74a0 · audit A · 3 stars
loop SKILL.md skill
nicholas-greenwood/agentic-engineering-skills · loop/SKILL.md · deliver a PR through implementation, review and validation rounds
git:20261107.27e854a · audit A · 3 stars
orchestrate-multi-pr-work SKILL.md skill
nicholas-greenwood/agentic-engineering-skills · orchestrate-multi-pr-work/SKILL.md · orchestrate multi-PR work
git:20261107.870f787 · audit A · 3 stars
plan SKILL.md skill
nicholas-greenwood/agentic-engineering-skills · plan/SKILL.md · use when user asks to write a plan or says "chat plan"/"md plan"/"linear plan"
git:20261103.11a0a1b · audit A · 3 stars
pr SKILL.md skill
nicholas-greenwood/agentic-engineering-skills · pr/SKILL.md · use before opening a PR or writing PR description
git:20261107.6259e5b · audit A · 3 stars
propose-refactor SKILL.md skill
nicholas-greenwood/agentic-engineering-skills · propose-refactor/SKILL.md · propose a refactor plan for an area
git:20261105.5786e71 · audit A · 3 stars
record-video SKILL.md skill
nicholas-greenwood/agentic-engineering-skills · record-video/SKILL.md · use when recording browser workflows in our app, external sites, dashboards or prototypes for PRs, evidence…
git:20261024.47ed487 · audit A · 3 stars

Every file in nicholas-greenwood/agentic-engineering-skills

Other files named llm-evaluation

llm-evaluation SKILL.md skill
wshobson/agents · plugins/llm-application-dev/skills/llm-evaluation/SKILL.md · Implement comprehensive evaluation strategies for LLM applications using automated metrics, human feedback, and…
git:20260522.be57c0b · audit A · 42,320 stars
llm-evaluation SKILL.md skill
dicklesworthstone/pi_agent_rust · tests/ext_conformance/artifacts/agents-wshobson/llm-application-dev/skills/llm-evaluation/SKILL.md · Implement comprehensive evaluation strategies for LLM applications using automated metrics, human feedback, and…
git:20260205.788be98 · audit A · 1,966 stars
llm-evaluation SKILL.md skill
hermeticormus/libreuiux-claude-code · plugins/llm-application-dev/skills/llm-evaluation/SKILL.md · Implement comprehensive evaluation strategies for LLM applications using automated metrics, human feedback, and…
git:20251120.288a379 · audit A · 124 stars
llm-evaluation SKILL.md skill
hermeticormus/claude-code-game-development · plugins/llm-application-dev/skills/llm-evaluation/SKILL.md · Implement comprehensive evaluation strategies for LLM applications using automated metrics, human feedback, and…
git:20251120.50bf83d · audit A · 78 stars
llm-evaluation SKILL.md skill
rudycity/superagent · .agents/skills/llm-evaluation/SKILL.md · Implement comprehensive evaluation strategies for LLM applications using automated metrics, human feedback, and…
git:20260626.019dba9 · audit A · 64 stars
llm-evaluation SKILL.md skill
martineserios/thebrana · system/skills/acquired/llm-evaluation/SKILL.md · LLM evaluation — automated metrics, human feedback, benchmarking. Use when testing performance, measuring AI quality…
git:20260610.36508ae · audit A · 3 stars

Browse by kind, by grade A, or by owner.