agent-evaluation SKILL.md skillA

This file is byte-identical to the first copy the registry indexed. Same content hash, so the same checks give both the same grade.

agent-evaluation from francostino/opencode-skills-collection is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add francostino/opencode-skills-collection/agent-evaluation@git:20260906.7d37dc9

Pins git:20260906.7d37dc9 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
francostino/opencode-skills-collection
Path
bundled-skills/agent-evaluation/SKILL.md
Versions recorded
3
Latest version
git:20260906.7d37dc9, committed Sep 6, 2026
First version recorded
Apr 7, 2026
Size
7,810 bytes
Repository stars
87
License
MIT

Evaluate agent behavior with versioned cases and explicit verifiers. Use when comparing agent or prompt changes, reproducing failures, or running agent regression tests.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Agent Evaluation

Evaluate observable agent behavior against task-specific cases. Modified by AAS maintainers on 2026-09-05 to remove unsupported benchmark claims, correct uncertainty/error reporting and separate optional architecture sketches from the operating procedure.

## When to Use

Use when comparing a changed agent, prompt or tool configuration, reproducing an observed failure, or estimating reliability on a declared task distribution. Do not infer product readiness from a public benchmark percentage or a generic score threshold.

## Prerequisites

- A versioned case set with expected observable outcomes and permission boundaries.
- A known baseline and candidate revision, including model, prompt, tools, configuration and runtime versions.
- Authorized synthetic or redacted inputs, isolated targets and a bounded token, time and cost budget.
- A verifier that distinguishes wrong outcomes, expected safe rejections, evaluator failures and infrastructure outages. Provider access is needed only if the declared evaluation calls that provider.

## Evaluation procedure
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add francostino/opencode-skills-collection/agent-evaluation@sha256:35a81463e739fbd8

The line at the top of this page pins the label git:20260906.7d37dc9, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_rbemjijznlarcy2b.svg)](https://markdownregistry.com/a/art_rbemjijznlarcy2b)

3 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 3 versions of this file, between Apr 7, 2026 and Sep 6, 2026, about one every 76 days. Its first recorded version is graded B and its latest A.

versioncommittedcommitsizeaudit
git:20260906.7d37dc9 latest2026-09-06 7d37dc9 7,810 BA view · diff
git:20260413.f8e00382026-04-13 f8e0038 36,957 BB view · diff
git:20260407.4b28f5b2026-04-07 4b28f5b 36,639 BB view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (7810 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

francostino/opencode-skills-collection · 87 stars · license MIT · pushed 2026-10-18 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_rbemjijznlarcy2b
GET https://markdownregistry.com/api/v1/resolve?ref=francostino/opencode-skills-collection/agent-evaluation
GET https://markdownregistry.com/api/v1/blob/35a81463e739fbd8021e6e775c14440ed0b6d264f1ec83b6ea9ddd3909b86d3f

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from francostino/opencode-skills-collection

AGENTS.md AGENTS.md file
francostino/opencode-skills-collection · AGENTS.md
git:20260820.c2f6bd5 · audit A · 87 stars
00-andruia-consultant SKILL.md skill
francostino/opencode-skills-collection · bundled-skills/00-andruia-consultant/SKILL.md · Usar al iniciar o mejorar un proyecto de IA: diagnostica código y restricciones, propone skills existentes y redacta…
git:20261015.fac8b7e · audit A · 87 stars
007 SKILL.md skill
francostino/opencode-skills-collection · bundled-skills/007/SKILL.md · Security audit, hardening, threat modeling (STRIDE/PASTA), Red/Blue Team, OWASP checks, code review, incident response…
git:20260906.7d37dc9 · audit A · 87 stars
10-andruia-skill-smith SKILL.md skill
francostino/opencode-skills-collection · bundled-skills/10-andruia-skill-smith/SKILL.md · Usar para crear o mejorar una skill de Andru.ia: define entradas y resultados, redacta SKILL.md con ejemplos y límites…
git:20261015.fac8b7e · audit A · 87 stars
20-andruia-niche-intelligence SKILL.md skill
francostino/opencode-skills-collection · bundled-skills/20-andruia-niche-intelligence/SKILL.md · Usar tras definir el sector de un proyecto: prepara un dossier en español con contexto, normas aplicables, patrones UX…
git:20261015.fac8b7e · audit A · 87 stars
2slides-ppt-generator SKILL.md skill
francostino/opencode-skills-collection · bundled-skills/2slides-ppt-generator/SKILL.md · AI-powered presentation generation via the 2slides API — create slides from text, match a reference image style…
git:20260906.7d37dc9 · audit A · 87 stars
360-feedback-system SKILL.md skill
francostino/opencode-skills-collection · bundled-skills/360-feedback-system/SKILL.md · 360 feedback register: reviewer, subject, review cycle, visibility, due date and score, as CSV, SQL, JSON Schema or…
git:20261001.ed2b2ec · audit A · 87 stars
3d-web-experience SKILL.md skill
francostino/opencode-skills-collection · bundled-skills/3d-web-experience/SKILL.md · Use when building or debugging web 3D scenes, product configurators or portfolios with Three.js, React Three Fiber or…
git:20261015.fac8b7e · audit A · 87 stars
aas-compose-stack SKILL.md skill
francostino/opencode-skills-collection · bundled-skills/aas-compose-stack/SKILL.md · Preserve the coding agent's explicit AAS skill selection as a validated stack and optional evidence.
git:20261004.4720433 · audit A · 87 stars
aas-discover SKILL.md skill
francostino/opencode-skills-collection · bundled-skills/aas-discover/SKILL.md · Discover AAS skills for an explicit task and compare their complete instructions without installing them.
git:20261004.4720433 · audit A · 87 stars
aas-review-stack SKILL.md skill
francostino/opencode-skills-collection · bundled-skills/aas-review-stack/SKILL.md · Review AAS stack manifests, preview plans and selection evidence in Workbench without applying changes.
git:20261004.4720433 · audit A · 87 stars
ab-test-setup SKILL.md skill
francostino/opencode-skills-collection · bundled-skills/ab-test-setup/SKILL.md · Use when designing an A/B or split test: define the hypothesis, control and variants, estimate sample size, verify…
git:20260906.7d37dc9 · audit A · 87 stars

Every file in francostino/opencode-skills-collection

Other files named agent-evaluation

agent-evaluation SKILL.md skill
sickn33/agentic-awesome-skills · plugins/agentic-awesome-skills-claude/skills/agent-evaluation/SKILL.md · Evaluate agent behavior with versioned cases and explicit verifiers. Use when comparing agent or prompt changes…
git:20260905.b0bf123 · audit A · 48,329 stars
agent-evaluation SKILL.md skill
aicodedecode/awesome-muse-skills · skills-imported/agent-evaluation/SKILL.md · Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and…
git:20260927.806f3e1 · audit A · 25 stars
agent-evaluation SKILL.md skill
alebgl77/claude-inc · skills/agent-evaluation/SKILL.md · Measures a skill's practical value with fixed business tasks, paired with-skill and without-skill trials, explicit…
git:20260908.272d42d · audit A · 19 stars
agent-evaluation SKILL.md skill
fmind/dot · skills/agent-evaluation/SKILL.md · Evaluate prompt, model, retrieval, and agent changes with repeated graded trials.
git:20261007.18f5c20 · audit A · 12 stars
agent-evaluation SKILL.md skill
fabioc-aloha/alex_skill_mall · plugins/ai-agents/agent-evaluation/skills/agent-evaluation/SKILL.md · Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and…
git:20260728.80a7ab6 · audit B · 5 stars

Browse by kind, by grade A, or by owner.