agent-evaluation SKILL.md skillB

agent-evaluation from fabioc-aloha/alex_skill_mall is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add fabioc-aloha/alex_skill_mall/agent-evaluation@git:20260728.80a7ab6

Pins git:20260728.80a7ab6 in mdr.lock. Pin the fingerprint instead.

Audit grade
B, 16 of 17 checks passed
Kind
SKILL.md skill
Repository
fabioc-aloha/alex_skill_mall
Path
plugins/ai-agents/agent-evaluation/skills/agent-evaluation/SKILL.md
Versions recorded
1
Latest version
git:20260728.80a7ab6, committed Jul 28, 2026
Size
36,901 bytes
Repository stars
5
License
MIT

Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and production monitoring—where even top agents achieve less than 50% on real-world benchmarks.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Agent Evaluation

Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and production monitoring—where even top agents achieve less than 50% on real-world benchmarks

## Capabilities

- agent-testing
- benchmark-design
- capability-assessment
- reliability-metrics
- regression-testing

## Prerequisites

- Knowledge: Testing methodologies, Statistical analysis basics, LLM behavior patterns
- Skills_recommended: autonomous-agents, multi-agent-orchestration
- Required skills: testing-fundamentals, llm-fundamentals

## Scope

- Does_not_cover: Model training evaluation (loss, perplexity), Fairness and bias testing, User experience testing
- Boundaries: Focus is agent capability and reliability, Covers functional and behavioral testing

## Ecosystem

### Primary_tools

- AgentBench - Multi-environment benchmark for LLM agents (ICLR 2024)
- τ-bench (Tau-bench) - Sierra's real-world agent benchmark
- ToolEmu - Risky behavior detection for agent tool use
- Langsmith - LLM tracing and evaluation platform

### Alternatives

- Braintrust - When: Need production monitoring integration LLM evaluation and monitoring
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add fabioc-aloha/alex_skill_mall/agent-evaluation@sha256:dd7de1c1b89ecd0a

The line at the top of this page pins the label git:20260728.80a7ab6, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_cor5u2w3jtxpaed6.svg)](https://markdownregistry.com/a/art_cor5u2w3jtxpaed6)

4 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 1 version of this file, committed on Jul 28, 2026.

versioncommittedcommitsizeaudit
git:20260728.80a7ab6 latest2026-07-28 80a7ab6 36,901 BB view

Audit of the latest version

B  16 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • fail: No prompt-injection phrasing (matched: Ignore all previous instructions)
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (36901 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Starting a new one? Use a template for SKILL.md on mdpantry, which passes every one of these checks and says what to change in it.

Source

GitHub

fabioc-aloha/alex_skill_mall · 5 stars · license MIT · pushed 2026-10-19 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_cor5u2w3jtxpaed6
GET https://markdownregistry.com/api/v1/resolve?ref=fabioc-aloha/alex_skill_mall/agent-evaluation
GET https://markdownregistry.com/api/v1/blob/dd7de1c1b89ecd0a12f58846de83245e0c697bc36e1ebd5733b141027f659f05

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from fabioc-aloha/alex_skill_mall

currency-audit SKILL.md skill
fabioc-aloha/alex_skill_mall · .github/skills/currency-audit/SKILL.md · Comprehensive brain file review — external freshness, internal consistency, semantic accuracy — stamp only after full…
git:20260529.0f7169e · audit A · 5 stars
mall-self-curation SKILL.md skill
fabioc-aloha/alex_skill_mall · .github/skills/mall-self-curation/SKILL.md
git:20260919.282978d · audit C · 5 stars
meditation SKILL.md skill
fabioc-aloha/alex_skill_mall · .github/skills/meditation/SKILL.md · Consolidate session learning into permanent architecture — extract patterns into skills, instructions, prompts, or…
git:20260529.0565655 · audit A · 5 stars
source-inventory SKILL.md skill
fabioc-aloha/alex_skill_mall · .github/skills/source-inventory/SKILL.md · Maintain the source registry in sources/supported-stores.json — add a new third-party plugin store, retire one, refresh…
git:20260529.0565655 · audit A · 5 stars
staleness-discipline SKILL.md skill
fabioc-aloha/alex_skill_mall · .github/skills/staleness-discipline/SKILL.md · Detect, classify, and prune stale source stores in the Mall — define what stale means and how to remove gracefully…
git:20260529.0565655 · audit A · 5 stars
store-evaluation SKILL.md skill
fabioc-aloha/alex_skill_mall · .github/skills/store-evaluation/SKILL.md · Evaluate a proposed store for inclusion in Alex_ACT_Plugin_Mall using a quality scorecard
git:20260529.0565655 · audit A · 5 stars
spline-3d-integration SKILL.md skill
fabioc-aloha/alex_skill_mall · plugins/3d-graphics/spline-3d-integration/skills/spline-3d-integration/SKILL.md · Use when adding interactive 3D scenes from Spline.design to web projects, including React embedding and runtime control…
git:20260728.80a7ab6 · audit A · 5 stars
threejs-animation SKILL.md skill
fabioc-aloha/alex_skill_mall · plugins/3d-graphics/threejs-animation/skills/threejs-animation/SKILL.md · Three.js animation - keyframe animation, skeletal animation, morph targets, animation mixing. Use when animating…
git:20260728.1225c0d · audit A · 5 stars
academic-editorial-judgment SKILL.md skill
fabioc-aloha/alex_skill_mall · plugins/academic-research/academic-editorial-judgment/skills/academic-editorial-judgment/SKILL.md · Context-dependent editorial style rules for academic writing — APA7, Chicago, MLA judgment calls
git:20260728.80a7ab6 · audit A · 5 stars
academic-paper-drafting SKILL.md skill
fabioc-aloha/alex_skill_mall · plugins/academic-research/academic-paper-drafting/skills/academic-paper-drafting/SKILL.md · End-to-end academic paper drafting for CHI, HBR, journals, and conferences with venue-specific templates, drafting…
git:20260728.80a7ab6 · audit A · 5 stars
academic-paper-reviewer SKILL.md skill
fabioc-aloha/alex_skill_mall · plugins/academic-research/academic-paper-reviewer/skills/academic-paper-reviewer/SKILL.md · Multi-perspective academic paper review with dynamic reviewer personas. Simulates 5 independent reviewers (EIC + 3 peer…
git:20260728.80a7ab6 · audit A · 5 stars
academic-research SKILL.md skill
fabioc-aloha/alex_skill_mall · plugins/academic-research/academic-research/skills/academic-research/SKILL.md · Research project scaffolding, thesis/dissertation writing, literature reviews, publication workflows, and the AI…
git:20260728.80a7ab6 · audit A · 5 stars

Every file in fabioc-aloha/alex_skill_mall

Other files named agent-evaluation

agent-evaluation SKILL.md skill
sickn33/agentic-awesome-skills · plugins/agentic-awesome-skills-claude/skills/agent-evaluation/SKILL.md · Evaluate agent behavior with versioned cases and explicit verifiers. Use when comparing agent or prompt changes…
git:20260905.b0bf123 · audit A · 49,071 stars
agent-evaluation SKILL.md skill
francostino/opencode-skills-collection · bundled-skills/agent-evaluation/SKILL.md · Evaluate agent behavior with versioned cases and explicit verifiers. Use when comparing agent or prompt changes…
git:20260906.7d37dc9 · audit A · 90 stars
agent-evaluation SKILL.md skill
aicodedecode/awesome-muse-skills · skills-imported/agent-evaluation/SKILL.md · Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and…
git:20260927.806f3e1 · audit A · 45 stars
agent-evaluation SKILL.md skill
alebgl77/claude-inc · skills/agent-evaluation/SKILL.md · Measures a skill's practical value with fixed business tasks, paired with-skill and without-skill trials, explicit…
git:20260908.272d42d · audit A · 21 stars
agent-evaluation SKILL.md skill
fmind/dot · skills/agent-evaluation/SKILL.md · Evaluate prompt, model, retrieval, and agent changes with repeated graded trials.
git:20261025.6c4dd76 · audit A · 12 stars

Browse by kind, by grade B, or by owner.