agentic-eval SKILL.md skillA

agentic-eval from marielynneblock/arcanum-artifex is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add marielynneblock/arcanum-artifex/agentic-eval@git:20260624.0a2f9fa

Pins git:20260624.0a2f9fa in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
marielynneblock/arcanum-artifex
Path
skills/agentic/agentic-eval/SKILL.md
Versions recorded
4
Latest version
git:20260624.0a2f9fa, committed Jun 24, 2026
First version recorded
May 10, 2026
Size
10,924 bytes
Repository stars
4
License
none declared

Use when designing and implementing evaluation loops for AI agents, including reflection, evaluator-optimiser patterns, rubric scoring, LLM-as-judge review, test-driven refinement, convergence checks, and iteration logging.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Agentic Evaluation Patterns

Patterns for self-improvement through iterative evaluation and refinement.

## Overview

Evaluation patterns enable agents to assess and improve their own outputs, moving beyond single-shot generation to iterative refinement loops.

```
Generate → Evaluate → Critique → Refine → Output
    ↑                              │
    └──────────────────────────────┘
```

## When to Use

- **Quality-critical generation**: Code, reports, analysis requiring high accuracy
- **Tasks with clear evaluation criteria**: Defined success metrics exist
- **Content requiring specific standards**: Style guides, compliance, formatting
- **Iterative improvement workflows**: Drafts, plans, prompts, or code need critique and refinement before delivery

## Do Not Use This Skill For

- Formal compliance claims, certification, or audit sign-off without approved organisational evidence
- Production monitoring design, runtime governance, access control, or policy enforcement
- Broad statistical evaluation methodology, benchmark design, or model selection studies
- Security, privacy, or safety review where evaluation loops are not the central concern

---

## Expected Outputs
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add marielynneblock/arcanum-artifex/agentic-eval@sha256:1b41a4e8a4e33ab1

The line at the top of this page pins the label git:20260624.0a2f9fa, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_kvvbfexztdka7gug.svg)](https://markdownregistry.com/a/art_kvvbfexztdka7gug)

5 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 4 versions of this file, between May 10, 2026 and Jun 24, 2026, about one every 15 days.

versioncommittedcommitsizeaudit
git:20260624.0a2f9fa latest2026-06-24 0a2f9fa 10,924 BA view · diff
git:20260520.f6c6e912026-05-20 f6c6e91 8,848 BA view · diff
git:20260515.b861afb2026-05-15 b861afb 5,525 BB view · diff
git:20260510.f26bcec2026-05-10 f26bcec 5,940 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (10924 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

marielynneblock/arcanum-artifex · 4 stars · license none declared · pushed 2026-09-19 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_kvvbfexztdka7gug
GET https://markdownregistry.com/api/v1/resolve?ref=marielynneblock/arcanum-artifex/agentic-eval
GET https://markdownregistry.com/api/v1/blob/1b41a4e8a4e33ab1220495db4f480d7771840f3de75ee411faba116a7853ab34

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from marielynneblock/arcanum-artifex

asset-frontmatter-check SKILL.md skill
marielynneblock/arcanum-artifex · .github/skills/asset-frontmatter-check/SKILL.md · Validate YAML frontmatter of Copilot customisation assets in this lab (SKILL.md, WORKFLOW.md, *.agent.md…
v1.0.0 · audit A · 4 stars
asset-self-containment-check SKILL.md skill
marielynneblock/arcanum-artifex · .github/skills/asset-self-containment-check/SKILL.md · Check that a Copilot customisation asset (skill, workflow, agent, instruction, or prompt folder) stays standalone and…
v1.0.0 · audit A · 4 stars
markdown-link-auditor SKILL.md skill
marielynneblock/arcanum-artifex · .github/skills/markdown-link-auditor/SKILL.md · Audit Markdown links, images, and local anchors for broken relative references. Use when reviewing documentation…
v1.1.0 · audit A · 4 stars
agent-governance-patterns SKILL.md skill
marielynneblock/arcanum-artifex · skills/agentic/agent-governance-patterns/SKILL.md · Design and implement governance controls for tool-using and multi-agent AI systems, including policy enforcement…
git:20260710.0115f49 · audit A · 4 stars
agent-owasp-compliance SKILL.md skill
marielynneblock/arcanum-artifex · skills/agentic/agent-owasp-compliance/SKILL.md · Assess tool-using and multi-agent AI systems against OWASP ASI-style controls, mapping evidence to prompt injection…
git:20260710.0115f49 · audit A · 4 stars
agent-supply-chain SKILL.md skill
marielynneblock/arcanum-artifex · skills/agentic/agent-supply-chain/SKILL.md · Review, generate, and verify supply-chain integrity controls for AI agent tools, plugins, MCP servers, skills, prompts…
git:20260520.f6c6e91 · audit A · 4 stars
ai-ready SKILL.md skill
marielynneblock/arcanum-artifex · skills/agentic/ai-ready/SKILL.md · Guide users to review and install the external ai-ready skill from its upstream repository. Use when the user asks to…
git:20260710.0115f49 · audit A · 4 stars
copilot-cli-quickstart SKILL.md skill
marielynneblock/arcanum-artifex · skills/agentic/copilot-cli-quickstart/SKILL.md · Beginner-friendly interactive tutorial for GitHub Copilot CLI concepts, slash commands, permissions, file context…
git:20260710.0115f49 · audit F · 4 stars
eval-driven-dev SKILL.md skill
marielynneblock/arcanum-artifex · skills/agentic/evaluation/eval-driven-dev/SKILL.md · Build an automated evaluation pipeline that tests a Python LLM application end-to-end with pixie test — real code…
v0.8.4 · audit A · 4 stars
first-ask SKILL.md skill
marielynneblock/arcanum-artifex · skills/agentic/first-ask/SKILL.md · Interactive task-refinement workflow that clarifies scope, deliverables, and constraints before carrying out the task…
git:20260710.0115f49 · audit A · 4 stars
generate-custom-instructions-from-codebase SKILL.md skill
marielynneblock/arcanum-artifex · skills/agentic/generate-custom-instructions-from-codebase/SKILL.md · Generate GitHub Copilot migration instructions by comparing two project versions and extracting conventions for…
git:20260710.0115f49 · audit A · 4 stars
github-copilot-starter SKILL.md skill
marielynneblock/arcanum-artifex · skills/agentic/github-copilot-starter/SKILL.md · Set up a GitHub Copilot customisation starter pack for a new project based on its technology stack, including…
git:20260710.0115f49 · audit A · 4 stars

Every file in marielynneblock/arcanum-artifex

Other files named agentic-eval

agentic-eval SKILL.md skill
github/awesome-copilot · skills/agentic-eval/SKILL.md · Patterns and techniques for evaluating and improving AI agent outputs. Use this skill when: - Implementing…
git:20260119.3d00ec4 · audit A · 40,226 stars
agentic-eval SKILL.md skill
skillmds/skillmd · plugins/build-multi-agent-system-with-crewai/skills/agentic-eval/SKILL.md · Patterns and techniques for evaluating and improving AI agent outputs. Use this skill when: - Implementing…
git:20260919.fecc0d5 · audit A · 250 stars
agentic-eval SKILL.md skill
sandbaseai/sandbase-skills · marketing/agentic-eval/SKILL.md · Plan, implement, or review agentic eval work in an existing codebase with compatibility, security, and verification…
git:20260908.a887321 · audit A · 202 stars
agentic-eval SKILL.md skill
fabioc-aloha/alex_skill_mall · plugins/ai-agents/agentic-eval/skills/agentic-eval/SKILL.md · Patterns for agent self-improvement through iterative evaluation and refinement -- generate, evaluate, critique, refine…
git:20260728.80a7ab6 · audit A · 5 stars
agentic-eval SKILL.md skill
pr-e/openclaw-master-skills · skills/agentic-eval/SKILL.md · Patterns and techniques for evaluating and improving AI agent outputs. Use this skill when: - Implementing…
git:20260302.9834b38 · audit A · 3 stars

Browse by kind, by grade A, or by owner.