meta-eval SKILL.md skillA
meta-eval from agentscope-ai/openjudge is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.
mdr add agentscope-ai/openjudge/meta-eval@git:20260708.2151defPins git:20260708.2151def in mdr.lock. Pin the fingerprint instead.
- Audit grade
- A, 17 of 17 checks passed
- Kind
- SKILL.md skill
- Repository
- agentscope-ai/openjudge
- Path
skills/eval_pipeline/00-meta-eval/SKILL.md- Versions recorded
- 1
- Latest version
- git:20260708.2151def, committed Jul 8, 2026
- Size
- 10,147 bytes
- Repository stars
- 1,020
- License
- Apache-2.0
Use when the user wants to build an evaluation system for an LLM/agent application but doesn't know where to start — they have traces, prompts, RAG pipelines, or nothing at all. Also use when the user mentions evaluation, eval, benchmarking, testing LLM quality, measuring agent performance, assessing RAG accuracy, or wants to compare prompts/models. This skill is the entry router: it asks diagnostic questions then recommends which sub-skill (local workflow) to use next.
Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.
What the file says
<HARD-GATE> NO sub-skill recommendation WITHOUT identifying data_form + label_status (these two pick the entry workflow). ALWAYS give a provisional recommendation once data_form + label_status are known, even if stakes/user_prior are still unknown — then ask the remaining questions to refine the downstream path. Do not withhold the route while waiting on stakes. </HARD-GATE> # Meta Eval Entry router for the eval skill collection. You diagnose what the user has and route them to the right sub-skill. You don't do evaluation yourself — you're the triage desk. Each sub-skill is self-contained: it carries inline the data shapes, statistics, and data principles it needs, so it can be installed and used on its own. ## Checklist You MUST create a task for each item and complete them in order: 1. **Ask 4 diagnostic questions** — data, labels, stakes, domain knowledge 2. **Match triage table** — map user scenario to sub-skill 3. **Recommend sub-skill** — tell the user which workflow to use and why 4. **Record routing decision** — write a brief summary of what was diagnosed and recommended ## Diagnostic Questions Ask these 4 questions (all at once — don't drip-feed): ``` …
Read the whole file at its exact version.
How to install
mdr add agentscope-ai/openjudge/meta-eval@sha256:73245bc3dc532905The line at the top of this page pins the label git:20260708.2151def, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.
[](https://markdownregistry.com/a/art_gkcoees2gcqw2rei)
4 badge image fetches in 30 days. What the badge shows.
Versions
The registry has recorded 1 version of this file, committed on Jul 8, 2026.
Audit of the latest version
- pass: Frontmatter block present
- pass: Frontmatter declares a name
- pass: Frontmatter declares a description
- pass: Size between 200 bytes and 200 KB (10147 bytes)
- pass: No zero-width or bidi control characters
- pass: No instruction hidden inside an HTML comment
- pass: No link to an exfiltration or paste host
- pass: No credential-shaped string
- pass: No instruction to send local credentials anywhere
- pass: No text hidden with inline styles
- pass: No prompt-injection phrasing
- pass: No curl or wget piped into a shell
- pass: No recursive delete of root, home or parent
- pass: No instruction to read or print local credentials
- pass: No base64 blob over 200 characters
- pass: No link to a raw IP address
- pass: No script tag
Source
agentscope-ai/openjudge · 1,020 stars · license Apache-2.0 · pushed 2026-10-30 · branch main
API
GET https://markdownregistry.com/api/v1/artifacts/art_gkcoees2gcqw2rei GET https://markdownregistry.com/api/v1/resolve?ref=agentscope-ai/openjudge/meta-eval GET https://markdownregistry.com/api/v1/blob/73245bc3dc53290535a4fe1197c539e2e4b5787cc6b12f2393144b07b5693f03
Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.
Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.