10 instruction files for AI agents, collected from calibre-labs/reforge-ai-evals. Install any of them at an exact version with mdr add calibre-labs/reforge-ai-evals/<name>.
calibre-labs/reforge-ai-evals · skills/eval-code/SKILL.md · Write deterministic, code-based evaluator functions for an AI product. Use this skill whenever you need to write…
calibre-labs/reforge-ai-evals · skills/eval-guide/SKILL.md · Entry point for eval work. Use when someone asks for help with evals in general, does not know where to start, asks…
calibre-labs/reforge-ai-evals · skills/eval-llm-judge/SKILL.md · Write LLM-as-judge evaluator prompts for AI products. Use this skill whenever you need to evaluate semantic properties…
calibre-labs/reforge-ai-evals · skills/eval-rubric/SKILL.md · Write or update the eval rubric for an AI agent or AI feature: the pass/fail criteria that define good behavior, in…
calibre-labs/reforge-ai-evals · skills/llm-align/SKILL.md · Analyze alignment between LLM judge scores and human labels in an eval dataset. Use this skill whenever someone wants…
calibre-labs/reforge-ai-evals · skills/ticket-to-eval/SKILL.md · Strip PII from a customer support ticket or eval trace and convert it into eval dataset rows. Produces two outputs: a…
calibre-labs/reforge-ai-evals · skills/trace-review-app/SKILL.md · Design and build a custom trace review app for one AI product: a single-page tool where the team reads traces, writes…
calibre-labs/reforge-ai-evals · skills/uig/SKILL.md · Build a User Input Grid (UIG) for an AI product or feature, evaluate existing eval datasets against it, and propose new…