waza-runner SKILL.md skillA

waza-runner from microsoft/waza is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add microsoft/waza/waza-runner@v1.0

Pins v1.0 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
microsoft/waza
Path
waza-runner/SKILL.md
Versions recorded
1
Latest version
v1.0, committed Feb 1, 2026
Size
2,457 bytes
Repository stars
1,424
License
MIT

Run evaluations on Agent Skills to measure their effectiveness. USE FOR: "run skill evals", "evaluate my skill", "test skill quality", "check skill triggers", "skill compliance check", "measure skill performance", "run evals on [skill-name]", "grade skill execution". DO NOT USE FOR: writing skills (use skill-authoring), improving frontmatter (use sensei), or general testing unrelated to skills.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Skill Eval Runner

> Evaluate Agent Skills like you evaluate AI Agents

This skill runs evaluations on other skills to measure their effectiveness using the same patterns that power AI agent evaluations.

## When to Use

- Running quality evaluations on a skill
- Testing if a skill triggers on correct prompts
- Measuring skill behavior quality
- Generating eval reports for CI/CD

## Commands

### Run Evals
```
Run evals on <skill-name>
```

### Initialize Eval Suite
```
Create evals for <skill-name>
```

### Generate Report
```
Generate eval report for <skill-name>
```

## Workflow

1. **Check for Eval Suite**: Look for `eval.yaml` in the skill directory
2. **Load Tasks**: Parse task definitions from `tasks/*.yaml`
3. **Execute**: Run each task through the configured graders
4. **Report**: Output results in JSON or Markdown format

## Metrics Measured

| Metric | Description | Default Threshold |
|--------|-------------|-------------------|
| Task Completion | Did the skill accomplish the goal? | 80% |
| Trigger Accuracy | Was skill invoked on correct prompts? | 90% |
| Behavior Quality | Tool calls, efficiency, reasoning | 70% |

## Grader Types
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add microsoft/waza/waza-runner@sha256:c05f979bbedf3fd6

The line at the top of this page pins the label v1.0, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_2nznkywz5a3letxp.svg)](https://markdownregistry.com/a/art_2nznkywz5a3letxp)

1 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 1 version of this file, committed on Feb 1, 2026.

versioncommittedcommitsizeaudit
v1.0 latest2026-02-01 6c71366 2,457 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (2457 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

microsoft/waza · 1,424 stars · license MIT · pushed 2026-10-21 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_2nznkywz5a3letxp
GET https://markdownregistry.com/api/v1/resolve?ref=microsoft/waza/waza-runner
GET https://markdownregistry.com/api/v1/blob/c05f979bbedf3fd6c90501eba89f87d8afd448d60f9826dae9b1a938bdc6afd5

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from microsoft/waza

squad-commands SKILL.md skill
microsoft/waza · .copilot/skills/squad-commands/SKILL.md · Categorized catalog of common Squad operations. Coordinator reads this file and presents it as an interactive menu when…
git:20260615.284ec6d · audit A · 1,424 stars
agent-collaboration SKILL.md skill
microsoft/waza · .github/skills/agent-collaboration/SKILL.md · Standard collaboration patterns for all squad agents — worktree awareness, decisions, cross-agent communication
git:20261016.42d1b9f · audit A · 1,424 stars
azd-publish SKILL.md skill
microsoft/waza · .github/skills/azd-publish/SKILL.md · Prepare and publish a new version of the waza azd extension. USE FOR: "publish extension", "release new version", "bump…
v1.0 · audit A · 1,424 stars
coordinator-init-mode SKILL.md skill
microsoft/waza · .github/skills/coordinator-init-mode/SKILL.md · The complete two-phase Init Mode protocol the Squad coordinator runs when no team exists yet in the current repo. Phase…
git:20261016.42d1b9f · audit A · 1,424 stars
coordinator-response-mode SKILL.md skill
microsoft/waza · .github/skills/coordinator-response-mode/SKILL.md · Selecting WHO handles work is the Routing table; selecting HOW they handle it (Direct, Lightweight, Standard, Full) is…
git:20261016.42d1b9f · audit A · 1,424 stars
coordinator-source-of-truth SKILL.md skill
microsoft/waza · .github/skills/coordinator-source-of-truth/SKILL.md · The complete file-by-file source-of-truth hierarchy for Squad: which files are authoritative, which are…
git:20261016.42d1b9f · audit A · 1,424 stars
cross-squad-communication SKILL.md skill
microsoft/waza · .github/skills/cross-squad-communication/SKILL.md · Protocol for sending queries, delegating tasks, and sharing context between independent Squad instances across…
git:20261016.42d1b9f · audit A · 1,424 stars
cross-squad SKILL.md skill
microsoft/waza · .github/skills/cross-squad/SKILL.md · Coordinating work across multiple Squad instances — discovery, delegation, and disambiguation when the user says…
git:20261016.42d1b9f · audit A · 1,424 stars
error-recovery SKILL.md skill
microsoft/waza · .github/skills/error-recovery/SKILL.md · Standard recovery patterns for all squad agents. When something fails, adapt — don't just report the failure.
git:20261016.42d1b9f · audit A · 1,424 stars
git-workflow SKILL.md skill
microsoft/waza · .github/skills/git-workflow/SKILL.md · Squad branching model: dev-first workflow with insiders preview channel
git:20261016.42d1b9f · audit A · 1,424 stars
iterative-retrieval SKILL.md skill
microsoft/waza · .github/skills/iterative-retrieval/SKILL.md · Max-3-cycle protocol for agent sub-tasks with WHY context and coordinator validation. Use when spawning sub-agents to…
git:20261016.42d1b9f · audit A · 1,424 stars
reflect SKILL.md skill
microsoft/waza · .github/skills/reflect/SKILL.md · Learning capture system that extracts HIGH/MED/LOW confidence patterns from conversations to prevent repeating…
v1.0.0-squad · audit A · 1,424 stars

Every file in microsoft/waza

Browse by kind, by grade A, or by owner.