writing-evals SKILL.md skillB

writing-evals from openclaw/clawhub is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add openclaw/clawhub/writing-evals@git:20260709.5d15061

Pins git:20260709.5d15061 in mdr.lock. Pin the fingerprint instead.

Audit grade
B, 16 of 17 checks passed
Kind
SKILL.md skill
Repository
openclaw/clawhub
Path
.agents/skills/writing-evals/SKILL.md
Versions recorded
1
Latest version
git:20260709.5d15061, committed Jul 9, 2026
Size
16,617 bytes
Repository stars
9,549
License
MIT

Scaffolds evaluation suites for the Axiom AI SDK. Generates eval files, scorers, flag schemas, and config from natural-language descriptions. Use when creating evals, writing scorers, setting up flag schemas, or configuring axiom.config.ts.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Writing Evals

You write evaluations that prove AI capabilities work. Evals are the test suite for non-deterministic systems: they measure whether a capability still behaves correctly after every change.

## Prerequisites

- Complete the [Axiom AI SDK Quickstart](https://axiom.co/docs/ai-engineering/quickstart) (instrumentation + authentication)

Verify the SDK is installed:

```bash
ls node_modules/axiom/dist/
```

If not installed, install it using the project's package manager (e.g., `pnpm add axiom`).

**Always check `node_modules/axiom/dist/docs/` first** for the correct API signatures, import paths, and patterns for the installed SDK version. The bundled docs are the source of truth — do not rely on the examples in this skill if they conflict.

## Philosophy

1. **Evals are tests for AI.** Every eval answers: "does this capability still work?"
2. **Scorers are assertions.** Each scorer checks one property of the output.
3. **Flags are variables.** Flag schemas let you sweep models, temperatures, strategies without code changes.
4. **Data drives coverage.** Happy path, adversarial, boundary, and negative cases.
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add openclaw/clawhub/writing-evals@sha256:19e7aff207386de3

The line at the top of this page pins the label git:20260709.5d15061, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_7nsemikkucjtafi4.svg)](https://markdownregistry.com/a/art_7nsemikkucjtafi4)

5 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 1 version of this file, committed on Jul 9, 2026.

versioncommittedcommitsizeaudit
git:20260709.5d15061 latest2026-07-09 5d15061 16,617 BB view

Audit of the latest version

B  16 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • fail: No prompt-injection phrasing (matched: Ignore previous instructions)
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (16617 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Starting a new one? Use a template for SKILL.md on mdpantry, which passes every one of these checks and says what to change in it.

Source

GitHub

openclaw/clawhub · 9,549 stars · license MIT · pushed 2026-11-07 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_7nsemikkucjtafi4
GET https://markdownregistry.com/api/v1/resolve?ref=openclaw/clawhub/writing-evals
GET https://markdownregistry.com/api/v1/blob/19e7aff207386de3db45cfa7bfa7814ec5a28a8152c07270f6c32d1696d1260c

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from openclaw/clawhub

autoreview SKILL.md skill
openclaw/clawhub · .agents/skills/autoreview/SKILL.md · Structured code review through the shared OpenClaw agent-skills installation.
git:20261020.ec1016a · audit A · 9,549 stars
axiom-alerting SKILL.md skill
openclaw/clawhub · .agents/skills/axiom-alerting/SKILL.md · Create and manage Axiom monitors and notifiers via the v2 public API. Use when building alerting, routing…
git:20260709.5d15061 · audit A · 9,549 stars
axiom-sre SKILL.md skill
openclaw/clawhub · .agents/skills/axiom-sre/SKILL.md · Expert SRE investigator for incidents and debugging. Uses hypothesis-driven methodology and systematic triage. Can…
git:20260709.5d15061 · audit A · 9,549 stars
building-dashboards SKILL.md skill
openclaw/clawhub · .agents/skills/building-dashboards/SKILL.md · Designs and builds Axiom dashboards via API. Covers chart types, APL and metrics/MPL query patterns, SmartFilters…
git:20260709.5d15061 · audit A · 9,549 stars
clawhub-ban-appeals SKILL.md skill
openclaw/clawhub · .agents/skills/clawhub-ban-appeals/SKILL.md · Review ClawHub account-ban appeals, distinguish bans from moderation holds or blocked releases, and prepare an…
git:20261031.5451f96 · audit A · 9,549 stars
clawhub-clawscan SKILL.md skill
openclaw/clawhub · .agents/skills/clawhub-clawscan/SKILL.md · Investigate ClawScan health alerts, diagnose scanner or ClawHub integration failures, prepare operational repairs, and…
git:20261031.5451f96 · audit A · 9,549 stars
clawhub-content-rights-correspondence SKILL.md skill
openclaw/clawhub · .agents/skills/clawhub-content-rights-correspondence/SKILL.md · Use when drafting, sending, or preserving email correspondence for an existing ClawHub content rights case.
git:20260616.0db6b17 · audit A · 9,549 stars
clawhub-convex SKILL.md skill
openclaw/clawhub · .agents/skills/clawhub-convex/SKILL.md · Apply ClawHub-specific Convex conventions and route to the right managed Convex skill. Use for any change under…
git:20260709.4119279 · audit A · 9,549 stars
clawhub-featured SKILL.md skill
openclaw/clawhub · .agents/skills/clawhub-featured/SKILL.md · Prepare evidence-based ClawHub Featured recommendations or apply explicitly authorized Featured changes through…
git:20261031.2655e7c · audit A · 9,549 stars
clawhub-moderation SKILL.md skill
openclaw/clawhub · .agents/skills/clawhub-moderation/SKILL.md · Use for ClawHub staff moderation actions with the repo-local ClawHub admin tool: skills, users, org publishers, plugin…
git:20261031.5451f96 · audit A · 9,549 stars
clawhub-pr-maintainer SKILL.md skill
openclaw/clawhub · .agents/skills/clawhub-pr-maintainer/SKILL.md · Use when reviewing, triaging, validating, or discussing ClawHub GitHub issues or pull requests, including author…
git:20261001.b673073 · audit A · 9,549 stars
clawhub-production-release SKILL.md skill
openclaw/clawhub · .agents/skills/clawhub-production-release/SKILL.md · Run and verify ClawHub production deploys and stable ClawHub CLI npm releases. Use when deploying backend or frontend…
git:20260710.4c59924 · audit A · 9,549 stars

Every file in openclaw/clawhub

Browse by kind, by grade B, or by owner.