eval-audit · git:20260518.3dbd4bc · 2026-05-18 · sha256 fc88b8e1f9211647

eval-audit git:20260518.3dbd4bcA

Immutable. This exact content is served forever at /api/v1/blob/fc88b8e1f9211647.

---
name: eval-audit
description: Use when reviewing an AI app for launch readiness, safety, security, OWASP agentic AI risks, metric coverage, traceability, or production RCA gaps.
---

# Eval Audit

Use this skill to find risk before changing the app. Audits inspect evidence,
code, metrics, and workflow coverage. Do not fix by default.

## Audit Areas

- OWASP agentic AI risks: control plane, tool permissions, data exposure,
  indirect prompt injection, identity boundaries, approval gates, and unsafe
  autonomy.
- Metric coverage: quality, safety, grounding, cost, latency, tool behavior,
  segment regressions, and missing expected-output contracts.
- Evidence quality: links back to Galileo traces, spans, sessions, log streams,
  experiments, and scorer status.
- Launch readiness: failure cases, rollback criteria, verification commands,
  privacy/PII risks, and production monitoring gaps.

## Output

Produce findings first, ordered by severity. Include evidence references and
the next command: `/eval-measure`, `/eval-fetch`, `/eval-diagnose`, or
`/eval-cost`.