eval-integrity SKILL.md skillA

eval-integrity from code-yeongyu/oh-my-openagent is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add code-yeongyu/oh-my-openagent/eval-integrity@git:20260902.87fadbf

Pins git:20260902.87fadbf in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
code-yeongyu/oh-my-openagent
Path
packages/shared-skills/skills/eval-integrity/SKILL.md
Versions recorded
2
Latest version
git:20260902.87fadbf, committed Sep 2, 2026
First version recorded
Sep 1, 2026
Size
5,939 bytes
Repository stars
70,763
License
a license file GitHub does not identify

Assess integrity of an eval, benchmark, metric, A/B test, holdout, LLM-judge, or user-study claim when the question is whether measurement, comparison, or evidence is independent and trustworthy.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Evaluation Integrity

Provide a read-only audit of whether an evaluation can support its stated claim. Do not alter code,
data, prompts, labels, or study operations. Begin with exactly one verdict line in the form
`**Verdict: PASS**`, `**Verdict: FAIL**`, or `**Verdict: INCONCLUSIVE**`. Emit no other verdict
line and do not restate the verdict later in the report. A favorable score is not itself evidence
of integrity.

## Route correctly

- **NOT for code review:** route implementation, correctness, security, or maintainability review to
  `review-work`.
- **NOT for data processing:** route cleaning, transforming, joining, modeling, or analyzing data to
  `data-scientist`.
- Use this skill for the independence and validity of the measurement setup, not for producing a
  result from it.

## Audit method

### 1. State the claim and map the evaluation

Write the claim in testable form: what comparison, metric, threshold, or causal statement is being
made; for which population; and under which decision rule. Map every role before judging it:

| Element | Record |
| --- | --- |
| Claim | The conclusion and decision it is meant to justify. |
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add code-yeongyu/oh-my-openagent/eval-integrity@sha256:79b401dd8afa35d2

The line at the top of this page pins the label git:20260902.87fadbf, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_vp4rgwgt6cppxroj.svg)](https://markdownregistry.com/a/art_vp4rgwgt6cppxroj)

2 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 2 versions of this file, between Sep 1, 2026 and Sep 2, 2026, more than one a day.

versioncommittedcommitsizeaudit
git:20260902.87fadbf latest2026-09-02 87fadbf 5,939 BA view · diff
git:20260901.d2e92102026-09-01 d2e9210 5,816 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (5939 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

code-yeongyu/oh-my-openagent · 70,763 stars · license a license file GitHub does not identify · pushed 2026-11-07 · branch dev

API

GET https://markdownregistry.com/api/v1/artifacts/art_vp4rgwgt6cppxroj
GET https://markdownregistry.com/api/v1/resolve?ref=code-yeongyu/oh-my-openagent/eval-integrity
GET https://markdownregistry.com/api/v1/blob/79b401dd8afa35d2c970c87c46398d8916164faba1d7c0fe7e2dfb99678141d0

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from code-yeongyu/oh-my-openagent

AGENTS.md@.agents AGENTS.md file
code-yeongyu/oh-my-openagent · .agents/AGENTS.md
git:20260923.2f99bd2 · audit A · 70,763 stars
codex-qa SKILL.md skill
code-yeongyu/oh-my-openagent · .agents/skills/codex-qa/SKILL.md · QA the omo Codex Light edition (lazycodex / packages/omo-codex) itself, in strict isolation so ONLY our plugin is…
git:20260923.2f99bd2 · audit A · 70,763 stars
get-unpublished-changes SKILL.md skill
code-yeongyu/oh-my-openagent · .agents/skills/get-unpublished-changes/SKILL.md · Compare HEAD with the latest published npm versions and list all unpublished changes by release layer. Triggers…
git:20260801.03121f8 · audit A · 70,763 stars
github-triage SKILL.md skill
code-yeongyu/oh-my-openagent · .agents/skills/github-triage/SKILL.md · Read-only GitHub triage for issues AND PRs. 1 item = 1 background task (category: quick). Analyzes all open items and…
git:20260513.2146071 · audit A · 70,763 stars
hyperplan SKILL.md skill
code-yeongyu/oh-my-openagent · .agents/skills/hyperplan/SKILL.md · Adversarial multi-agent planning skill. Self-orchestrates 5 hostile category members (unspecified-low…
git:20260923.573d36a · audit A · 70,763 stars
omomomo SKILL.md skill
code-yeongyu/oh-my-openagent · .agents/skills/omomomo/SKILL.md · Easter egg command - about oh-my-opencode. Triggers: omomomo, about, easter egg.
git:20260731.b3b45cd · audit A · 70,763 stars
opencode-qa SKILL.md skill
code-yeongyu/oh-my-openagent · .agents/skills/opencode-qa/SKILL.md · QA opencode itself, per case: verify the CLI/terminal (opencode run, db, serve, export), prove a specific plugin…
git:20260708.0806e41 · audit B · 70,763 stars
pre-publish-review SKILL.md skill
code-yeongyu/oh-my-openagent · .agents/skills/pre-publish-review/SKILL.md · Nuclear-grade 12-agent pre-publish release gate. Runs /get-unpublished-changes to detect all changes since last npm…
git:20260904.cd0c0a3 · audit A · 70,763 stars
publish SKILL.md skill
code-yeongyu/oh-my-openagent · .agents/skills/publish/SKILL.md · Publish oh-my-opencode to npm by triggering the GitHub Actions publish workflow and verifying its artifacts. Ship-only…
git:20261025.4b02a69 · audit A · 70,763 stars
remove-deadcode SKILL.md skill
code-yeongyu/oh-my-openagent · .agents/skills/remove-deadcode/SKILL.md · Remove unused code from this project with ultrawork mode, LSP-verified safety, atomic commits. Triggers: remove dead…
git:20261105.ab2c2d5 · audit A · 70,763 stars
security-research SKILL.md skill
code-yeongyu/oh-my-openagent · .agents/skills/security-research/SKILL.md · Team Mode security research skill. Orchestrates 3 vulnerability hunters and 2 PoC engineers to audit a codebase in…
git:20260920.2a3e860 · audit A · 70,763 stars
senpi-qa SKILL.md skill
code-yeongyu/oh-my-openagent · .agents/skills/senpi-qa/SKILL.md · QA the omo Senpi adapter (packages/omo-senpi, packages/senpi-task) against the REAL senpi binary in strict isolation…
git:20260923.2f99bd2 · audit A · 70,763 stars

Every file in code-yeongyu/oh-my-openagent

Browse by kind, by grade A, or by owner.