scorer-reference SKILL.md skillA

scorer-reference from dreadnode/capabilities is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add dreadnode/capabilities/scorer-reference@git:20261021.39fded1

Pins git:20261021.39fded1 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
dreadnode/capabilities
Path
capabilities/ai-red-teaming/skills/scorer-reference/SKILL.md
Versions recorded
2
Latest version
git:20261021.39fded1, committed Oct 21, 2026
First version recorded
May 4, 2026
Size
8,226 bytes
Repository stars
21
License
MIT

Catalog of AIRT scorers - 146 user-selectable (+ agentic *_detected scorers auto-wired per OWASP-ASI category); documents the core set with exact names, categories, and when to use each.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Scorer Reference

The AIRT SDK exposes **146 user-selectable scorers** (plus agentic `*_detected` scorers that the agentic suite auto-wires per OWASP-ASI category). The tables below document the core set - use these EXACT names in the `scorers` parameter, or ask `"Show me the available scorers"` for the full list.

## Default Scorer

Every attack includes `llm_judge` (1-10 jailbreak scale) by default. Add additional scorers to detect specific vulnerability types.

## Rubric-Based Scorers (LLM-judged, 10)

Use when you need nuanced evaluation of specific security properties.

| Scorer | Detects |
|--------|---------|
| `rce` | Remote code execution risk in response |
| `data_exfiltration` | Data leakage patterns in LLM response |
| `goal_hijacking` | Agent goal was redirected |
| `memory_poisoning` | Agent memory was compromised |
| `privilege_escalation` | Elevated permissions obtained |
| `priv_esc` | Alias for privilege_escalation |
| `scope_creep` | Agent exceeded intended scope |
| `tool_chaining` | Dangerous tool chain was executed |
| `tool_selection_safety_rubric` | Agent selected inappropriate tools (LLM-judged) |
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add dreadnode/capabilities/scorer-reference@sha256:e0050f3c9df52f32

The line at the top of this page pins the label git:20261021.39fded1, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_qfbmdp3dpqyhwcit.svg)](https://markdownregistry.com/a/art_qfbmdp3dpqyhwcit)

3 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 2 versions of this file, between May 4, 2026 and Oct 21, 2026, about one every 169 days.

versioncommittedcommitsizeaudit
git:20261021.39fded1 latest2026-10-21 39fded1 8,226 BA view · diff
git:20260504.2a643742026-05-04 2a64374 7,920 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (8226 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

dreadnode/capabilities · 21 stars · license MIT · pushed 2026-11-02 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_qfbmdp3dpqyhwcit
GET https://markdownregistry.com/api/v1/resolve?ref=dreadnode/capabilities/scorer-reference
GET https://markdownregistry.com/api/v1/blob/e0050f3c9df52f32a3ff87ca50d6345fff48d0df1b1f5021eed92b2a65038794

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from dreadnode/capabilities

AGENTS.md AGENTS.md file
dreadnode/capabilities · AGENTS.md
git:20261016.ba11ee9 · audit A · 21 stars
CLAUDE.md CLAUDE.md file
dreadnode/capabilities · CLAUDE.md
git:20260504.2a64374 · audit B · 21 stars
analytics-interpretation SKILL.md skill
dreadnode/capabilities · capabilities/ai-red-teaming/skills/analytics-interpretation/SKILL.md · Guide for reading and interpreting AIRT analytics output including ASR, risk scores, severity, and compliance metrics
git:20260922.9ca478a · audit A · 21 stars
attack-selection-guide SKILL.md skill
dreadnode/capabilities · capabilities/ai-red-teaming/skills/attack-selection-guide/SKILL.md · Decision tree for selecting AIRT attacks based on goals, target type, and constraints
git:20260716.236a798 · audit A · 21 stars
auth-setup-guide SKILL.md skill
dreadnode/capabilities · capabilities/ai-red-teaming/skills/auth-setup-guide/SKILL.md · Guide the user through authenticating the target, attacker, and judge models from their own environment (any cloud, any…
git:20260708.b5ee7d3 · audit A · 21 stars
compliance-mapping SKILL.md skill
dreadnode/capabilities · capabilities/ai-red-teaming/skills/compliance-mapping/SKILL.md · Maps AIRT attacks, transforms, and scorers to OWASP LLM Top 10, OWASP ASI (ASI01-ASI10), MITRE ATLAS, NIST AI RMF, and…
git:20261021.39fded1 · audit A · 21 stars
error-troubleshooting SKILL.md skill
dreadnode/capabilities · capabilities/ai-red-teaming/skills/error-troubleshooting/SKILL.md · Diagnose and fix common errors in AIRT attack generation, execution, and results collection
git:20260911.2fc80d2 · audit A · 21 stars
provisioning-and-lifecycle SKILL.md skill
dreadnode/capabilities · capabilities/ai-red-teaming/skills/provisioning-and-lifecycle/SKILL.md · Provision a hosted target, pick the right endpoint per target type, tear down to stop billing, and interpret transient…
git:20260909.172e429 · audit A · 21 stars
trace-analysis-advisor SKILL.md skill
dreadnode/capabilities · capabilities/ai-red-teaming/skills/trace-analysis-advisor/SKILL.md · Analyzes historical attack traces to provide intelligent recommendations for attack selection, transform effectiveness…
git:20260504.959acbc · audit A · 21 stars
transform-reference SKILL.md skill
dreadnode/capabilities · capabilities/ai-red-teaming/skills/transform-reference/SKILL.md · Catalog of AIRT transforms - 429 text transforms (596 incl. multimodal/variants); documents the core set with exact…
git:20261021.39fded1 · audit A · 21 stars
whitebox-local-surrogate SKILL.md skill
dreadnode/capabilities · capabilities/ai-red-teaming/skills/whitebox-local-surrogate/SKILL.md · How to run white-box (gradient/embedding/activation) attacks, which need a local open-weight surrogate model the user…
git:20261021.30680ec · audit A · 21 stars
workflow-patterns SKILL.md skill
dreadnode/capabilities · capabilities/ai-red-teaming/skills/workflow-patterns/SKILL.md · Python workflow templates for common AIRT assessment scenarios using the Assessment API
git:20261002.5d23421 · audit A · 21 stars

Every file in dreadnode/capabilities

Other files named scorer-reference

scorer-reference SKILL.md skill
dreadnode/capabilities · capabilities/web-security/skills/scorer-reference/SKILL.md · SDK rubrics and scorers for web-security evaluation tasks. Use when configuring task.yaml verification, composing…
git:20260529.8f6ea0e · audit A · 21 stars

Browse by kind, by grade A, or by owner.