redteam SKILL.md skillA
redteam from agentscope-ai/openjudge is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.
mdr add agentscope-ai/openjudge/redteam@git:20260708.2151defPins git:20260708.2151def in mdr.lock. Pin the fingerprint instead.
- Audit grade
- A, 17 of 17 checks passed
- Kind
- SKILL.md skill
- Repository
- agentscope-ai/openjudge
- Path
skills/eval_pipeline/07-redteam/SKILL.md- Versions recorded
- 1
- Latest version
- git:20260708.2151def, committed Jul 8, 2026
- Size
- 14,669 bytes
- Repository stars
- 1,020
- License
- Apache-2.0
Use when the user wants to test their LLM/agent application for safety and security vulnerabilities — jailbreaks, prompt injection, PII extraction, harmful content generation, or evaluator gaming. Also use when the user mentions security testing, adversarial testing, red teaming, safety evaluation, ASR (Attack Success Rate), or "is my app safe to deploy." Outputs ASR paired with over-refusal rate and an audit document.
Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.
What the file says
<HARD-GATE> NO ASR report WITHOUT paired over-refusal rate measurement. NO attack vector distribution WITHOUT reading a policy document first. NO regulated-stakes redteam WITHOUT a sign-off block in the audit document. </HARD-GATE> # Redteam Test your application's safety boundaries systematically. This skill generates attack prompts from a policy document, measures what gets through, and pairs the Attack Success Rate (ASR) with the Over-Refusal Rate so you don't reward models that simply refuse everything. ## When to Activate - Pre-deployment safety audit - Regulatory compliance check - After major model or prompt changes that could affect safety - User reports a jailbreak or injection vulnerability - Periodic (quarterly) safety re-evaluation ## Checklist You MUST create a task for each item and complete them in order: 1. **Establish policy** — what's prohibited, what's allowed, what's gray 2. **Derive attack vectors from policy** — not a fixed template 3. **Generate attack set + over-refusal set** — paired measurement 4. **Run attacks and evaluate** — ASR per policy category 5. **Compute over-refusal rate** — paired with ASR 6. **Output safety scorecard + audit document** …
Read the whole file at its exact version.
How to install
mdr add agentscope-ai/openjudge/redteam@sha256:d1ff8b9faeb30c17The line at the top of this page pins the label git:20260708.2151def, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.
[](https://markdownregistry.com/a/art_2cvwuwffsc55jl3k)
3 badge image fetches in 30 days. What the badge shows.
Versions
The registry has recorded 1 version of this file, committed on Jul 8, 2026.
Audit of the latest version
- pass: Frontmatter block present
- pass: Frontmatter declares a name
- pass: Frontmatter declares a description
- pass: Size between 200 bytes and 200 KB (14669 bytes)
- pass: No zero-width or bidi control characters
- pass: No instruction hidden inside an HTML comment
- pass: No link to an exfiltration or paste host
- pass: No credential-shaped string
- pass: No instruction to send local credentials anywhere
- pass: No text hidden with inline styles
- pass: No prompt-injection phrasing
- pass: No curl or wget piped into a shell
- pass: No recursive delete of root, home or parent
- pass: No instruction to read or print local credentials
- pass: No base64 blob over 200 characters
- pass: No link to a raw IP address
- pass: No script tag
Source
agentscope-ai/openjudge · 1,020 stars · license Apache-2.0 · pushed 2026-10-30 · branch main
API
GET https://markdownregistry.com/api/v1/artifacts/art_2cvwuwffsc55jl3k GET https://markdownregistry.com/api/v1/resolve?ref=agentscope-ai/openjudge/redteam GET https://markdownregistry.com/api/v1/blob/d1ff8b9faeb30c175d697bd899521ea743bb5ee855554eb33541ce76caf7c219
Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.
Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.
More from agentscope-ai/openjudge
Every file in agentscope-ai/openjudge