create-skill-test SKILL.md skillA

create-skill-test from dotnet/skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add dotnet/skills/create-skill-test@git:20261008.0608d89

Pins git:20261008.0608d89 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
dotnet/skills
Path
.agents/skills/create-skill-test/SKILL.md
Versions recorded
10
Latest version
git:20261008.0608d89, committed Oct 8, 2026
First version recorded
Aug 19, 2026
Size
24,501 bytes
Repository stars
5,788
License
MIT

Scaffolds eval.yaml evaluation specs for skills, custom agents, and redistributable gh-aw workflow packages in the dotnet/skills repository. Use when creating skill or workflow-package tests, writing evaluation stimuli, defining graders and rubrics, sizing an eval for statistical power, or setting up test fixture files. Handles the Vally eval.yaml schema, fixture organization, and overfitting avoidance. Do not use for running or debugging existing evals (use improve-skill-quality) nor for…

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Create Skill Test

Scaffold an evaluation spec (`eval.yaml`) for a skill, agent, or workflow package so it conforms to the Vally schema,
passes `skill-validator check` and `check_eval_quality.py`, is powerful enough to return a verdict,
and does not overfit to the skill's own wording.

## When to Use

- Creating a new `eval.yaml` for a skill, agent, or workflow package
- Adding stimuli to an existing eval
- Sizing an eval so the pass gate can actually be reached
- Setting up or repairing fixture files alongside an eval
- Reviewing whether rubric items and graders risk overfitting

## When Not to Use

- Diagnosing a failing or regressed eval — use `improve-skill-quality`
- Modifying the skill-validator or the evaluation workflows
- Creating or editing `SKILL.md` files — use `create-skill`

## Inputs

| Input | Required | Description |
|-------|----------|-------------|
| Skill or agent name | Yes | Must exist under `plugins/<plugin>/skills/` or `plugins/<plugin>/agents/` |
| Plugin name | Yes | e.g. `dotnet-msbuild` |
| Skill content | Yes | Read it — you cannot write non-overfitted rubric items without it |
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add dotnet/skills/create-skill-test@sha256:6ad381db3f71541f

The line at the top of this page pins the label git:20261008.0608d89, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_zqefdfgcw6wajz7x.svg)](https://markdownregistry.com/a/art_zqefdfgcw6wajz7x)

2 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 10 versions of this file, between Aug 19, 2026 and Oct 8, 2026, about one every 6 days.

versioncommittedcommitsizeaudit
git:20261008.0608d89 latest2026-10-08 0608d89 24,501 BA view · diff
git:20261006.6fa2f242026-10-06 6fa2f24 22,867 BA view · diff
git:20261006.77aac262026-10-06 77aac26 22,849 BA view · diff
git:20261001.f868e4e2026-10-01 f868e4e 22,202 BA view · diff
git:20260915.36222bf2026-09-15 36222bf 17,971 BA view · diff
git:20260828.2b9056b2026-08-28 2b9056b 18,096 BA view · diff
git:20260826.3adf7cb2026-08-26 3adf7cb 18,046 BA view · diff
git:20260825.ba4f4042026-08-25 ba4f404 17,928 BA view · diff
git:20260819.780c9992026-08-19 780c999 18,213 BA view · diff
git:20260819.3e9d74a2026-08-19 3e9d74a 17,890 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (24501 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

dotnet/skills · 5,788 stars · license MIT · pushed 2026-11-01 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_zqefdfgcw6wajz7x
GET https://markdownregistry.com/api/v1/resolve?ref=dotnet/skills/create-skill-test
GET https://markdownregistry.com/api/v1/blob/6ad381db3f71541f0fb07b6a0ec73b3e5c8b2ed92f85ac51214e584b61e3101c

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from dotnet/skills

authoring-github-workflows SKILL.md skill
dotnet/skills · .agents/skills/authoring-github-workflows/SKILL.md · Author and review GitHub Actions workflow YAML safely so syntactically-valid YAML can't ship a workflow that GitHub…
git:20260616.01b4875 · audit A · 5,788 stars
create-custom-agent SKILL.md skill
dotnet/skills · .agents/skills/create-custom-agent/SKILL.md · Creates VS Code custom agent files (.agent.md) for specialized AI personas with tools, instructions, and handoffs. Use…
git:20260205.8bbd012 · audit A · 5,788 stars
create-skill SKILL.md skill
dotnet/skills · .agents/skills/create-skill/SKILL.md · Scaffolds new agent skills for the dotnet/skills repository. Use when creating a new skill, generating SKILL.md files…
git:20261009.e191d40 · audit A · 5,788 stars
improve-skill-quality SKILL.md skill
dotnet/skills · .agents/skills/improve-skill-quality/SKILL.md · Diagnoses and fixes skills in the dotnet/skills repository that lose to their own baseline, fail to activate, time out…
git:20261006.77aac26 · audit A · 5,788 stars
agentic-workflows SKILL.md skill
dotnet/skills · .github/skills/agentic-workflows/SKILL.md · Route gh-aw workflow design/create/debug/upgrade requests to the right prompts.
git:20261012.b0bf173 · audit A · 5,788 stars
AGENTS.md AGENTS.md file
dotnet/skills · AGENTS.md
git:20261002.fd2077a · audit A · 5,788 stars
no-eval-skill SKILL.md skill
dotnet/skills · eng/skill-validator/tests/fixtures/no-eval-skill/SKILL.md · A skill with no eval.yaml for testing discovery behavior.
git:20260220.11bf689 · audit B · 5,788 stars
sample-skill SKILL.md skill
dotnet/skills · eng/skill-validator/tests/fixtures/sample-skill/SKILL.md · A sample skill for testing the validator. Helps with greeting generation.
git:20260220.11bf689 · audit A · 5,788 stars
csharp-scripts SKILL.md skill
dotnet/skills · plugins/dotnet-advanced/skills/csharp-scripts/SKILL.md · Run file-based C# apps with the .NET CLI when the user explicitly wants C#/.NET code without creating a project. Use…
git:20260629.4975793 · audit A · 5,788 stars
dotnet-pinvoke SKILL.md skill
dotnet/skills · plugins/dotnet-advanced/skills/dotnet-pinvoke/SKILL.md · Correctly call native (C/C++) libraries from .NET using P/Invoke and LibraryImport. Covers function signatures, string…
git:20261019.ec3ac07 · audit A · 5,788 stars
nuget-trusted-publishing SKILL.md skill
dotnet/skills · plugins/dotnet-advanced/skills/nuget-trusted-publishing/SKILL.md · Set up NuGet trusted publishing (OIDC) on a GitHub Actions repo — replaces long-lived API keys with short-lived tokens…
git:20260629.4975793 · audit A · 5,788 stars
vectorization SKILL.md skill
dotnet/skills · plugins/dotnet-advanced/skills/vectorization/SKILL.md · Design, implement, optimize, and review SIMD code in .NET. USE FOR: vectorizing scalar loops with TensorPrimitives…
git:20261005.c6ec97b · audit A · 5,788 stars

Every file in dotnet/skills

Browse by kind, by grade A, or by owner.