Home / nahid-sparktales / agent-dispatcher · skills/product/experimentation/SKILL.md · GitHub

experimentation skillA

experimentation is agent-read markdown (skill) from nahid-sparktales/agent-dispatcher: Design an A/B test that can answer its question — hypothesis, randomization unit, power, duration, pre-registered analysis — and read the result honestly, including a null. Use when someone proposes testing a change, asks how long a test must run or whether a result is real, when a test is about to be stopped early, or when a flat result is being read as "no difference". Not for defining the metric itself (product-analytics), not for a change too small or too rare to power, and not for authorizi.

Indexed from public GitHub and served as immutable, content-addressed versions. Install it pinned to an exact SHA-256 with the mdr CLI, and every file is verified against the hash recorded here before it reaches your agent. The deterministic audit below grades the latest version, and the same file always earns the same grade.

What the file says

# Experimentation

Most experiments fail before they launch: an unmeasurable hypothesis, a unit that leaks between
arms, or a sample that was never going to detect the effect anyone cared about. Reading results is
the short part. The design is where the answer is won or lost.

## When this fires

A change is about to be tested, a running test is about to be read or stopped, or a result is being
turned into a decision. It also fires as a refusal: when the traffic cannot support a test worth
running, saying that early is the valuable output.

## Five states, not one

- **Designed** — hypothesis, unit, primary metric, power and duration written down.
- **Launched** — assignment is live and exposures are being logged.
- **Read** — analysed at the pre-registered time, after sanity checks pass.
- **Conclusive** — the result distinguishes the hypothesis from its absence at the stated power.
- **Shipped** — a human decided to roll it out. Never a consequence of the other four.

## Procedure

1. **Write a falsifiable hypothesis with a direction and a size.** "Moving the plan selector above
   the fold will increase trial starts by at least 5% relative, because users currently scroll past
…

Read the whole file at its exact version.

How to install

Latest version
mdr add nahid-sparktales/agent-dispatcher/experimentation@git:20260919.a0d4f55
Exact content
mdr add nahid-sparktales/agent-dispatcher/experimentation@sha256:e116b7f5fe59e4c6

Pin to a label to follow the author's releases, or to a sha256 to freeze the exact bytes forever. Either way the resolved hash is written to mdr.lock, and mdr install reproduces it on any machine.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_pcyxnjywnmyigoq5.svg)](https://markdownregistry.com/a/art_pcyxnjywnmyigoq5)

1 badge views in 30 days

Versions

versioncommittedcommitsizeaudit
git:20260919.a0d4f55 latest2026-09-19 a0d4f55 8,042 BA view

Audit of the latest version

A  17 of 17 checks passed. Deterministic, no model, same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (8042 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

nahid-sparktales/agent-dispatcher · 49 stars · license MIT · pushed 2026-09-23 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_pcyxnjywnmyigoq5
GET https://markdownregistry.com/api/v1/resolve?ref=nahid-sparktales/agent-dispatcher/experimentation
GET https://markdownregistry.com/api/v1/blob/e116b7f5fe59e4c6e6a3506fa55bd8976e068a214714a8fef06b6c963e491b00

Your agent does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

More from nahid-sparktales/agent-dispatcher

agent-dispatcher skill
nahid-sparktales/agent-dispatcher · skills/agent-dispatcher/SKILL.md · Route work to a specialist role and load its task-specific guidance. Use when the user invokes /agent-dispatcher, names…
git:20260920.c183eff · audit A · 49 stars
agent-design skill
nahid-sparktales/agent-dispatcher · skills/ai/agent-design/SKILL.md · Scope an agent or subagent before it is built — the one job it owns, the smallest tool set that closes that job, what…
git:20260919.a0d4f55 · audit A · 49 stars
agent-evals skill
nahid-sparktales/agent-dispatcher · skills/ai/agent-evals/SKILL.md · Build an eval suite that can actually detect a regression — cases pulled from real traffic, graders that check…
git:20260919.a0d4f55 · audit A · 49 stars
context-engineering skill
nahid-sparktales/agent-dispatcher · skills/ai/context-engineering/SKILL.md · Decide what actually occupies the model's window — progressive disclosure through an index, retrieval versus inlining…
git:20260919.a0d4f55 · audit A · 49 stars
llm-observability skill
nahid-sparktales/agent-dispatcher · skills/ai/llm-observability/SKILL.md · See what an agent actually did — one trace per run with nested model, tool and retrieval spans, token and latency…
git:20260919.a0d4f55 · audit A · 49 stars
mcp-design skill
nahid-sparktales/agent-dispatcher · skills/ai/mcp-design/SKILL.md · Build an MCP server, or bring an existing one into a project — choosing the transport, deciding which tools, resources…
git:20260919.a0d4f55 · audit A · 49 stars
memory-design skill
nahid-sparktales/agent-dispatcher · skills/ai/memory-design/SKILL.md · Decide what an agent should remember, which layer holds it, who it is scoped to, and how a stale or contradicted memory…
git:20260919.a0d4f55 · audit A · 49 stars
model-routing skill
nahid-sparktales/agent-dispatcher · skills/ai/model-routing/SKILL.md · Pick a model per job and degrade sensibly when one fails — a quality bar per call site, candidates compared on the same…
git:20260919.a0d4f55 · audit A · 49 stars
prompt-engineering skill
nahid-sparktales/agent-dispatcher · skills/ai/prompt-engineering/SKILL.md · Write or revise a prompt so it holds up — output contract, instruction placement, examples that earn their place, an…
git:20260919.a0d4f55 · audit A · 49 stars
prompt-injection-defense skill
nahid-sparktales/agent-dispatcher · skills/ai/prompt-injection-defense/SKILL.md · Treat everything an agent reads but did not author as data rather than instructions — an explicit trust boundary, a…
git:20260919.a0d4f55 · audit A · 49 stars
retrieval-rag skill
nahid-sparktales/agent-dispatcher · skills/ai/retrieval-rag/SKILL.md · Build and fix retrieval that actually returns the right passage — structure-aware chunking, one pinned embedding model…
git:20260919.a0d4f55 · audit A · 49 stars
structured-output skill
nahid-sparktales/agent-dispatcher · skills/ai/structured-output/SKILL.md · Get parseable, trustworthy structured results out of a model — schema design, the enforcement mechanism the provider…
git:20260919.a0d4f55 · audit A · 49 stars

Every file in nahid-sparktales/agent-dispatcher

Other files named experimentation

experimentation skill
cbrock84/headcount · plugins/demand-generation/skills/experimentation/SKILL.md · Designs, runs, and reads A/B tests and growth experiments — hypothesis, sample size, duration, and honest…
git:20260901.49e89d6 · audit A · 1,664 stars

Browse by kind, by grade A, or by owner.