experiment-design SKILL.md skillA

experiment-design from rampstackco/claude-skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add rampstackco/claude-skills/experiment-design@git:20260810.e5bc675

Pins git:20260810.e5bc675 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
rampstackco/claude-skills
Path
skills/experiment-design/SKILL.md
Versions recorded
5
Latest version
git:20260810.e5bc675, committed Aug 10, 2026
First version recorded
May 5, 2026
Size
31,727 bytes
Repository stars
1,013
License
MIT

A discipline for designing experiments (A/B tests, multivariate, holdouts) so the results actually answer the question you asked. Hypothesis writing, sample size, duration, segment analysis, running discipline, matching a result to a pre-committed decision rule, and the common failure modes that produce confidently wrong shipping decisions. Use this skill whenever the user is planning a test that has not run yet: framing a hypothesis, sizing the sample, setting duration, choosing guardrails…

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Experiment Design

A senior product manager's playbook for running experiments that produce trustworthy decisions.

The default state of experimentation in most companies is sloppy. PMs run tests against vague hypotheses, look at results too early, ignore guardrails, stratify into noise, and ship features whose lift is mostly measurement error. The cost is real: ship the wrong thing, kill the right thing, learn the wrong lesson, repeat.

This skill is the discipline that prevents most of those mistakes. It assumes you have a working experimentation platform (Statsig, PostHog, GrowthBook, Optimizely, Amplitude, Eppo, Kameleoon; the platform does not matter for the principles). It assumes you have product-design and engineering pipelines that can deliver real treatment changes. The hard part is the thinking, and that is what is here.

When to use this skill: any time you are about to design or interpret an experiment. Read the relevant section before you start, not after the test is running.

---

## What this skill covers
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add rampstackco/claude-skills/experiment-design@sha256:357daa03e27b4d4b

The line at the top of this page pins the label git:20260810.e5bc675, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_cpg6lzghjlugqd2q.svg)](https://markdownregistry.com/a/art_cpg6lzghjlugqd2q)

4 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 5 versions of this file, between May 5, 2026 and Aug 10, 2026, about one every 24 days.

versioncommittedcommitsizeaudit
git:20260810.e5bc675 latest2026-08-10 e5bc675 31,727 BA view · diff
git:20260810.cd90ddd2026-08-10 cd90ddd 31,204 BA view · diff
git:20260507.ac2b0782026-05-07 ac2b078 30,568 BA view · diff
git:20260506.9b7a15f2026-05-06 9b7a15f 30,080 BA view · diff
git:20260505.c80b8962026-05-05 c80b896 30,159 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (31727 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

rampstackco/claude-skills · 1,013 stars · license MIT · pushed 2026-10-27 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_cpg6lzghjlugqd2q
GET https://markdownregistry.com/api/v1/resolve?ref=rampstackco/claude-skills/experiment-design
GET https://markdownregistry.com/api/v1/blob/357daa03e27b4d4b9f32b7a3c8311885d4792f2d33da089a608773ddce786623

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from rampstackco/claude-skills

accessibility-audit SKILL.md skill
rampstackco/claude-skills · skills/accessibility-audit/SKILL.md · Run a comprehensive WCAG accessibility audit covering perceivable, operable, understandable, and robust principles. Use…
git:20260810.e5bc675 · audit A · 1,013 stars
ads-creative-development SKILL.md skill
rampstackco/claude-skills · skills/ads-creative-development/SKILL.md · How to produce ad creative that converts at performance scale. Hook patterns, format selection, video pacing, variation…
git:20260810.63d8377 · audit A · 1,013 stars
ads-performance-analytics SKILL.md skill
rampstackco/claude-skills · skills/ads-performance-analytics/SKILL.md · How to read paid media dashboards without fooling yourself. Attribution models, platform reporting quirks…
git:20260810.e5bc675 · audit A · 1,013 stars
after-action-report SKILL.md skill
rampstackco/claude-skills · skills/after-action-report/SKILL.md · Run a structured after-action review (postmortem, retrospective) on a launch, incident, or completed project to capture…
git:20260810.e5bc675 · audit A · 1,013 stars
ai-content-collaboration SKILL.md skill
rampstackco/claude-skills · skills/ai-content-collaboration/SKILL.md · How humans and AI compose in content workflows. Where AI legitimately participates, where humans must own, hybrid…
git:20260507.ac2b078 · audit A · 1,013 stars
analytics-strategy SKILL.md skill
rampstackco/claude-skills · skills/analytics-strategy/SKILL.md · Design measurement frameworks including event taxonomy, KPI hierarchy, dashboard architecture, attribution models, and…
git:20260507.ac2b078 · audit A · 1,013 stars
art-direction SKILL.md skill
rampstackco/claude-skills · skills/art-direction/SKILL.md · Direct visual and creative work for campaigns, photography, illustration, video, and branded experiences. Use this…
git:20260810.1d637e9 · audit A · 1,013 stars
backup-and-disaster-recovery SKILL.md skill
rampstackco/claude-skills · skills/backup-and-disaster-recovery/SKILL.md · Plan and run backups, set recovery objectives, and run disaster recovery drills. Use this skill when defining RPO/RTO…
git:20260507.ac2b078 · audit A · 1,013 stars
beta-program-management SKILL.md skill
rampstackco/claude-skills · skills/beta-program-management/SKILL.md · Running closed and open betas that produce real signal. Beta participant selection, structured feedback collection…
git:20260810.e5bc675 · audit A · 1,013 stars
brand-archetype-system SKILL.md skill
rampstackco/claude-skills · skills/brand-archetype-system/SKILL.md · Apply pre-composed aesthetic archetype defaults to jumpstart brand design work covering color, typography, layout…
git:20260510.f1aa1d7 · audit A · 1,013 stars
brand-discovery SKILL.md skill
rampstackco/claude-skills · skills/brand-discovery/SKILL.md · Run upstream brand discovery covering audience research, competitive landscape, category dynamics, problem space, and…
git:20260810.e5bc675 · audit A · 1,013 stars
brand-ideation SKILL.md skill
rampstackco/claude-skills · skills/brand-ideation/SKILL.md · Generate, evaluate, and narrow brand concepts during early ideation including positioning territories, naming…
git:20260810.e5bc675 · audit A · 1,013 stars

Every file in rampstackco/claude-skills

Other files named experiment-design

experiment-design SKILL.md skill
fcakyon/labrat · plugin/skills/experiment-design/SKILL.md · Use when the user wants to design experiments, plan ablation studies, structure baselines, or create incremental…
git:20260312.ea277c2 · audit A · 452 stars
experiment-design SKILL.md skill
qa-aman/claude-skills · skills/by-role/pm/experiment-design/SKILL.md · Design product experiments to test hypotheses. Use when the user says "run an experiment", "A/B test this"…
git:20261019.be4abcc · audit A · 24 stars
experiment-design SKILL.md skill
uchicago-dsi/ai-sci-skills · skills/experiment-design/SKILL.md · Design the smallest useful experiment matrix that separates important hypotheses and changes a decision. Use when the…
git:20261013.2f47de7 · audit A · 20 stars
experiment-design SKILL.md skill
kendrick-stein/mcislab_deepread · skills/3-experiment/experiment-design/SKILL.md · 当 Supervisor 说"设计个实验""怎么验证这个 idea", 或 autoresearch 判断某个 developing/validated idea 需要实验验证时, 为 idea 设计完整实验方案
git:20260428.bf023ec · audit A · 12 stars
experiment-design SKILL.md skill
vandanaajaydubey111/great-pm · skills/experiment-design/SKILL.md · Playbook for trustworthy experiments — hypothesis framing, test types, sample size and power, statistical vs practical…
git:20260721.86de099 · audit A · 3 stars
experiment-design SKILL.md skill
vandanaajaydubey111/great-pm · plugins/great-pm/skills/experiment-design/SKILL.md · Playbook for trustworthy experiments — hypothesis framing, test types, sample size and power, statistical vs practical…
git:20260920.2cbc56d · audit A · 3 stars

Browse by kind, by grade A, or by owner.