experiment-design SKILL.md skillA

experiment-design from fcakyon/labrat is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add fcakyon/labrat/experiment-design@git:20260312.ea277c2

Pins git:20260312.ea277c2 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
fcakyon/labrat
Path
plugin/skills/experiment-design/SKILL.md
Versions recorded
1
Latest version
git:20260312.ea277c2, committed Mar 12, 2026
Size
3,976 bytes
Repository stars
452
License
MIT

Use when the user wants to design experiments, plan ablation studies, structure baselines, or create incremental evaluation strategies. Triggers on phrases like "design ablation", "plan experiment", "what experiments should I run", "baseline comparison", or "experiment matrix".

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Experiment Design Methodology

You are helping a researcher design rigorous experiments. Follow this methodology systematically.

## Step 1: Understand the Research Question

Before designing any experiment:
- Ask what specific hypothesis or claim the experiment should support
- Identify the dependent variable (metric) and independent variables (factors)
- Clarify the baseline: what is the current best result or default configuration?

## Step 2: Single-Variable Isolation

Every ablation study must change exactly ONE variable at a time. For each factor:

1. **Define the factor** — what is being varied (e.g., loss function, learning rate, architecture component)
2. **List levels** — all values this factor will take (e.g., CE, focal, VAR)
3. **Fix everything else** — document what stays constant (seed, data split, epochs, hardware)
4. **Predict outcome** — before running, state what you expect and why

Template for each ablation row:
```
| Run ID | Factor | Value | Fixed Config | Expected Outcome |
|--------|--------|-------|-------------|-----------------|
```

## Step 3: Experiment Matrix

For multi-factor studies, use a structured matrix:
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add fcakyon/labrat/experiment-design@sha256:31f7d7dafccb976f

The line at the top of this page pins the label git:20260312.ea277c2, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_hhgjad6xptjq7z7a.svg)](https://markdownregistry.com/a/art_hhgjad6xptjq7z7a)

2 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 1 version of this file, committed on Mar 12, 2026.

versioncommittedcommitsizeaudit
git:20260312.ea277c2 latest2026-03-12 ea277c2 3,976 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (3976 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

fcakyon/labrat · 452 stars · license MIT · pushed 2026-11-01 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_hhgjad6xptjq7z7a
GET https://markdownregistry.com/api/v1/resolve?ref=fcakyon/labrat/experiment-design
GET https://markdownregistry.com/api/v1/blob/31f7d7dafccb976f478a12f6d472af2fd53d79e37e339e210594076f3a3e2771

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from fcakyon/labrat

compare SKILL.md skill
fcakyon/labrat · plugin/skills/compare/SKILL.md · Same-epoch comparison and analysis of training runs across wandb, neptune, tensorboard, mlflow, or local result files…
git:20261030.b34f8aa · audit A · 452 stars
dataset-curation SKILL.md skill
fcakyon/labrat · plugin/skills/dataset-curation/SKILL.md · Use when the user wants to analyze dataset bias, create stratified samples, evaluate fairness, or plan dataset…
git:20260312.ea277c2 · audit A · 452 stars
debug SKILL.md skill
fcakyon/labrat · plugin/skills/debug/SKILL.md · Evidence-before-action diagnosis of failing ML experiments. Probes the system before guessing causes, process list…
git:20260430.e4e97e0 · audit A · 452 stars
launch SKILL.md skill
fcakyon/labrat · plugin/skills/launch/SKILL.md · Pre-flight checklist for long-running ML training jobs covering config diff, run naming, path verification, monitoring…
git:20261030.3dd54cf · audit A · 452 stars
literature-research SKILL.md skill
fcakyon/labrat · plugin/skills/literature-research/SKILL.md · Use when the user wants to find related work, survey a research area, run a literature gap analysis, or discover…
git:20261030.3dd54cf · audit A · 452 stars
paper-check SKILL.md skill
fcakyon/labrat · plugin/skills/paper-check/SKILL.md · Check a paper against its code, results and citations before submission (numbers, terms, code vs paper, formulas vs…
git:20261030.3dd54cf · audit A · 452 stars
paper-write SKILL.md skill
fcakyon/labrat · plugin/skills/paper-write/SKILL.md · Write, structure, or revise academic paper sections, keep notation consistent, refine figures and tables, and set up or…
git:20261030.3dd54cf · audit A · 452 stars
rebuttal SKILL.md skill
fcakyon/labrat · plugin/skills/rebuttal/SKILL.md · Prepare a paper for peer review. Reads the paper and experiment results, selects the strongest ablations, anticipates…
git:20261030.b34f8aa · audit A · 452 stars
reproduce SKILL.md skill
fcakyon/labrat · plugin/skills/reproduce/SKILL.md · End-to-end paper reproduction from arxiv URL through smoke runs to replication experiments. Handles missing or partial…
git:20261030.b34f8aa · audit A · 452 stars
setup SKILL.md skill
fcakyon/labrat · plugin/skills/setup/SKILL.md · 30-second auto-detection tour, then optional configuration of notifications, CLI allowlist, research CLAUDE.md rules…
git:20261030.b34f8aa · audit A · 452 stars

Every file in fcakyon/labrat

Other files named experiment-design

experiment-design SKILL.md skill
rampstackco/claude-skills · skills/experiment-design/SKILL.md · A discipline for designing experiments (A/B tests, multivariate, holdouts) so the results actually answer the question…
git:20260810.e5bc675 · audit A · 1,013 stars
experiment-design SKILL.md skill
qa-aman/claude-skills · skills/by-role/pm/experiment-design/SKILL.md · Design product experiments to test hypotheses. Use when the user says "run an experiment", "A/B test this"…
git:20261019.be4abcc · audit A · 24 stars
experiment-design SKILL.md skill
uchicago-dsi/ai-sci-skills · skills/experiment-design/SKILL.md · Design the smallest useful experiment matrix that separates important hypotheses and changes a decision. Use when the…
git:20261013.2f47de7 · audit A · 20 stars
experiment-design SKILL.md skill
kendrick-stein/mcislab_deepread · skills/3-experiment/experiment-design/SKILL.md · 当 Supervisor 说"设计个实验""怎么验证这个 idea", 或 autoresearch 判断某个 developing/validated idea 需要实验验证时, 为 idea 设计完整实验方案
git:20260428.bf023ec · audit A · 12 stars
experiment-design SKILL.md skill
vandanaajaydubey111/great-pm · skills/experiment-design/SKILL.md · Playbook for trustworthy experiments — hypothesis framing, test types, sample size and power, statistical vs practical…
git:20260721.86de099 · audit A · 3 stars
experiment-design SKILL.md skill
vandanaajaydubey111/great-pm · plugins/great-pm/skills/experiment-design/SKILL.md · Playbook for trustworthy experiments — hypothesis framing, test types, sample size and power, statistical vs practical…
git:20260920.2cbc56d · audit A · 3 stars

Browse by kind, by grade A, or by owner.