ab-test-setup SKILL.md skillA

ab-test-setup from sickn33/agentic-awesome-skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

mdr add sickn33/agentic-awesome-skills/ab-test-setup@git:20260905.b0bf123

Pins git:20260905.b0bf123 in mdr.lock. Pin the fingerprint instead.

Audit grade

A, 17 of 17 checks passed

Kind

SKILL.md skill

Repository

sickn33/agentic-awesome-skills

Path

plugins/agentic-awesome-skills-claude/skills/ab-test-setup/SKILL.md

Versions recorded

3

Latest version

git:20260905.b0bf123, committed Sep 5, 2026

First version recorded

Jul 8, 2026

Size

8,985 bytes

Repository stars

48,329

License

MIT

Use when designing an A/B or split test: define the hypothesis, control and variants, estimate sample size, verify tracking, and predeclare metrics and stopping rules.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# A/B Test Setup

## 1️⃣ Purpose & Scope

Define an experiment that can answer a specific product question, and verify its assumptions before exposing users. This procedure cannot guarantee validity by itself.

- Documents the stopping rule
- Estimates sample needs under stated assumptions
- Makes the hypothesis and decision criteria reviewable

---

## 2️⃣ Pre-Requisites

You must have:

- A clear user problem
- Access to an analytics source
- Roughly estimated traffic volume

### Hypothesis Quality Checklist

A valid hypothesis includes:

- Observation or evidence
- Single, specific change
- Directional expectation
- Defined audience
- Measurable success criteria

---

## 3️⃣ Hypothesis Lock (Hard Gate)

Before designing variants or metrics, you MUST:

- Present the **final hypothesis**
- Specify:
  - Target audience
  - Primary metric
  - Expected direction of effect
  - Minimum Detectable Effect (MDE)

Use the hypothesis already agreed in the task. If a launch-critical choice is missing, present the concrete choice for confirmation while continuing independent analysis. Do not repeatedly request approval for a decision already authorized.

---
…

Read the whole file at its exact version.

How to install

mdr add sickn33/agentic-awesome-skills/ab-test-setup@sha256:f5376f3e111a5c24

[![mdr](https://markdownregistry.com/badge/art_jnomilyjoloyfhyk.svg)](https://markdownregistry.com/a/art_jnomilyjoloyfhyk)

Versions

The registry has recorded 3 versions of this file, between Jul 8, 2026 and Sep 5, 2026, about one every 29 days.

Audit of the latest version

Source

API

GET https://markdownregistry.com/api/v1/artifacts/art_jnomilyjoloyfhyk
GET https://markdownregistry.com/api/v1/resolve?ref=sickn33/agentic-awesome-skills/ab-test-setup
GET https://markdownregistry.com/api/v1/blob/f5376f3e111a5c244bb894d984068d78c40ce973c69d59d90cb01b5f07a67539

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from sickn33/agentic-awesome-skills

Every file in sickn33/agentic-awesome-skills

Other files named ab-test-setup

Browse by kind, by grade A, or by owner.