When the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," or "hypothesis." For tracking implementation, see analytics-tracking.
Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.
What the file says
# A/B Test Setup
You are an expert in experimentation and A/B testing. Your goal is to help design tests that produce statistically valid, actionable results.
## Initial Assessment
Before designing a test, understand:
1. **Test Context**
- What are you trying to improve?
- What change are you considering?
- What made you want to test this?
2. **Current State**
- Baseline conversion rate?
- Current traffic volume?
- Any historical test data?
3. **Constraints**
- Technical implementation complexity?
- Timeline requirements?
- Tools available?
---
## Core Principles
### 1. Start with a Hypothesis
- Not just "let's see what happens"
- Specific prediction of outcome
- Based on reasoning or data
### 2. Test One Thing
- Single variable per test
- Otherwise you don't know what worked
- Save MVT for later
### 3. Statistical Rigor
- Pre-determine sample size
- Don't peek and stop early
- Commit to the methodology
### 4. Measure What Matters
- Primary metric tied to business value
- Secondary metrics for context
- Guardrail metrics to prevent harm
---
## Hypothesis Framework
### Structure
```
Because [observation/data],
we believe [change]
…
The line at the top of this page pins the label v1.0.0, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.
GET https://markdownregistry.com/api/v1/artifacts/art_olp2rfhbpqgnf6ce
GET https://markdownregistry.com/api/v1/resolve?ref=aitytech/agentkits-marketing/ab-test-setup
GET https://markdownregistry.com/api/v1/blob/109c115627458f5bc654bcbdfca7eaf1c16b7599d12657c8bed5d7b9d567e610
Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.
aitytech/agentkits-marketing · skills/analytics-attribution/SKILL.md · Performance measurement, attribution modeling, and marketing ROI analysis. Use when setting up tracking, analyzing…
aitytech/agentkits-marketing · skills/competitor-alternatives/SKILL.md · When the user wants to create competitor comparison or alternative pages for SEO and sales enablement. Also use when…
aitytech/agentkits-marketing · skills/content-strategy/SKILL.md · Content planning, creation, and distribution strategy. Use when planning content calendars, developing content pillars…
aitytech/agentkits-marketing · skills/copy-editing/SKILL.md · When the user wants to edit, review, or improve existing marketing copy. Also use when the user mentions 'edit this…
aitytech/agentkits-marketing · skills/copywriting/SKILL.md · When the user wants to write, rewrite, or improve marketing copy for any page — including homepage, landing pages…
aitytech/agentkits-marketing · skills/document-skills/docx/SKILL.md · Comprehensive document creation, editing, and analysis with support for tracked changes, comments, formatting…
aitytech/agentkits-marketing · skills/document-skills/pdf/SKILL.md · Comprehensive PDF manipulation toolkit for extracting text and tables, creating new PDFs, merging/splitting documents…
aitytech/agentkits-marketing · skills/document-skills/pptx/SKILL.md · Presentation creation, editing, and analysis. When Claude needs to work with presentations (.pptx files) for: (1)…
aitytech/agentkits-marketing · skills/document-skills/xlsx/SKILL.md · Comprehensive spreadsheet creation, editing, and analysis with support for formulas, formatting, data analysis, and…
sickn33/agentic-awesome-skills · plugins/agentic-awesome-skills-claude/skills/ab-test-setup/SKILL.md · Use when designing an A/B or split test: define the hypothesis, control and variants, estimate sample size, verify…
leoyeai/openclaw-marketing-skills · skills/ab-test-setup/SKILL.md · When the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B…
openclaudia/openclaudia-skills · skills/ab-test-setup/SKILL.md · Design, plan, and analyze A/B tests with statistical rigor. Use when the user asks about A/B testing, split testing…
davidpc007/openclaw-marketing-skills · skills/ab-test-setup/SKILL.md · When the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B…
francostino/opencode-skills-collection · bundled-skills/ab-test-setup/SKILL.md · Use when designing an A/B or split test: define the hypothesis, control and variants, estimate sample size, verify…
aicodedecode/awesome-muse-skills · skills-imported/ab-test-setup/SKILL.md · When the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B…
