Claude Skill MartBrowse skillsQuick linesLearn by videoTerminal guideWhat is a Skill?
 
← Back to list

A/B Test Plan Builder

Produces a statistically rigorous A/B or multivariate test spec — hypothesis, sample size, duration, guardrails, and go/no-go criteria.

Marketing & SEOIntermediate★ 833⑂ 137AI score 9/10Last updated: Sep 7, 2026

What it does

  • Frames an If/Then/Because hypothesis grounded in data, research, or UX principles.
  • Computes required sample size per variant via sample-size-calculator.py, forcing you to confirm whether your MDE is absolute or relative (~200× difference at a 5% baseline).
  • Estimates test duration from daily traffic, enforcing a 7-day minimum business cycle and flagging runs over 8 weeks.
  • Specifies control/variant details, primary and secondary metrics, guardrails, SRM checks, early-stopping rules, and decision thresholds.
  • Evaluates finished tests with significance-tester.py and logs learnings to the campaign tracker.

Who it's for

  • Growth and CRO practitioners optimizing landing pages, checkout flows, or CTAs.
  • Marketers who guess at test duration instead of calculating it.
  • Teams that want pre-registration discipline to avoid post-hoc rationalization.

Example uses

  1. "Pricing page converts at 5%, I want to catch a +1pp lift" → absolute-MDE sample size plus days-to-significance.
  2. "Design a multivariate test for three email subject lines" → variable matrix, multiple-comparison correction, traffic feasibility check.
  3. "My test finished — is it significant?" → plug in control/variant visitors and conversions for a significance test.

· · · Install guide · · ·

Try it now, no install

Paste this into Claude to use the skill without installing anything.

Read the instructions in this file and follow them to help me:
https://raw.githubusercontent.com/indranilbanerjee/digital-marketing-pro/HEAD/skills/ab-test-plan/SKILL.md

What I want: (describe your task here)

If Claude can't open the link, open it yourself and paste the contents instead.

↓ If it works for you, download the ZIP below and install it. Then it runs on its own — no pasting each time.

Install in the Claude app (no terminal)
  1. Download the ZIP with the button below.
  2. In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
  3. Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
↓ Download ZIP
Install in Claude Code

Let Claude do it — paste this into Claude Code

Install the skill I found on Claude Skill Mart.
Copy the skills/ab-test-plan folder from the GitHub repo indranilbanerjee/digital-marketing-pro into my ~/.claude/skills/ab-test-plan/.
When it's done, tell me in one line what this skill can do.

Install with a command instead

git clone https://github.com/indranilbanerjee/digital-marketing-pro.git /tmp/digital-marketing-pro && mkdir -p ~/.claude/skills && cp -r /tmp/digital-marketing-pro/skills/ab-test-plan ~/.claude/skills/

⚠ This is a third-party skill. Check the source repository before installing.

  1. Open a terminal.
  2. Clone the repo: git clone https://github.com/indranilbanerjee/digital-marketing-pro.git
  3. Create the skills folder: mkdir -p ~/.claude/skills
  4. Copy the skill: cp -r digital-marketing-pro/skills/ab-test-plan ~/.claude/skills/
  5. The skill calls scripts in the repo's scripts/ folder, so keep the repo in place or install the full plugin for complete functionality.
  6. Verify Python 3 is available: python3 --version
  7. Restart Claude Code and invoke it with /digital-marketing-pro:ab-test-plan or a prompt like "set up an A/B test".
  8. If no brand profile exists yet, run brand-setup first or continue with defaults.
View source on GitHub ↗License: MIT