Claude Skill MartBrowse skillsQuick linesLearn by videoTerminal guideWhat is a Skill?
 
← Back to list

A/B Test Readout

Turns finished A/B test numbers into an honest readout with a ship/no-ship verdict, significance checks and segment cuts.

Data & AnalyticsIntermediate★ 1,319⑂ 232AI score 8/10Last updated: Aug 28, 2026

What it does

  • Opens with a one-line verdict — Ship / Don't ship / Inconclusive — plus the headline number.
  • Builds a results table (primary + guardrail metrics) with relative lift and p-value / confidence interval.
  • Separates statistical from practical significance, so tiny-but-significant lifts don't get shipped.
  • Interrogates the classic ways A/B results mislead: sample/power, peeking, novelty and primacy effects, and wins driven by a single segment.
  • Adds segment cuts (new vs returning, platform, geography) and a recommendation with post-launch monitoring or a follow-up test.

Who it's for

  • PMs and growth folks who have to write the decision doc after an experiment.
  • Leads translating analyst output into a team-readable call.
  • Teams that tend to ignore guardrail regressions and ship early.

Examples

  1. "Checkout copy test is done: control 4.1% (n=12,000), variant 4.4% (n=11,800), ran 2 weeks — write the readout."
  2. "Primary is +6% but refund rate ticked up" → recommends holding the ship because of the guardrail regression.
  3. "We hit significance on day 5, can we ship?" → flags peeking and the sample still needed.

· · · Install guide · · ·

Try it now, no install

Paste this into Claude to use the skill without installing anything.

Read the instructions in this file and follow them to help me:
https://raw.githubusercontent.com/mohitagw15856/pm-claude-skills/HEAD/exports/openclaw/ab-test-readout/SKILL.md

What I want: (describe your task here)

If Claude can't open the link, open it yourself and paste the contents instead.

↓ If it works for you, download the ZIP below and install it. Then it runs on its own — no pasting each time.

Install in the Claude app (no terminal)
  1. Download the ZIP with the button below.
  2. In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
  3. Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
↓ Download ZIP
Install in Claude Code

Let Claude do it — paste this into Claude Code

Install the skill I found on Claude Skill Mart.
Copy the exports/openclaw/ab-test-readout folder from the GitHub repo mohitagw15856/pm-claude-skills into my ~/.claude/skills/ab-test-readout/.
When it's done, tell me in one line what this skill can do.

Install with a command instead

git clone https://github.com/mohitagw15856/pm-claude-skills.git /tmp/pm-claude-skills && mkdir -p ~/.claude/skills/ab-test-readout && cp -r /tmp/pm-claude-skills/exports/openclaw/ab-test-readout/* ~/.claude/skills/ab-test-readout/

⚠ This is a third-party skill. Check the source repository before installing.

  1. Open your terminal.
  2. Clone the repo: git clone https://github.com/mohitagw15856/pm-claude-skills.git
  3. Create the skill folder: mkdir -p ~/.claude/skills/ab-test-readout
  4. Copy the files: cp -r pm-claude-skills/exports/openclaw/ab-test-readout/* ~/.claude/skills/ab-test-readout/
  5. Restart Claude Code and ask something like "write the A/B test readout for these results".
  6. For best output, supply the hypothesis, primary metric, per-arm sample size and conversions, test duration, and any guardrail metrics.
View source on GitHub ↗License: MIT