Claude Skill MartBrowse skillsQuick linesLearn by videoTerminal guideWhat is a Skill?
 
← Back to list

Experiment Design Methodology

A 7-step methodology skill for designing ablations, baselines, experiment matrices, and analysis plans.

Data & AnalyticsIntermediate★ 377⑂ 33AI score 7/10Last updated: Jul 3, 2026

What it does

  • Clarifies the research question, hypothesis, dependent/independent variables, and baseline first.
  • Builds ablation tables enforcing the "change exactly ONE variable" rule, with fixed config and predicted outcome columns.
  • Chooses a multi-factor strategy (full factorial, sequential elimination, Latin square) and lays out the experiment matrix.
  • Estimates GPU hours, API costs, storage, and wall-clock time, flagging plans that blow the budget.
  • Generates config stubs matching your project's format plus an execution script and a pre-registered analysis plan.

Who it's for

  • Grad students and researchers designing ablation studies for papers.
  • ML engineers drowning in experiment combinations who need structure.
  • Research teams standardizing reproducibility (fixed seeds, documented constants).

Examples

  1. "Design an ablation for the loss function" → a matrix table across CE/focal/VAR with fixed settings and expected results.
  2. "How many GPU hours will this cost?" → runs × time-per-run estimate plus checkpoint storage.
  3. "Give me the run order and a script" → baselines first, parallelizable runs marked, plus metrics and plots to produce.

· · · Install guide · · ·

Try it now, no install

Paste this into Claude to use the skill without installing anything.

Read the instructions in this file and follow them to help me:
https://raw.githubusercontent.com/fcakyon/phd-skills/HEAD/plugin/skills/experiment-design/SKILL.md

What I want: (describe your task here)

If Claude can't open the link, open it yourself and paste the contents instead.

↓ If it works for you, download the ZIP below and install it. Then it runs on its own — no pasting each time.

Install in the Claude app (no terminal)
  1. Download the ZIP with the button below.
  2. In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
  3. Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
↓ Download ZIP
Install in Claude Code

Let Claude do it — paste this into Claude Code

Install the skill I found on Claude Skill Mart.
Copy the plugin/skills/experiment-design folder from the GitHub repo fcakyon/phd-skills into my ~/.claude/skills/experiment-design/.
When it's done, tell me in one line what this skill can do.

Install with a command instead

git clone https://github.com/fcakyon/phd-skills.git && mkdir -p ~/.claude/skills && cp -r phd-skills/plugin/skills/experiment-design ~/.claude/skills/

⚠ This is a third-party skill. Check the source repository before installing.

  1. Open a terminal.
  2. Clone the repo: git clone https://github.com/fcakyon/phd-skills.git
  3. Create the skills directory: mkdir -p ~/.claude/skills
  4. Copy the skill: cp -r phd-skills/plugin/skills/experiment-design ~/.claude/skills/
  5. Restart Claude Code and try "plan experiment" or "design ablation" to trigger it.
  6. Run it inside your project directory so it can read your existing configs and match their format.
View source on GitHub ↗License: MIT