HypoGeniC Hypothesis-Generation Auditor
Plans, validates, and evaluates ChicagoHAI HypoGeniC/HypoRefine runs for LLM-assisted hypothesis generation from labeled text data.
Data & AnalyticsAdvanced★ 33,030⑂ 3,248AI score 8/10Last updated: Aug 9, 2026
What it does
Enforces a local-review-first workflow around the ChicagoHAI hypogenic package (HypoGeniC / HypoRefine).
- Reproducible install of pinned
hypogenic==0.3.5with wheel/sdist SHA-256 in an isolated environment - Separates and validates the official task YAML config from this skill's local run policy JSON
- Dataset audit: manifest checksums, schemas, label counts, and cross-split duplicate (leakage) detection
- Conservative upper-bound cost/run planning from request and per-request token caps
- Redacted inspection of hypothesis banks and prediction files (no raw candidate text)
- Model-free evaluation: accuracy, coverage, macro-F1, confusion matrix
- Provider privacy gate covering OpenAI/Anthropic retention and ZDR caveats
Bundled scripts are deterministic and local-only: they never import hypogenic, read .env, or contact a model.
Who it's for
- Researchers and grad students experimenting with LLM-driven hypothesis generation on labeled datasets
- ML engineers who need reproducible HypoBench benchmark runs
- Teams that must bound API spend and prevent sensitive data from leaving the machine
Examples
- "Check the HypoBench review dataset for split leakage before I run hypogenic" →
audit_dataset.pyreturns checksums and duplicate groups, failing the gate on cross-split duplicates. - "I plan 300 GPT calls — what's the worst-case cost?" → fill prices in a reviewed run config and run
plan_run.pyfor an upper bound plus a ready/not-ready verdict. - "Just compute macro-F1 and a confusion matrix from my saved test predictions" →
evaluate_local.py reportproduces metrics with explicit scientific limitations.
· · · Install guide · · ·
Install in the Claude app (no terminal)
- Download the ZIP with the button below.
- In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
- Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
Install in Claude Code
Let Claude do it — paste this into Claude Code
Install the skill I found on Claude Skill Mart. Copy the skills/hypogenic folder from the GitHub repo K-Dense-AI/scientific-agent-skills into my ~/.claude/skills/hypogenic/. When it's done, tell me in one line what this skill can do.
Install with a command instead
git clone https://github.com/K-Dense-AI/scientific-agent-skills.git && cp -r scientific-agent-skills/skills/hypogenic ~/.claude/skills/hypogenic⚠ This is a third-party skill. Check the source repository before installing.
- Open a terminal and create the skills folder:
mkdir -p ~/.claude/skills - Clone the repository:
git clone https://github.com/K-Dense-AI/scientific-agent-skills.git - Copy just this skill:
cp -r scientific-agent-skills/skills/hypogenic ~/.claude/skills/hypogenic - Install Python 3.10+ and
uv(e.g.curl -LsSf https://astral.sh/uv/install.sh | sh). - Only when you need real runs, create an isolated env:
uv venv --python 3.12 .venv && uv pip install "hypogenic==0.3.5" - Restart Claude Code and ask something like "plan a hypogenic generation run" to confirm the skill loads.
- Set provider keys only as environment variables (
OPENAI_API_KEYorANTHROPIC_API_KEY) — never inside config files. - Run
scripts/validate_config.pyandscripts/audit_dataset.pyfirst, and approve external model calls only after the local checks pass.
View source on GitHub ↗License: MIT