Gate Check — LLM Cost Triage Analysis

What it does

• Reads your pipeline's entry points and prompts, then lists every bounded decision: classification, routing, filtering, yes/no triage, priority, language, "is this even for us".
• Estimates today's cost per decision (calls/day, tokens per call, cost of a wrong answer) to surface one-bit questions burning frontier calls.
• Proposes the cheapest gate that can hold each decision, in rising order: rule (regex, allowlist, header check) → classic classifier (logistic regression on a few hundred labelled examples) → small / System One model when inputs are too varied for features.
• Requires a confidence threshold and an explicit fail-closed route for every gate: unsure escalates to the big model or a human, never guesses.
• Optionally generates a baseline scaffold: label.py to sample ~200 real examples for hand-labelling, and baseline.py to train the classic classifier and print held-out accuracy — the number every vendor claim must beat.
• Emits a ranked report sorted by savings, and explicitly leaves alone decisions that genuinely need the big model.

Who it's for

• Teams running LLM agents or pipelines where API cost and latency hurt.
• Backend / ML engineers cleaning up a "send everything to the big model" architecture.
• Anyone adding a triage, routing, or filter layer in front of an agent.

Examples

1. "Our support-ticket pipeline is too expensive — find what doesn't need the big model" → identifies spam filtering, language detection, and queue assignment, and maps them to rules plus a classifier.
2. "I want a triage layer in front of my agent" → defines the label set, threshold, and escalation path for unsure cases.
3. "A vendor claims 90% accuracy with their small model — is that good?" → builds a baseline on your own data with label.py and baseline.py for a fair comparison.

Read the instructions in this file and follow them to help me:
https://raw.githubusercontent.com/undefined-ui/second-brain-os/HEAD/plugins/agents-course/skills/gate-check/SKILL.md

What I want: (describe your task here)

Install the skill I found on Claude Skill Mart.
Copy the plugins/agents-course/skills/gate-check folder from the GitHub repo undefined-ui/second-brain-os into my ~/.claude/skills/gate-check/.
When it's done, tell me in one line what this skill can do.