Stable Baselines3 RL Assistant
Guides the full Stable Baselines3 workflow — algorithm choice, custom envs, callbacks, training and evaluation.
Dev & CodingAdvanced★ 33,030⑂ 3,248AI score 8/10Last updated: Aug 9, 2026
What it does
Built around Stable Baselines3 (SB3) 2.8, this skill lets Claude drive an end-to-end reinforcement learning workflow:
- Algorithm selection across PPO, A2C, SAC, TD3, DDPG, DQN and HER
- Custom
gymnasium.Envtemplates pluscheck_env()validation rules (image dtype, channel order, Discrete start constraints) - Vectorized environments (DummyVecEnv vs SubprocVecEnv) and off-policy
gradient_steps=-1tuning - Callbacks: EvalCallback, CheckpointCallback, reward thresholds, custom callback scaffolding
- Model persistence, VecNormalize statistics, evaluation and video recording
- Learning-rate schedules, Dict observations with MultiInputPolicy, TensorBoard logging
Bundled scripts/ templates and references/ guides back up each section.
Who it's for
- Researchers and grad students reproducing or prototyping RL experiments
- Engineers applying single-agent RL to robotics, game AI or scheduling
- Developers new to the SB3 API who want a safe, standard workflow
Examples
- "Wrap my inventory simulator as a Gymnasium env and validate it with check_env" → generates the env class and validation script
- "Continuous control task — pick between SAC and TD3 and write the training loop" → algorithm comparison plus training code with callbacks and TensorBoard
- "Evaluate my saved PPO agent over 10 episodes and record a video" →
evaluate_policyandVecVideoRecordersnippets
· · · Install guide · · ·
Install in the Claude app (no terminal)
- Download the ZIP with the button below.
- In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
- Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
Install in Claude Code
Let Claude do it — paste this into Claude Code
Install the skill I found on Claude Skill Mart. Copy the skills/stable-baselines3 folder from the GitHub repo K-Dense-AI/scientific-agent-skills into my ~/.claude/skills/stable-baselines3/. When it's done, tell me in one line what this skill can do.
Install with a command instead
git clone https://github.com/K-Dense-AI/scientific-agent-skills.git /tmp/scientific-agent-skills && mkdir -p ~/.claude/skills && cp -r /tmp/scientific-agent-skills/skills/stable-baselines3 ~/.claude/skills/⚠ This is a third-party skill. Check the source repository before installing.
- Open a terminal.
- Clone the repository:
git clone https://github.com/K-Dense-AI/scientific-agent-skills.git - Create the skills directory:
mkdir -p ~/.claude/skills - Copy just this skill:
cp -r scientific-agent-skills/skills/stable-baselines3 ~/.claude/skills/ - Install the library in a Python 3.10+ environment:
uv pip install 'stable-baselines3[extra]>=2.8' - Restart Claude Code and ask something like "Write a PPO CartPole training script with stable-baselines3" to trigger the skill.
View source on GitHub ↗License: MIT