Claude Skill MartBrowse skillsWhat is a Skill?
Back to list

Stable Baselines3 RL Assistant

Guides the full Stable Baselines3 workflow — algorithm choice, custom envs, callbacks, training and evaluation.

Dev & CodingAdvanced33,0303,248AI score 8/10Last updated: Aug 9, 2026

What it does

Built around Stable Baselines3 (SB3) 2.8, this skill lets Claude drive an end-to-end reinforcement learning workflow:

  • Algorithm selection across PPO, A2C, SAC, TD3, DDPG, DQN and HER
  • Custom gymnasium.Env templates plus check_env() validation rules (image dtype, channel order, Discrete start constraints)
  • Vectorized environments (DummyVecEnv vs SubprocVecEnv) and off-policy gradient_steps=-1 tuning
  • Callbacks: EvalCallback, CheckpointCallback, reward thresholds, custom callback scaffolding
  • Model persistence, VecNormalize statistics, evaluation and video recording
  • Learning-rate schedules, Dict observations with MultiInputPolicy, TensorBoard logging

Bundled scripts/ templates and references/ guides back up each section.

Who it's for

  • Researchers and grad students reproducing or prototyping RL experiments
  • Engineers applying single-agent RL to robotics, game AI or scheduling
  • Developers new to the SB3 API who want a safe, standard workflow

Examples

  1. "Wrap my inventory simulator as a Gymnasium env and validate it with check_env" → generates the env class and validation script
  2. "Continuous control task — pick between SAC and TD3 and write the training loop" → algorithm comparison plus training code with callbacks and TensorBoard
  3. "Evaluate my saved PPO agent over 10 episodes and record a video" → evaluate_policy and VecVideoRecorder snippets

· · · Install guide · · ·

Install in the Claude app (no terminal)
  1. Download the ZIP with the button below.
  2. In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
  3. Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
Download ZIP
Install in Claude Code

Let Claude do it — paste this into Claude Code

Install the skill I found on Claude Skill Mart.
Copy the skills/stable-baselines3 folder from the GitHub repo K-Dense-AI/scientific-agent-skills into my ~/.claude/skills/stable-baselines3/.
When it's done, tell me in one line what this skill can do.

Install with a command instead

git clone https://github.com/K-Dense-AI/scientific-agent-skills.git /tmp/scientific-agent-skills && mkdir -p ~/.claude/skills && cp -r /tmp/scientific-agent-skills/skills/stable-baselines3 ~/.claude/skills/

This is a third-party skill. Check the source repository before installing.

  1. Open a terminal.
  2. Clone the repository: git clone https://github.com/K-Dense-AI/scientific-agent-skills.git
  3. Create the skills directory: mkdir -p ~/.claude/skills
  4. Copy just this skill: cp -r scientific-agent-skills/skills/stable-baselines3 ~/.claude/skills/
  5. Install the library in a Python 3.10+ environment: uv pip install 'stable-baselines3[extra]>=2.8'
  6. Restart Claude Code and ask something like "Write a PPO CartPole training script with stable-baselines3" to trigger the skill.