Robot Perception
A production-grade best-practices skill for camera/LiDAR/depth calibration and building multi-sensor robot perception pipelines.
Dev & CodingAdvanced★ 346⑂ 45AI score 9/10Last updated: Aug 12, 2026
What it does
Gives Claude a battle-tested playbook for robot perception systems.
- Sensor landscape: comparison tables of RGB, stereo, structured light, ToF, spinning/solid-state LiDAR, IMU, force-torque, tactile and event cameras (output shape, range, rate, best use), plus a hardware-to-SDK-to-ROS2-package mapping for RealSense, ZED, OAK-D, FLIR/Basler, Velodyne, Ouster and Livox.
- Three calibration workflows: checkerboard intrinsics with coverage tracking, sub-pixel refinement and per-image reprojection diagnostics; stereo and camera-to-LiDAR extrinsics via
stereoCalibrate/solvePnP; eye-in-hand and eye-to-hand calibration viacv2.calibrateHandEyewith a verification routine. - Quality checklists: target RMS thresholds (<0.5 px intrinsic, <1 px stereo, <5 mm hand-eye), minimum image/pose counts, and explicit triggers for recalibration (bumped camera, focus change, thermal drift).
- Streaming architecture: dedicated capture thread, bounded deque with drop policy, timestamping at capture, and FPS/drop diagnostics.
- Synchronization: timestamp nearest-neighbour soft sync, RealSense inter-cam hardware sync, PTP for GigE cameras.
- RGB pipelines: precomputed undistortion maps, detection wrapper with workspace filtering and track stability, median-window depth back-projection to 3D, AprilTag/ArUco pose estimation.
- Anti-patterns: same-thread capture+inference, unbounded buffers,
sleep-based frame timing, timestamping at processing time.
Who it's for
- Robotics engineers wiring cameras and LiDARs into ROS2 stacks
- Developers who need hand-eye calibration for manipulation
- Teams debugging frame misalignment or latency in multi-camera rigs
- ML engineers deploying vision models on robot/edge hardware
Example uses
- "Write an eye-in-hand calibration script for a RealSense D435 on a UR5" → pose-collection loop,
calibrateHandEyecall, and a sub-5 mm verification step. - "My checkerboard calibration reports 1.8 px RMS — why so high?" → diagnosis against the checklist: poor image coverage, fronto-parallel-only boards, autofocus drift.
- "My camera runs at 30 FPS but the pipeline only hits 9 FPS" → refactor into a capture thread with a
deque(maxlen=2)latest-frame policy.
· · · Install guide · · ·
Try it now, no install
Paste this into Claude to use the skill without installing anything.
Read the instructions in this file and follow them to help me: https://raw.githubusercontent.com/arpitg1304/robotics-agent-skills/HEAD/skills/robot-perception/SKILL.md What I want: (describe your task here)
If Claude can't open the link, open it yourself and paste the contents instead.
↓ If it works for you, download the ZIP below and install it. Then it runs on its own — no pasting each time.
Install in the Claude app (no terminal)
- Download the ZIP with the button below.
- In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
- Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
Install in Claude Code
Let Claude do it — paste this into Claude Code
Install the skill I found on Claude Skill Mart. Copy the skills/robot-perception folder from the GitHub repo arpitg1304/robotics-agent-skills into my ~/.claude/skills/robot-perception/. When it's done, tell me in one line what this skill can do.
Install with a command instead
git clone https://github.com/arpitg1304/robotics-agent-skills.git && mkdir -p ~/.claude/skills && cp -r robotics-agent-skills/skills/robot-perception ~/.claude/skills/⚠ This is a third-party skill. Check the source repository before installing.
- Open a terminal (Terminal on macOS/Linux, WSL or Git Bash on Windows).
- Verify Claude Code is installed:
claude --version - Create the skills directory:
mkdir -p ~/.claude/skills - Clone the repo to a temp folder:
git clone https://github.com/arpitg1304/robotics-agent-skills.git /tmp/robotics-agent-skills - Copy just this skill:
cp -r /tmp/robotics-agent-skills/skills/robot-perception ~/.claude/skills/ - Confirm it landed:
ls ~/.claude/skills/robot-perceptionshould show SKILL.md. - Restart Claude Code and ask something like "calibrate my camera intrinsics with a checkerboard" — the skill triggers automatically.
- (Optional) To actually run the sample code:
pip install opencv-contrib-python numpy open3d pyrealsense2
View source on GitHub ↗License: Apache-2.0