Claude Skill MartBrowse skillsQuick linesLearn by videoTerminal guideWhat is a Skill?
← Back to list

Robot Perception

A production-grade best-practices skill for camera/LiDAR/depth calibration and building multi-sensor robot perception pipelines.

Dev & CodingAdvanced★ 369⑂ 48AI score 9/10Last updated: Aug 12, 2026

What it does

Gives Claude a battle-tested playbook for robot perception systems.

  • Sensor landscape: comparison tables of RGB, stereo, structured light, ToF, spinning/solid-state LiDAR, IMU, force-torque, tactile and event cameras (output shape, range, rate, best use), plus a hardware-to-SDK-to-ROS2-package mapping for RealSense, ZED, OAK-D, FLIR/Basler, Velodyne, Ouster and Livox.
  • Three calibration workflows: checkerboard intrinsics with coverage tracking, sub-pixel refinement and per-image reprojection diagnostics; stereo and camera-to-LiDAR extrinsics via stereoCalibrate/solvePnP; eye-in-hand and eye-to-hand calibration via cv2.calibrateHandEye with a verification routine.
  • Quality checklists: target RMS thresholds (<0.5 px intrinsic, <1 px stereo, <5 mm hand-eye), minimum image/pose counts, and explicit triggers for recalibration (bumped camera, focus change, thermal drift).
  • Streaming architecture: dedicated capture thread, bounded deque with drop policy, timestamping at capture, and FPS/drop diagnostics.
  • Synchronization: timestamp nearest-neighbour soft sync, RealSense inter-cam hardware sync, PTP for GigE cameras.
  • RGB pipelines: precomputed undistortion maps, detection wrapper with workspace filtering and track stability, median-window depth back-projection to 3D, AprilTag/ArUco pose estimation.
  • Anti-patterns: same-thread capture+inference, unbounded buffers, sleep-based frame timing, timestamping at processing time.

Who it's for

  • Robotics engineers wiring cameras and LiDARs into ROS2 stacks
  • Developers who need hand-eye calibration for manipulation
  • Teams debugging frame misalignment or latency in multi-camera rigs
  • ML engineers deploying vision models on robot/edge hardware

Example uses

  1. "Write an eye-in-hand calibration script for a RealSense D435 on a UR5" → pose-collection loop, calibrateHandEye call, and a sub-5 mm verification step.
  2. "My checkerboard calibration reports 1.8 px RMS — why so high?" → diagnosis against the checklist: poor image coverage, fronto-parallel-only boards, autofocus drift.
  3. "My camera runs at 30 FPS but the pipeline only hits 9 FPS" → refactor into a capture thread with a deque(maxlen=2) latest-frame policy.

· · · Install guide · · ·

Try it now, no install

Paste this into Claude to use the skill without installing anything.

Read the instructions in this file and follow them to help me:
https://raw.githubusercontent.com/arpitg1304/robotics-agent-skills/HEAD/skills/robot-perception/SKILL.md

What I want: (describe your task here)

If Claude can't open the link, open it yourself and paste the contents instead.

↓ If it works for you, download the ZIP below and install it. Then it runs on its own — no pasting each time.

Install in the Claude app (no terminal)
  1. Download the ZIP with the button below.
  2. In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
  3. Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
↓ Download ZIP
Install in Claude Code

Let Claude do it — paste this into Claude Code

Install the skill I found on Claude Skill Mart.
Copy the skills/robot-perception folder from the GitHub repo arpitg1304/robotics-agent-skills into my ~/.claude/skills/robot-perception/.
When it's done, tell me in one line what this skill can do.

Install with a command instead

git clone https://github.com/arpitg1304/robotics-agent-skills.git && mkdir -p ~/.claude/skills && cp -r robotics-agent-skills/skills/robot-perception ~/.claude/skills/

⚠ This is a third-party skill. Check the source repository before installing.

  1. Open a terminal (Terminal on macOS/Linux, WSL or Git Bash on Windows).
  2. Verify Claude Code is installed: claude --version
  3. Create the skills directory: mkdir -p ~/.claude/skills
  4. Clone the repo to a temp folder: git clone https://github.com/arpitg1304/robotics-agent-skills.git /tmp/robotics-agent-skills
  5. Copy just this skill: cp -r /tmp/robotics-agent-skills/skills/robot-perception ~/.claude/skills/
  6. Confirm it landed: ls ~/.claude/skills/robot-perception should show SKILL.md.
  7. Restart Claude Code and ask something like "calibrate my camera intrinsics with a checkerboard" — the skill triggers automatically.
  8. (Optional) To actually run the sample code: pip install opencv-contrib-python numpy open3d pyrealsense2
View source on GitHub ↗License: Apache-2.0