Claude Skill MartBrowse skillsQuick linesLearn by videoTerminal guideWhat is a Skill?
Back to list

Robot Perception

A production-grade best-practices skill for camera/LiDAR/depth calibration and building multi-sensor robot perception pipelines.

Dev & CodingAdvanced34645AI score 9/10Last updated: Aug 12, 2026

What it does

Gives Claude a battle-tested playbook for robot perception systems.

  • Sensor landscape: comparison tables of RGB, stereo, structured light, ToF, spinning/solid-state LiDAR, IMU, force-torque, tactile and event cameras (output shape, range, rate, best use), plus a hardware-to-SDK-to-ROS2-package mapping for RealSense, ZED, OAK-D, FLIR/Basler, Velodyne, Ouster and Livox.
  • Three calibration workflows: checkerboard intrinsics with coverage tracking, sub-pixel refinement and per-image reprojection diagnostics; stereo and camera-to-LiDAR extrinsics via stereoCalibrate/solvePnP; eye-in-hand and eye-to-hand calibration via cv2.calibrateHandEye with a verification routine.
  • Quality checklists: target RMS thresholds (<0.5 px intrinsic, <1 px stereo, <5 mm hand-eye), minimum image/pose counts, and explicit triggers for recalibration (bumped camera, focus change, thermal drift).
  • Streaming architecture: dedicated capture thread, bounded deque with drop policy, timestamping at capture, and FPS/drop diagnostics.
  • Synchronization: timestamp nearest-neighbour soft sync, RealSense inter-cam hardware sync, PTP for GigE cameras.
  • RGB pipelines: precomputed undistortion maps, detection wrapper with workspace filtering and track stability, median-window depth back-projection to 3D, AprilTag/ArUco pose estimation.
  • Anti-patterns: same-thread capture+inference, unbounded buffers, sleep-based frame timing, timestamping at processing time.

Who it's for

  • Robotics engineers wiring cameras and LiDARs into ROS2 stacks
  • Developers who need hand-eye calibration for manipulation
  • Teams debugging frame misalignment or latency in multi-camera rigs
  • ML engineers deploying vision models on robot/edge hardware

Example uses

  1. "Write an eye-in-hand calibration script for a RealSense D435 on a UR5" → pose-collection loop, calibrateHandEye call, and a sub-5 mm verification step.
  2. "My checkerboard calibration reports 1.8 px RMS — why so high?" → diagnosis against the checklist: poor image coverage, fronto-parallel-only boards, autofocus drift.
  3. "My camera runs at 30 FPS but the pipeline only hits 9 FPS" → refactor into a capture thread with a deque(maxlen=2) latest-frame policy.

· · · Install guide · · ·

Try it now, no install

Paste this into Claude to use the skill without installing anything.

Read the instructions in this file and follow them to help me:
https://raw.githubusercontent.com/arpitg1304/robotics-agent-skills/HEAD/skills/robot-perception/SKILL.md

What I want: (describe your task here)

If Claude can't open the link, open it yourself and paste the contents instead.

If it works for you, download the ZIP below and install it. Then it runs on its own — no pasting each time.

Install in the Claude app (no terminal)
  1. Download the ZIP with the button below.
  2. In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
  3. Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
Download ZIP
Install in Claude Code

Let Claude do it — paste this into Claude Code

Install the skill I found on Claude Skill Mart.
Copy the skills/robot-perception folder from the GitHub repo arpitg1304/robotics-agent-skills into my ~/.claude/skills/robot-perception/.
When it's done, tell me in one line what this skill can do.

Install with a command instead

git clone https://github.com/arpitg1304/robotics-agent-skills.git && mkdir -p ~/.claude/skills && cp -r robotics-agent-skills/skills/robot-perception ~/.claude/skills/

This is a third-party skill. Check the source repository before installing.

  1. Open a terminal (Terminal on macOS/Linux, WSL or Git Bash on Windows).
  2. Verify Claude Code is installed: claude --version
  3. Create the skills directory: mkdir -p ~/.claude/skills
  4. Clone the repo to a temp folder: git clone https://github.com/arpitg1304/robotics-agent-skills.git /tmp/robotics-agent-skills
  5. Copy just this skill: cp -r /tmp/robotics-agent-skills/skills/robot-perception ~/.claude/skills/
  6. Confirm it landed: ls ~/.claude/skills/robot-perception should show SKILL.md.
  7. Restart Claude Code and ask something like "calibrate my camera intrinsics with a checkerboard" — the skill triggers automatically.
  8. (Optional) To actually run the sample code: pip install opencv-contrib-python numpy open3d pyrealsense2
View source on GitHubLicense: Apache-2.0