Claude Skill MartBrowse skillsQuick linesLearn by videoTerminal guideWhat is a Skill?
 
← Back to list

Oxylabs Web Scraper API

Teaches Claude to call the Oxylabs Web Scraper API for block-free scraping of pages, SERPs and product data as structured JSON.

Web & APIIntermediate★ 875⑂ 2AI score 9/10Last updated: Sep 30, 2026

What it does

  • Gives Claude the exact Oxylabs endpoints (realtime.oxylabs.io, data.oxylabs.io) and JSON request format with Basic Auth from env vars.
  • Documents every core parameter — source, parse, render, geo_location, session_id, user_agent_type, plus context keys for headers, cookies, POST bodies and redirects.
  • Explains when to use one of the 40+ dedicated sources (Amazon, Google, marketplaces) versus the universal source.
  • Covers geo-targeting rules, JavaScript rendering, multi-format output (raw/parsed/png/markdown/xhr), batch Push-Pull jobs up to 5,000 values, and base64 image downloads.
  • Includes an error-code table and practical guidance such as ~180s client timeouts for rendered requests.

Who it's for

  • Data and backend engineers already using (or evaluating) Oxylabs.
  • E-commerce and marketing teams doing price monitoring, catalog collection, or SERP tracking.
  • Developers tired of maintaining their own anti-bot workarounds.

Examples

  1. "Pull the Amazon listing for ASIN B07FZ8S74R" → builds an amazon_product request with parse: true.
  2. "Get Google results for 'best laptops' as seen from California" → google_search with geo_location: "California,United States".
  3. "This page is JS-heavy, give me its content as markdown" → universal with render: "html" and the markdown result type.

· · · Install guide · · ·

Try it now, no install

Paste this into Claude to use the skill without installing anything.

Read the instructions in this file and follow them to help me:
https://raw.githubusercontent.com/oxylabs/agent-skills/HEAD/skills/web-scraper-api/SKILL.md

What I want: (describe your task here)

If Claude can't open the link, open it yourself and paste the contents instead.

↓ If it works for you, download the ZIP below and install it. Then it runs on its own — no pasting each time.

Install in the Claude app (no terminal)
  1. Download the ZIP with the button below.
  2. In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
  3. Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
↓ Download ZIP
Install in Claude Code

Let Claude do it — paste this into Claude Code

Install the skill I found on Claude Skill Mart.
Copy the skills/web-scraper-api folder from the GitHub repo oxylabs/agent-skills into my ~/.claude/skills/web-scraper-api/.
When it's done, tell me in one line what this skill can do.

Install with a command instead

git clone https://github.com/oxylabs/agent-skills.git /tmp/oxylabs-agent-skills && mkdir -p ~/.claude/skills && cp -r /tmp/oxylabs-agent-skills/skills/web-scraper-api ~/.claude/skills/

⚠ This is a third-party skill. Check the source repository before installing.

  1. Open a terminal.
  2. Clone the repo: git clone https://github.com/oxylabs/agent-skills.git
  3. Copy the skill: mkdir -p ~/.claude/skills && cp -r agent-skills/skills/web-scraper-api ~/.claude/skills/
  4. Get your Web Scraper API username and password from the Oxylabs dashboard.
  5. Add export OXY_WSA_USERNAME="..." and export OXY_WSA_PASSWORD="..." to ~/.zshrc or ~/.bashrc, then run source ~/.zshrc.
  6. Restart Claude Code and ask something like "scrape this URL and parse the product data" to trigger the skill.
View source on GitHub ↗License: MIT