AI Skill MartBrowse skillsPromptsProgramsLearnWhat is a Skill?
 
← Back to list

Scrapling Web Extraction Helper

A step-by-step playbook for diagnosing the Scrapling CLI, choosing static vs. browser fetching, and validating extracted output.

Web & APIIntermediate★ 1,323⑂ 212AI score 8/10Last updated: Aug 8, 2026

What it does

  • Runs the bundled scripts/diagnose_scrapling.py to check your local Scrapling install before anything else.
  • Fixes missing CLI extras (uv tool install 'scrapling[shell]') and installs the Playwright browser runtime when needed.
  • Enforces an escalation order: extract get (static) → extract fetch (JS-rendered) → extract stealthy-fetch (anti-bot only).
  • Requires validating the saved file (size, title, selector target) instead of trusting the exit code.
  • Provides recovery paths for known failure modes such as local TLS trust-store errors and WeChat (mp.weixin.qq.com) article bodies.

Who it's for

  • Developers and researchers using the Scrapling CLI to pull HTML, Markdown, or text from pages.
  • Anyone scraping WeChat public articles or JavaScript-heavy pages.
  • People who keep losing time to broken scraper installs.

Examples

  1. "Save just the article body as Markdown" → scrapling extract get 'URL' article.md -s 'main', then verify with wc -c.
  2. "My WeChat extraction is empty" → use -s '#js_content' with the URL properly quoted.
  3. "scrapling --help is broken" → diagnose, then reinstall with the [shell] extra.

· · · Install guide · · ·

Try it now, no install

Paste this into Claude to use the skill without installing anything.

Read the instructions in this file and follow them to help me:
https://raw.githubusercontent.com/daymade/claude-code-skills/HEAD/scrapling-skill/SKILL.md

What I want: (describe your task here)

If Claude can't open the link, open it yourself and paste the contents instead.

↓ If it works for you, download the ZIP below and install it. Then it runs on its own — no pasting each time.

Install in the Claude app (no terminal)
  1. Download the ZIP with the button below.
  2. In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
  3. Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
↓ Download ZIP
Install in Claude Code

Let Claude do it — paste this into Claude Code

Install the skill I found on AI Skill Mart.
Copy the scrapling-skill folder from the GitHub repo daymade/claude-code-skills into my ~/.claude/skills/scrapling-skill/.
When it's done, tell me in one line what this skill can do.

Install with a command instead

git clone https://github.com/daymade/claude-code-skills.git && cp -r claude-code-skills/scrapling-skill ~/.claude/skills/scrapling-skill

⚠ This is a third-party skill. Check the source repository before installing.

  1. Open a terminal.
  2. Clone the repo: git clone https://github.com/daymade/claude-code-skills.git
  3. Copy the skill: cp -r claude-code-skills/scrapling-skill ~/.claude/skills/scrapling-skill
  4. Install the CLI: uv tool install 'scrapling[shell]' (install uv first if missing).
  5. For browser-backed fetching, run scrapling install to add the Playwright runtime.
  6. Restart Claude Code and ask something like "use scrapling to extract this URL's main content" to trigger the skill.
View source on GitHub ↗License: MIT