Claude Skill MartBrowse skillsWhat is a Skill?
 
← Back to list

Scrapling Web Extraction Helper

A skill that drives the Scrapling CLI to extract HTML, Markdown, or text from webpages while diagnosing install problems first.

Web & APIIntermediate★ 1,323⑂ 212AI score 8/10Last updated: Aug 8, 2026

What it does

  • Runs a bundled diagnostic script (diagnose_scrapling.py) before anything else to catch missing CLI extras or a missing Playwright/Chromium runtime.
  • Gives a clear escalation rule: try static extract get first, move to extract fetch only for JS-rendered pages, and stealthy-fetch only against anti-bot challenges.
  • Saves main content to Markdown via CSS selectors, then actually validates file size and contents instead of trusting the exit code.
  • Documents known failure modes: local SSL trust-store errors, WeChat article bodies (#js_content), and browser fetch timeouts.

Who it's for

  • Anyone archiving blog posts, news, or docs as clean Markdown for later reading or summarizing.
  • Researchers who regularly scrape awkward pages such as WeChat public-account articles.
  • Developers who want a systematic way to debug empty or truncated scrape output.

Examples

  1. "Save just the article body of this blog post as Markdown" → extract get ... -s 'main' followed by a head check of the file.
  2. "Pull this WeChat article" → extract with -s '#js_content', retrying with --no-verify if a local certificate error appears.
  3. "The output file is empty" → run the diagnostic, confirm Chromium is installed, then escalate to extract fetch --timeout 20000.

· · · Install guide · · ·

Install in the Claude app (no terminal)
  1. Download the ZIP with the button below.
  2. In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
  3. Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
↓ Download ZIP
Install in Claude Code

Let Claude do it — paste this into Claude Code

Install the skill I found on Claude Skill Mart.
Copy the scrapling-skill folder from the GitHub repo daymade/claude-code-skills into my ~/.claude/skills/scrapling-skill/.
When it's done, tell me in one line what this skill can do.

Install with a command instead

git clone https://github.com/daymade/claude-code-skills.git && mkdir -p ~/.claude/skills && cp -r claude-code-skills/scrapling-skill ~/.claude/skills/

⚠ This is a third-party skill. Check the source repository before installing.

  1. Open a terminal and go to a working folder.
  2. Clone the repository: git clone https://github.com/daymade/claude-code-skills.git
  3. Create the skills directory: mkdir -p ~/.claude/skills
  4. Copy the skill in: cp -r claude-code-skills/scrapling-skill ~/.claude/skills/
  5. Install the CLI: uv tool install 'scrapling[shell]' (install uv first if you don't have it).
  6. If you need browser-backed fetching, run scrapling install.
  7. Restart Claude Code and ask something like "Use Scrapling to save this URL's main content as Markdown" to trigger the skill.
View source on GitHub ↗License: MIT