Scrapling integrated as OpenClaw's scraping backbone
Scrapling, an open-source scraping library, has been integrated into OpenClaw as its core scraping backbone. This addresses common issues with AI agents struggling with real-world web data, broken scrapers, Cloudflare walls, and selectors that fail when sites update.
Key features and capabilities
Unlike most scraping tools that rely on hardcoded selectors that break when websites redesign, Scrapling learns the structure of a page and adjusts automatically when things change without requiring code rewrites.
- 774x faster than BeautifulSoup with Lxml
- Works across HTTP and full browser automation
- Supports CSS, XPath, text, and regex selectors
- Async sessions for parallel scraping
- Includes a CLI so non-developers can use it without writing code
Getting started
Installation is straightforward:
pip install "scrapling[ai]"The library is fully open source under a BSD-3 license and has been gaining traction on GitHub.
📖 Read the full source: r/openclaw
👀 See Also
ddash: Mermaid Diagram Tool with URL-Based Storage and Claude Code Integration
ddash is a free Mermaid diagram tool where the entire diagram is compressed into the URL hash, requiring no backend, accounts, or storage. It includes a Claude Code skill that lets you generate and open diagrams directly during conversations with commands like /diagram the auth flow.
Jork Agentic Framework Built with Claude Ranks Top 10 in $4M Hackathon
A developer built an agentic framework called Jork using Claude and GLM models that ranked Top 10 among 2000+ applications in a $4 million hackathon. The framework autonomously developed tools including a Solana launchpad radar and a working word search game.
HF Viewer: Visualize Any Hugging Face Model Graph Instantly
HF Viewer is a browser-based tool that renders an interactive architecture graph for any Hugging Face model. Paste a URL or repo name, inspect the graph without local setup.
Claude Code Plan Mode Reduces Redo Rate from 40% to Near Zero
A developer tracked 30+ coding sessions with Claude Code and found that skipping Plan Mode resulted in redoing tasks from scratch 40% of the time. With Plan Mode, the redo rate dropped to basically zero, with one feature taking 17 minutes total versus 35+ minutes without planning.