⬢github Python · 96.4K ★ +4.3K since we first saw it · pushed 1 h ago · BSD-3-Clause
D4Vinci/Scrapling
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Scrapling is a Python web scraping framework that aims to cover everything from single requests to full-scale crawls. It supports stealth scraping, Playwright-based automation, XPath/CSS selectors, and exposes an MCP server and AI agent skills so AI assistants can use it for data extraction tasks.
Why now: It has grown extremely popular (~92k stars) and is trending, with recent focus on AI integration like MCP server support and agent skills.
Who it is for: Python developers and data engineers who need robust, stealth-capable scraping, including those wiring scraping into AI agents.
aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-server
Stars over our 228 snapshots: 92.1K to 96.4K, since 2 d ago.
Where people talked about it
- ⬢github D4Vinci/Scrapling 11 min ago
API: https://socialmediatrends-api.osmike.com/v1/repos/D4Vinci/Scrapling