Scrapling
An adaptive web scraping framework capable of handling everything from single requests to large-scale scraping.
- Type
- MCP
- Transport
- http
- Open source
- Yes
- GitHub Stars
- ★ 65.7k
- Source
- mcp-github
- Repository
- github.com/D4Vinci/Scrapling
Overview
Scrapling is an adaptive web scraping framework that can manage tasks ranging from single requests to large-scale scraping. Its parser learns from website changes and automatically re-locates elements when pages are updated. Its scraper can bypass anti-bot systems such as Cloudflare Turnstile. Its spider framework allows you to scale to concurrent, multi-session scraping and supports pause/resume functionality and automatic proxy rotation. Achievable with just a few lines of Python code. Ideal for AI developers and engineers requiring large-scale data scraping and analysis.
Capabilities
- ▪Adaptive Parser
- ▪Bypass Anti-Bot Systems
- ▪Concurrent Multi-Session Scraping
- ▪Automatic Proxy Rotation
- ▪Real-time Statistics and Streaming
Use cases
Setup
pip install scrapling
This information was compiled by AI from public sources and may contain inaccuracies — please refer to the source.
FAQ
Does Scrapling support dynamic content scraping?
Yes, Scrapling supports dynamic content scraping.
Can Scrapling bypass anti-crawling systems?
Yes, Scrapling can bypass anti-crawling systems such as Cloudflare Turnstile.
Related skills
TrendRadar
An AI-driven tool for sentiment monitoring and trend analysis, supporting multi-platform aggregation, RSS subscription, and intelligent notifications.
gpt-researcher
An autonomous agent for deep research using any LLM provider.
Deep-Research-skills
Provides structured deep research capabilities for Claude Code, OpenCode, and Codex, supporting a two-phase research process.
SurfSense
SurfSense is an open-source AI agent network research platform providing real-time data connectivity via REST API or MCP server.
video-search-and-summarization
NVIDIA Video Search and Summarization Blueprint enables real-time video analytics, visual question answering, and automated reporting.
google-maps-scraper
Scrape business data from Google Maps, such as name, address, phone number, etc.