scraping
16 projects share this GitHub topic
Lines connect members that are measurably related to each other. Dot size reflects stars.
🧬 Members
firecrawl
The API to search, scrape, and interact with the web at scale. 🔥
★ 157.9k
Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale…
★ 71.7k
Scrapegraph-ai
Python scraper based on AI
★ 28.8k
crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript…
★ 25.1k
crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data…
★ 9.4k
camofox-browser
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in…
★ 8.2k
autoscraper
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
★ 7.7k
trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as…
★ 6.4k
AnyCrawl
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured…
★ 3.4k
OpenOutreach
Agentic Email Automation Tool: Describe your product. Define your target market. The AI finds the leads for…
★ 2.6k
brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
★ 2.5k
thepipe
Get clean data from tricky documents, powered by vision-language models ⚡
★ 1.5k
reverse-api-engineer
The agent that turns websites into APIs!
★ 906
ketch
Fast, stateless CLI for web search and scrape. Built for AI agents.
★ 434
scraperai
ScraperAI is an open-source, AI-powered tool designed to simplify web scraping for users of all skill levels.
★ 424
llm-reader
Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web…
★ 301
🔗 Related families
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.