scraping
16 projects share this GitHub topic
Lines connect members that are measurably related to each other. Dot size reflects stars.
🧬 Members
firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
★ 195.7k
Scrapling
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't…
★ 89.7k
Scrapegraph-ai
Python scraper based on AI
★ 32.3k
Jobs_Applier_AI_Agent_AIHawk
Open source AI job application bot in Python: browser automation and web scraping to read job postings, then…
★ 30.3k
crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript…
★ 26.3k
camofox-browser
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in…
★ 11.9k
crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data…
★ 9.6k
trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as…
★ 7k
brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
★ 2.7k
thepipe
Get clean data from tricky documents, powered by vision-language models ⚡
★ 1.5k
parsera
Lightweight library for scraping web-sites with LLMs
★ 1.3k
reverse-api-engineer
The agent that turns websites into APIs!
★ 1.1k
chatgpt-scraper-api
Collect structured responses from a ChatGPT scraper by sending a prompt with valid ChatGPT scraping API…
★ 1.1k · GitHub ↗
reverse-api-engineer
The agent that turns websites into APIs!
★ 911
ketch
Fast, stateless CLI for web search and scrape. Built for AI agents.
★ 532
llm-reader
Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web…
★ 301
🔗 Related families
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.