web-crawling
5 projects share this GitHub topic
Lines connect members that are measurably related to each other. Dot size reflects stars.
🧬 Members
crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript…
★ 25.6k
crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data…
★ 9.5k
brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
★ 2.6k
moli
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
★ 1.6k
Craw4LLM
Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"
★ 664
🔗 Related families
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.