web-crawling
6 projetos partilham este topic do GitHub
Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.
🧬 Membros
crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run…
★ 86.4k
crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript…
★ 26.3k
moli
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
★ 21.2k
crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data…
★ 9.6k
brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
★ 2.7k
Craw4LLM
Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"
★ 666
🔗 Familias relacionadas
Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.