crawler

24 projets partagent ce topic GitHub

Les traits relient les membres réellement apparentés entre eux. La taille des points suit les étoiles.

🧬 Membres

The API to search, scrape, and interact with the web at scale. 🔥

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale…

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/…

Python scraper based on AI

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript…

🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn…

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data…

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as…

A community-driven way to read and chat with AI bots - powered by chatGPT.

Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language…

Leaked GPTs Prompts Bypass the 25 message limit or to try out GPTs without a Plus subscription.

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust.…

Flexible Node.js AI-assisted crawler library

Google, Naver multiprocess image web crawler (Selenium)

Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud…

ChatWeb can crawl web pages, read PDF, DOCX, TXT, and extract the main content, then answer your questions…

hacker-news-digest

:newspaper: Let ChatGPT Summarize Hacker News for You

Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"

Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions,…

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for…

Fast-Powerful-Whisper-AI-Services-API

⚡ 一款用于自动语音识别 (ASR)、翻译的高性能异步 API。不需要购买Whisper…

ScraperAI is an open-source, AI-powered tool designed to simplify web scraping for users of all skill levels.

Use LLMs to robustly extract web data

🔗 Familles voisines

web-scraping 33 scraper 17 data-extraction 12 scraping 16 web-crawler 13 html-to-markdown 12 markdown 77 web-scraper 9

Mesuré à partir des topics GitHub communs aux deux projets, pondérés par leur rareté.