web-scraping
45 progetti condividono questo topic GitHub
Le linee collegano membri che sono misurabilmente correlati tra loro. La dimensione dei punti riflette le stelle.
🧬 Membri
firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
★ 195.7k
browser-use
Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent…
★ 119.2k
Scrapling
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't…
★ 89.7k
crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run…
★ 86.4k
ai-website-cloner-template
Clone any website with one command using AI coding agents
★ 37.4k
CloakBrowser
Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level…
★ 32.5k
Scrapegraph-ai
Python scraper based on AI
★ 32.3k
Jobs_Applier_AI_Agent_AIHawk
Open source AI job application bot in Python: browser automation and web scraping to read job postings, then…
★ 30.3k
crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript…
★ 26.3k
moli
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
★ 21.2k
Douyin_TikTok_Download_API
🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API，支持 AI agent 通过 MCP…
★ 20.9k · GitHub ↗
maxun
🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn…
★ 17.3k
SurfSense
Air-gapped, privacy-focused, open-source NotebookLM alternative. AI agent that researches, transforms, and…
★ 16.6k
nanobrowser
Open-source AI agent for web automation. Use your real, logged-in browser to automate daily tasks.
★ 14.2k
SeleniumBase
📊 Python APIs for Web Automation, Testing, and Scraping. CDP Mode launches a stealth browser that bypasses…
★ 13.2k · GitHub ↗
camofox-browser
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in…
★ 11.9k
crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data…
★ 9.6k
firecrawl-mcp-server
Official Firecrawl MCP server, the context API for AI agents: search, scrape, and interact with the web, plus…
★ 7.7k
trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as…
★ 7k
skills
Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms…
★ 6.3k
wigolo
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys,…
★ 5.5k
brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
★ 2.7k
webclaw
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust.…
★ 2.4k
open-scouts
🔥 AI-powered web monitoring platform. Create automated scouts that search the web and send email alerts…
★ 1.4k
ShardBrowser
Free, open-source anti-detect browser launcher for web scraping and multi-accounting. By the ProxyShard team.…
★ 1.3k
WebAI2API
★ 1.3k
reverse-api-engineer
The agent that turns websites into APIs!
★ 1.1k
chatgpt-scraper-api
Collect structured responses from a ChatGPT scraper by sending a prompt with valid ChatGPT scraping API…
★ 1.1k · GitHub ↗
crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for…
★ 1.1k · GitHub ↗
crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for…
★ 1.1k
ovobrowser
源码级 Chromium 指纹内核，检测站按普通 Chrome 评分。Source-level Chromium fingerprint kernel…
★ 1k · GitHub ↗
x-reader
Universal content reader MCP Server for 10+ platforms
★ 962
reverse-api-engineer
The agent that turns websites into APIs!
★ 911
agent-skills
Official Agent skills of Oxylabs products
★ 846
reader
Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions,…
★ 558
ketch
Fast, stateless CLI for web search and scrape. Built for AI agents.
★ 532
oc
Turn any website into a compact CLI tailored for AI agents. Browse the web in hundreds of tokens, not tens of…
★ 422
kuri
Browser automation, web crawling, and iOS + Android device control for AI agents. Zig-native, token-efficient…
★ 350
camoufox-cli
Anti-detect browser automation CLI & Skills for AI agents — Camoufox-powered fingerprint spoofing, no…
★ 330
gpt4V-scraper
AI agent that can SEE 👁️, control, navigate, & do stuff for you on your browser.
★ 310
agent-fetch
Full-content web fetcher for AI agents — Chrome TLS fingerprinting, browser impersonation, and …
★ 301
decodo-openclaw-skill
OpenClaw skill for scraping any URL using the Decodo Web Scraping API.
★ 152
pagesift
High-performance, memory-efficient Rust web crawler & content extraction engine for AI agents and RAG.…
★ 113 · GitHub ↗
omniseek
Your agent seeks what search can't find. A self-hosted perception MCP server that transcribes speech, reads…
★ 88
markdown-link-resolver
A zero-dependency Python tool to resolve relative Markdown links and inline images as Base64 strings for RAG…
★ 58 · GitHub ↗
🔗 Famiglie affini
Misurato dai temi di GitHub condivisi da entrambi i progetti, ponderato in base a quanto è raro ciascun tema.