web-scraping
35 progetti condividono questo topic GitHub
Le linee collegano membri che sono misurabilmente correlati tra loro. La dimensione dei punti riflette le stelle.
🧬 Membri
firecrawl
The context API to search, scrape, and interact with the web at scale. 🔥
★ 174.8k
Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale…
★ 77.6k
ai-website-cloner-template
Clone any website with one command using AI coding agents
★ 33.5k
CloakBrowser
Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level…
★ 31k
Jobs_Applier_AI_Agent_AIHawk
Open source AI job application bot in Python: browser automation and web scraping to read job postings, then…
★ 30.3k
Scrapegraph-ai
Python scraper based on AI
★ 30.2k
crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript…
★ 25.6k
maxun
🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn…
★ 17.3k
SurfSense
Open-source NotebookLM alternative. Research the open web with live data(Reddit, YT, IG, TikTok, Indeed,…
★ 16k
crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data…
★ 9.5k
camofox-browser
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in…
★ 9k
firecrawl-mcp-server
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other…
★ 7.4k
trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as…
★ 6.7k
skills
Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms…
★ 5.5k
wigolo
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys,…
★ 4.8k
brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
★ 2.6k
webclaw
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust.…
★ 2.3k
moli
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
★ 1.6k
open-scouts
🔥 AI-powered web monitoring platform. Create automated scouts that search the web and send email alerts…
★ 1.4k
WebAI2API
★ 1.3k
reverse-api-engineer
The agent that turns websites into APIs!
★ 1.1k
x-reader
Universal content reader MCP Server for 10+ platforms
★ 961
reverse-api-engineer
The agent that turns websites into APIs!
★ 911
crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for…
★ 894
agent-skills
Official Agent skills of Oxylabs products
★ 846
ShardBrowser
Free, open-source anti-detect browser launcher for web scraping and multi-accounting. By the ProxyShard team.…
★ 779
reader
Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions,…
★ 558
ketch
Fast, stateless CLI for web search and scrape. Built for AI agents.
★ 532
oc
Turn any website into a compact CLI tailored for AI agents. Browse the web in hundreds of tokens, not tens of…
★ 422
kuri
Browser automation, web crawling, and iOS + Android device control for AI agents. Zig-native, token-efficient…
★ 350
camoufox-cli
Anti-detect browser automation CLI & Skills for AI agents — Camoufox-powered fingerprint spoofing, no…
★ 330
gpt4V-scraper
AI agent that can SEE 👁️, control, navigate, & do stuff for you on your browser.
★ 310
agent-fetch
Full-content web fetcher for AI agents — Chrome TLS fingerprinting, browser impersonation, and …
★ 301
decodo-openclaw-skill
OpenClaw skill for scraping any URL using the Decodo Web Scraping API.
★ 152
omniseek
Your agent seeks what search can't find. A self-hosted perception MCP server that transcribes speech, reads…
★ 47
🔗 Famiglie affini
Misurato dai temi di GitHub condivisi da entrambi i progetti, ponderato in base a quanto è raro ciascun tema.