Home Projects crw
crw
Rust

crw

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB

by us · GitHub
Stars
Forks
License
Created
Last commit
Category
Language
Likely
Self-hostable
aiai-agentscrawlerAGPL-3.0RustSelf-hostable
View on GitHub
In plain words

Convert web pages into clean text or structured data quickly with a web scraping tool.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
crw — GitHub preview card
📈 Star history
889435
2026-07-202026-08-31
📈 Track crw

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB

crw has 889 stars on GitHub. It has been forked 60 times. crw is written mainly in Rust. It has been in active development since 2026. crw is available under the AGPL-3.0 license. Its main topics are ai, ai-agents, crawler, data-extraction.

Frequently asked questions

What is crw?

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB

Is crw open source?

crw is an open-source project. It is released under the AGPL-3.0 license.

Is crw free?

Yes. crw is free and open source — you can use, modify and self-host it. Its AGPL-3.0 license is a strong copyleft: if you distribute a modified version — including offering it as a network service — your changes must be released under the same license.

What license does crw use?

crw is available under the AGPL-3.0 license.

What language is crw written in?

crw is written mainly in Rust.

🏅 Maintainer of this project?
olud.ai badge — crw

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=us-crw)](https://olud.ai/project/us-crw.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.