crawl4ai
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
Crawl4AI is a fast, fully open-source crawler that outputs LLM-friendly Markdown with smart extraction strategies, built to run entirely on your own machine.
From the README
pip install crawl4ai crawl4ai-setup # Setup the browser
- LLM ready output, smart Markdown with headings, tables, code, citation hints
- Fast in practice, async browser pool, caching, minimal hops
- Full control, sessions, proxies, cookies, user scripts, hooks
- Adaptive intelligence, learns site patterns, explores only what matters
- Deploy anywhere, zero keys, CLI and Docker, cloud friendly
Excerpts from the project README on GitHub. Copyright and licensing remain with the respective authors.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytime🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
crawl4ai has 80.2k stars on GitHub. It has been forked 8.3k times. crawl4ai is written mainly in Python. It has been in active development since 2024. crawl4ai is available under the Apache-2.0 license.
Read the full guideWhat is crawl4ai?
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
Is crawl4ai open source?
crawl4ai is an open-source project. It is released under the Apache-2.0 license.
Is crawl4ai free?
Yes. crawl4ai is free and open source — you can use, modify and self-host it.
What license does crawl4ai use?
crawl4ai is available under the Apache-2.0 license.
What language is crawl4ai written in?
crawl4ai is written mainly in Python.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/unclecode-crawl4ai.html)
