ai-crawler-py
Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.
Start data extraction from any website by providing a URL and a natural language prompt.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeCrawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.
ai-crawler-py has 3.2k stars on GitHub. It has been forked 11 times. It has been in active development since 2025. Its main topics are ai, ai-agents, ai-crawler, ai-scraping.
What is ai-crawler-py?
Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.
Is ai-crawler-py open source?
ai-crawler-py is an open-source project.
Is ai-crawler-py free?
Yes. ai-crawler-py is free and open source — you can use, modify and self-host it.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/oxylabs-ai-crawler-py.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.