Evaluate large language models using various metrics to ensure they perform well in different tasks.
From the README
pip install -U deepeval
- LLM apps end-to-end as black boxes
- Complete agent trajectories across every decision and action
- Individual agent steps such as LLM calls, tool use, retrieval, and sub-agent handoffs
Excerpts from the project README on GitHub. Copyright and licensing remain with the respective authors.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeThe LLM Evaluation Framework
deepeval has 18k stars on GitHub. It has been forked 1.9k times. deepeval is written mainly in Python. It has been in active development since 2023. deepeval is available under the Apache-2.0 license. Its main topics are evaluation-framework, evaluation-metrics, llm-evaluation, llm-evaluation-framework.
What is deepeval?
The LLM Evaluation Framework
Is deepeval open source?
deepeval is an open-source project. It is released under the Apache-2.0 license.
Is deepeval free?
Yes. deepeval is free and open source — you can use, modify and self-host it.
What license does deepeval use?
deepeval is available under the Apache-2.0 license.
What language is deepeval written in?
deepeval is written mainly in Python.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/confident-ai-deepeval.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.