Home Projects alpaca_eval
alpaca_eval
Jupyter Notebook

alpaca_eval

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

by tatsu-lab · GitHub
Stars
Forks
Trending
License
Created
Last commit
deep-learningevaluationfoundation-modelsApache-2.0Jupyter Notebook
View on GitHub
In plain words

Automatically assess how well language models follow instructions with a fast and cost-effective tool.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
alpaca_eval — GitHub preview card
📈 Star history
2.01k2.00k
2026-07-102026-08-31
📈 Track alpaca_eval

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

alpaca_eval has 2k stars on GitHub. It has been forked 315 times. alpaca_eval is written mainly in Jupyter Notebook. It has been in active development since 2023. alpaca_eval is available under the Apache-2.0 license. Its main topics are deep-learning, evaluation, foundation-models, instruction-following.

Frequently asked questions

What is alpaca_eval?

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

Is alpaca_eval open source?

alpaca_eval is an open-source project. It is released under the Apache-2.0 license.

Is alpaca_eval free?

Yes. alpaca_eval is free and open source — you can use, modify and self-host it.

What license does alpaca_eval use?

alpaca_eval is available under the Apache-2.0 license.

What language is alpaca_eval written in?

alpaca_eval is written mainly in Jupyter Notebook.

🏅 Maintainer of this project?
olud.ai badge — alpaca_eval

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=tatsu-lab-alpaca-eval)](https://olud.ai/project/tatsu-lab-alpaca-eval.html)
More badge options →
🧬 Related projects🧬 View the DNA map →