An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
Automatically assess how well language models follow instructions with a fast and cost-effective tool.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeAn automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
alpaca_eval has 2k stars on GitHub. It has been forked 315 times. alpaca_eval is written mainly in Jupyter Notebook. It has been in active development since 2023. alpaca_eval is available under the Apache-2.0 license. Its main topics are deep-learning, evaluation, foundation-models, instruction-following.
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
alpaca_eval is an open-source project. It is released under the Apache-2.0 license.
Yes. alpaca_eval is free and open source — you can use, modify and self-host it.
alpaca_eval is available under the Apache-2.0 license.
alpaca_eval is written mainly in Jupyter Notebook.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/tatsu-lab-alpaca-eval.html)