lmms-eval
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
Evaluate AI models across different types of content like text, images, and audio using a comprehensive toolkit.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeOne-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
lmms-eval has 4.4k stars on GitHub. It has been forked 648 times. lmms-eval is written mainly in Python. It has been in active development since 2024. Its main topics are agi, audio-evaluation, benchmark, evaluation.
What is lmms-eval?
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
Is lmms-eval open source?
lmms-eval is an open-source project.
Is lmms-eval free?
Yes. lmms-eval is free and open source — you can use, modify and self-host it.
What language is lmms-eval written in?
lmms-eval is written mainly in Python.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/evolvinglmms-lab-lmms-eval.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.