MMMU
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
Evaluate your AI models using a comprehensive benchmark for understanding and reasoning across multiple disciplines.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeThis repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
MMMU has 593 stars on GitHub. It has been forked 56 times. MMMU is written mainly in Python. It has been in active development since 2023. MMMU is available under the Apache-2.0 license. Its main topics are computer-vision, deep-learning, deep-neural-networks, evaluation.
What is MMMU?
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
Is MMMU open source?
MMMU is an open-source project. It is released under the Apache-2.0 license.
Is MMMU free?
Yes. MMMU is free and open source — you can use, modify and self-host it.
What license does MMMU use?
MMMU is available under the Apache-2.0 license.
What language is MMMU written in?
MMMU is written mainly in Python.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/mmmu-benchmark-mmmu.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.