MNN
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
Run AI models on your device quickly and efficiently, even on low-power hardware.
From the README
- Optimized for devices, no dependencies, can be easily deployed to mobile devices and a variety of embedded devices.
- iOS platform: static library size will full option for armv7+arm64 platforms is about 12MB, size increase of linked executables is about 2M.
- Android platform: core so size is about 800KB (armv7a - c++shared).
- Using MNNBUILDMINI can reduce package size by about 25%, with a limit of fixed model input size
- Support FP16 / Int8 quantize, can reduce model size 50%-70%
Excerpts from the project README on GitHub. Copyright and licensing remain with the respective authors.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeMNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
MNN has 16k stars on GitHub. It has been forked 2.4k times. MNN is written mainly in C++. It has been in active development since 2019. MNN is available under the Apache-2.0 license. Its main topics are arm, convolution, deep-learning, embedded-devices.
What is MNN?
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
Is MNN open source?
MNN is an open-source project. It is released under the Apache-2.0 license.
Is MNN free?
Yes. MNN is free and open source — you can use, modify and self-host it.
What license does MNN use?
MNN is available under the Apache-2.0 license.
What language is MNN written in?
MNN is written mainly in C++.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/alibaba-mnn.html)
