OnnxStream
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM)
Run AI models like Stable Diffusion on various devices using a lightweight library.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeLightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM)
OnnxStream has 2.1k stars on GitHub. It has been forked 97 times. OnnxStream is written mainly in C++. It has been in active development since 2023. Its main topics are llama, machine-learning, mistral, onnx.
What is OnnxStream?
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM)
Is OnnxStream open source?
OnnxStream is an open-source project.
Is OnnxStream free?
Yes. OnnxStream is free and open source — you can use, modify and self-host it.
What language is OnnxStream written in?
OnnxStream is written mainly in C++.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/vitoplantamura-onnxstream.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.