vllm-omni
A framework for efficient model inference with omni-modality models
Serve and run various AI models for audio, images, and more efficiently and cost-effectively.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeA framework for efficient model inference with omni-modality models
vllm-omni has 5.6k stars on GitHub. It has been forked 1.3k times. vllm-omni is written mainly in Python. It has been in active development since 2025. vllm-omni is available under the Apache-2.0 license. Its main topics are audio-generation, diffusion, image-generation, inference.
What is vllm-omni?
A framework for efficient model inference with omni-modality models
Is vllm-omni open source?
vllm-omni is an open-source project. It is released under the Apache-2.0 license.
Is vllm-omni free?
Yes. vllm-omni is free and open source — you can use, modify and self-host it.
What license does vllm-omni use?
vllm-omni is available under the Apache-2.0 license.
What language is vllm-omni written in?
vllm-omni is written mainly in Python.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/vllm-project-vllm-omni.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.