paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Run and manage large language models on your own servers for privacy and control.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
paddler has 1.7k stars on GitHub. It has been forked 97 times. paddler is written mainly in Rust. It has been in active development since 2024. paddler is available under the Apache-2.0 license. Its main topics are ai, llamacpp, llm, llmops.
What is paddler?
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Is paddler open source?
paddler is an open-source project. It is released under the Apache-2.0 license.
Is paddler free?
Yes. paddler is free and open source — you can use, modify and self-host it.
What license does paddler use?
paddler is available under the Apache-2.0 license.
What language is paddler written in?
paddler is written mainly in Rust.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/intentee-paddler.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.