Python

GPUStack

Manage GPU clusters for running models
by gpustack · Apache-2.0
5 577stars632forksPythonlanguage9 days agolast push
Run LLMs locallyGPU cluster managerApache-2.0Runs locallyPythonAdvanced

From the README

Documentation ↗

Excerpts from the project README on GitHub. Copyright and licensing remain with the respective authors.

🛡 Published security advisories
A high count usually means the project is heavily examined. A low count usually means it is little examined — not that it is safe.
No public activity signals for this tool — it has no open repository we can measure.
Olud Pulse ⓘ ★★★★★★★★★★ /100 signals tracked
🐳 Docker pulls 📦 PyPI downloads / month 📦 npm downloads / month 🚀 Latest release ·
Visit website →View on GitHub

What is GPUStack?

GPUStack pools heterogeneous GPUs across machines into one cluster and schedules model workloads across them, with a web UI and OpenAI-compatible endpoints.

Why people choose GPUStack

GPUStack at a glance

CategoryRun LLMs locally
TypeGPU cluster manager
LicenseApache-2.0
Runs locallyYes
Built withPython
Skill levelAdvanced
Best forteams with several GPU machines to pool
See GitHub stats & activity

Open-source alternatives to GPUStack

Other open-source run llms locally tools worth comparing:

OllamaRun open LLMs locally from one commandLM StudioBrowse, download and chat with local modelsJanOpen-source, offline ChatGPT-style desktop appGPT4AllPrivate local AI that runs on CPUllama.cppThe C/C++ engine powering local inferenceLocalAIA drop-in OpenAI API you self-hostText Generation WebUIFeature-rich web UI for local modelsKoboldCppSingle-file local model runnerMLC LLMRun LLMs on any device, even phonesllamafileOne executable file = model + runtimeexoRun big models across your everyday devicesCortexOllama-style runtime from the Jan teamNexa SDKRun any model on any device — CPU, GPU, NPURamaLamaRun models as OCI containers

GPUStack head-to-head

GPUStack vs OllamaGPUStack vs LM StudioGPUStack vs JanGPUStack vs GPT4AllGPUStack vs llama.cppGPUStack vs LocalAIGPUStack vs Text Generation WebUIGPUStack vs KoboldCppGPUStack vs MLC LLMGPUStack vs llamafileGPUStack vs exoGPUStack vs CortexGPUStack vs Nexa SDKGPUStack vs RamaLama

FAQ

Is GPUStack free?

GPUStack is free and open-source (Apache-2.0 license), so you can use, self-host and modify it at no cost.

Can I run GPUStack locally?

Yes. GPUStack is designed to run on your own machine or server, keeping your data private.

What is the best alternative to GPUStack?

Popular open-source alternatives include Ollama, LM Studio, Jan. See the comparisons above to choose.

Explore more open-source AI

Browse the full directory of open-source AI tools, models and projects — updated daily.

Browse all tools →