LocalAI

A drop-in OpenAI API you self-host
Run LLMs locallySelf-hosted API serverMITSelf-hostedGoIntermediate
🛡 Published security advisories
A high count usually means the project is heavily examined. A low count usually means it is little examined — not that it is safe.
No public activity signals for this tool — it has no open repository we can measure.
OSAI Pulse ⓘ ★★★★★★★★★★ /100 signals tracked
🐳 Docker pulls 📦 PyPI downloads / month 📦 npm downloads / month 🚀 Latest release ·
Visit website →View on GitHub

What is LocalAI?

LocalAI is a self-hosted, OpenAI-compatible API that runs LLMs, image and audio models in containers, designed so the same client code points at local or hosted models.

Why people choose LocalAI

LocalAI at a glance

CategoryRun LLMs locally
TypeSelf-hosted API server
LicenseMIT
Runs locallySelf-hosted
Built withGo
Skill levelIntermediate
Best forteams shipping local inference inside a product

Open-source alternatives to LocalAI

Other open-source run llms locally tools worth comparing:

OllamaRun open LLMs locally from one commandLM StudioBrowse, download and chat with local modelsJanOpen-source, offline ChatGPT-style desktop appGPT4AllPrivate local AI that runs on CPUllama.cppThe C/C++ engine powering local inferenceText Generation WebUIFeature-rich web UI for local modelsKoboldCppSingle-file local model runnerMLC LLMRun LLMs on any device, even phonesllamafileOne executable file = model + runtimeexoRun big models across your everyday devicesCortexOllama-style runtime from the Jan teamNexa SDKRun any model on any device — CPU, GPU, NPURamaLamaRun models as OCI containersGPUStackManage GPU clusters for running models

LocalAI head-to-head

LocalAI vs OllamaLocalAI vs LM StudioLocalAI vs JanLocalAI vs GPT4AllLocalAI vs llama.cppLocalAI vs Text Generation WebUILocalAI vs KoboldCppLocalAI vs MLC LLMLocalAI vs llamafileLocalAI vs exoLocalAI vs CortexLocalAI vs Nexa SDKLocalAI vs RamaLamaLocalAI vs GPUStack

FAQ

Is LocalAI free?

LocalAI is free and open-source (MIT license), so you can use, self-host and modify it at no cost.

Can I run LocalAI locally?

Yes. LocalAI is designed to run on your own machine or server, keeping your data private.

What is the best alternative to LocalAI?

Popular open-source alternatives include Ollama, LM Studio, Jan. See the comparisons above to choose.

Explore more open-source AI

Browse the full directory of open-source AI tools, models and projects — updated daily.

Browse all tools →