Python

Nexa SDK

Run any model on any device — CPU, GPU, NPU
by NexaAI · Apache-2.0
Run LLMs locallyLocal runtime (SDK)Apache-2.0Runs locallyPythonIntermediate

From the README

Install
curl -fsSL https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-geniex/install.sh | sh

Excerpts from the project README on GitHub. Copyright and licensing remain with the respective authors.

🛡 Published security advisories
A high count usually means the project is heavily examined. A low count usually means it is little examined — not that it is safe.
No public activity signals for this tool — it has no open repository we can measure.
Olud Pulse ⓘ ★★★★★★★★★★ /100 signals tracked
🐳 Docker pulls 📦 PyPI downloads / month 📦 npm downloads / month 🚀 Latest release ·
Visit website →View on GitHub

What is Nexa SDK?

Nexa SDK runs text, vision, audio and image models locally across CPU, GPU and NPU backends, with a single unified API and OpenAI-compatible server.

Why people choose Nexa SDK

Nexa SDK at a glance

CategoryRun LLMs locally
TypeLocal runtime (SDK)
LicenseApache-2.0
Runs locallyYes
Built withPython
Skill levelIntermediate
Best fordevelopers targeting many device types from one codebase

Open-source alternatives to Nexa SDK

Other open-source run llms locally tools worth comparing:

OllamaRun open LLMs locally from one commandLM StudioBrowse, download and chat with local modelsJanOpen-source, offline ChatGPT-style desktop appGPT4AllPrivate local AI that runs on CPUllama.cppThe C/C++ engine powering local inferenceLocalAIA drop-in OpenAI API you self-hostText Generation WebUIFeature-rich web UI for local modelsKoboldCppSingle-file local model runnerMLC LLMRun LLMs on any device, even phonesllamafileOne executable file = model + runtimeexoRun big models across your everyday devicesCortexOllama-style runtime from the Jan teamRamaLamaRun models as OCI containersGPUStackManage GPU clusters for running models

Nexa SDK head-to-head

Nexa SDK vs OllamaNexa SDK vs LM StudioNexa SDK vs JanNexa SDK vs GPT4AllNexa SDK vs llama.cppNexa SDK vs LocalAINexa SDK vs Text Generation WebUINexa SDK vs KoboldCppNexa SDK vs MLC LLMNexa SDK vs llamafileNexa SDK vs exoNexa SDK vs CortexNexa SDK vs RamaLamaNexa SDK vs GPUStack

FAQ

Is Nexa SDK free?

Nexa SDK is free and open-source (Apache-2.0 license), so you can use, self-host and modify it at no cost.

Can I run Nexa SDK locally?

Yes. Nexa SDK is designed to run on your own machine or server, keeping your data private.

What is the best alternative to Nexa SDK?

Popular open-source alternatives include Ollama, LM Studio, Jan. See the comparisons above to choose.

Explore more open-source AI

Browse the full directory of open-source AI tools, models and projects — updated daily.

Browse all tools →