Home› Projects› dgx-spark-inference-stack
dgx-spark-inference-stack
Shell

dgx-spark-inference-stack

Serve the home! Inference stack for your Nvidia DGX Spark aka the Grace Blackwell AI supercomputer on your desk. Mostly vLLM based for now and single-spark. For the not-so-rich buddies. If you want latest/in-testing, look at the branches

by jdaln · GitHub
51
Stars
5
Forks
Apache-2.0
License
2026
Created
25 days ago
Last commit
cuda
Category
Shell
Language
Likely
Self-hostable
cudadgxdgx-sparkApache-2.0ShellSelf-hostable
View on GitHub
In plain words

Run large language models on your Nvidia DGX Spark computer for efficient AI processing.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
dgx-spark-inference-stack — GitHub preview card
📈 Star history
5149
2026-07-202026-08-31
📈 Track dgx-spark-inference-stack

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Serve the home! Inference stack for your Nvidia DGX Spark aka the Grace Blackwell AI supercomputer on your desk. Mostly vLLM based for now and single-spark. For the not-so-rich buddies. If you want latest/in-testing, look at the branches

dgx-spark-inference-stack has 51 stars on GitHub. It has been forked 5 times. dgx-spark-inference-stack is written mainly in Shell. It has been in active development since 2026. dgx-spark-inference-stack is available under the Apache-2.0 license. Its main topics are cuda, dgx, dgx-spark, docker.

❓ Frequently asked questions

What is dgx-spark-inference-stack?

Serve the home! Inference stack for your Nvidia DGX Spark aka the Grace Blackwell AI supercomputer on your desk. Mostly vLLM based for now and single-spark. For the not-so-rich buddies. If you want latest/in-testing, look at the branches

Is dgx-spark-inference-stack open source?

dgx-spark-inference-stack is an open-source project. It is released under the Apache-2.0 license.

Is dgx-spark-inference-stack free?

Yes. dgx-spark-inference-stack is free and open source — you can use, modify and self-host it.

What license does dgx-spark-inference-stack use?

dgx-spark-inference-stack is available under the Apache-2.0 license.

What language is dgx-spark-inference-stack written in?

dgx-spark-inference-stack is written mainly in Shell.

🏅 Maintainer of this project?
olud.ai badge — dgx-spark-inference-stack

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=jdaln-dgx-spark-inference-stack)](https://olud.ai/project/jdaln-dgx-spark-inference-stack.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →
atlas
Pure Rust Inference Engine
★ 601 · cuda
sharesdgxdgx-spark
JetStream
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, startin…
★ 456 · gemma
sharesmodel-servingmlops
vllm-ascend
Community maintained hardware plugin for vLLM on Ascend
★ 2.7k · ascend
sharesmodel-servingmlops
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
★ 90.5k · amd
voicebox
The open-source AI voice studio. Clone, dictate, create.
★ 51.9k · ai
sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
★ 32.9k · attention
instant-ngp
Instant neural graphics primitives: lightning fast NeRF and more
★ 17.5k · 3d-reconstruction
burn
Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on…
★ 15.6k · autodiff
kaldi
kaldi-asr/kaldi is the official location of the Kaldi project.
★ 15.4k · c-plus-plus
TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLM…
★ 14.5k · blackwell

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.