Home Projects sndr_core_engine
sndr_core_engine
Python

sndr_core_engine

SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A3B FP8 ~240 tok/s, 27B-int4 hybrid GDN+Mamba, Gemma4 26B/31B AWQ, 256K ctx. 321 patches: TurboQuant k8v4 KV, MTP/DFlash

by Sandermage · GitHub
Stars
Forks
License
Created
Last commit
Category
Language
Likely
Self-hostable
awqconsumer-gpucudaApache-2.0PythonSelf-hostable
View on GitHub
In plain words

Run advanced AI models on your personal NVIDIA graphics card for faster results.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
sndr_core_engine — GitHub preview card
📈 Star history
132125
2026-07-202026-08-31
📈 Track sndr_core_engine

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A3B FP8 ~240 tok/s, 27B-int4 hybrid GDN+Mamba, Gemma4 26B/31B AWQ, 256K ctx. 321 patches: TurboQuant k8v4 KV, MTP/DFlash

sndr_core_engine has 131 stars on GitHub. It has been forked 6 times. sndr_core_engine is written mainly in Python. It has been in active development since 2026. sndr_core_engine is available under the Apache-2.0 license. Its main topics are awq, consumer-gpu, cuda, gemma.

Frequently asked questions

What is sndr_core_engine?

SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A3B FP8 ~240 tok/s, 27B-int4 hybrid GDN+Mamba, Gemma4 26B/31B AWQ, 256K ctx. 321 patches: TurboQuant k8v4 KV, MTP/DFlash

Is sndr_core_engine open source?

sndr_core_engine is an open-source project. It is released under the Apache-2.0 license.

Is sndr_core_engine free?

Yes. sndr_core_engine is free and open source — you can use, modify and self-host it.

What license does sndr_core_engine use?

sndr_core_engine is available under the Apache-2.0 license.

What language is sndr_core_engine written in?

sndr_core_engine is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — sndr_core_engine

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=sandermage-sndr-core-engine)](https://olud.ai/project/sandermage-sndr-core-engine.html)
More badge options →
🧬 Related projects🧬 View the DNA map →