koboldcpp
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
KoboldCpp is an easy, single-executable way to run GGUF models locally with a built-in UI, strong sampler controls and support for text, image and voice.
From the README
curl -sSL https://raw.githubusercontent.com/LostRuins/koboldcpp/concedo/android_install.sh | sh
- Single file executable, with no installation required and no external dependencies
- Runs on CPU or GPU, supports full or partial offloaded
- LLM text generation (Supports all GGML and GGUF models, backwards compatibility with ALL past models)
- Image Generation and Image Editing (Stable Diffusion 1.5, SDXL, SD3, Flux, Qwen Image, Z-Image, Klein)
- Video Generation (WAN 2.2)
- Speech-To-Text (Voice Recognition) via Whisper
Excerpts from the project README on GitHub. Copyright and licensing remain with the respective authors.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeRun GGUF models easily with a KoboldAI UI. One File. Zero Install.
koboldcpp has 11.6k stars on GitHub. It has been forked 758 times. koboldcpp is written mainly in C++. It has been in active development since 2023. koboldcpp is available under the AGPL-3.0 license. Its main topics are gemma, ggml, gguf, koboldai.
Read the full guideWhat is koboldcpp?
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
Is koboldcpp open source?
koboldcpp is an open-source project. It is released under the AGPL-3.0 license.
Is koboldcpp free?
Yes. koboldcpp is free and open source — you can use, modify and self-host it. Its AGPL-3.0 license is a strong copyleft: if you distribute a modified version — including offering it as a network service — your changes must be released under the same license.
What license does koboldcpp use?
koboldcpp is available under the AGPL-3.0 license.
What language is koboldcpp written in?
koboldcpp is written mainly in C++.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/lostruins-koboldcpp.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.