gguf

21 progetti condividono questo topic GitHub

Le linee collegano membri che sono misurabilmente correlati tra loro. La dimensione dei punti riflette le stelle.

🧬 Membri

Hundreds of models & providers. One command to find what runs on your hardware.

Distribute and run LLMs with a single file.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No…

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs,…

动手学Ollama，CPU玩转大模型部署，在线阅读地址：https://datawhalechina.github.io/handy-ollam…

Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs…

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model…

Go manage your Ollama models

A SOTA quantization algorithm for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA,…

Interface for OuteTTS models.

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your…

locally-uncensored

Plug-and-play local AI studio: uncensored chat, image & video generation, coding agent. Runs abliterated LLMs…

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX…

Llama 3+ inference in pure Java

The most advanced, fully offline client-side AI suite on Android today.

A desktop app for running Large Language Models locally.

A native .NET LLM inference engine for GGUF models. TensorSharp provides a console application, a web-based…

Run Ornith, Qwen, Nemotron & DeepSeek optimized on AMD Strix Halo — unified OpenAI-compatible server with…

★ 41 · GitHub ↗

Native AI inference for PHP 8.3+ - run ONNX, GGUF (llama.cpp) and RubixML models directly in your PHP process…

🔗 Famiglie affini

local-llm 42 llama-cpp 23 local-ai 45 mlx 29 gemma 30 llamacpp 27 llm-inference 65 inference 74

Misurato dai temi di GitHub condivisi da entrambi i progetti, ponderato in base a quanto è raro ciascun tema.