gguf

26 projets partagent ce topic GitHub

Les traits relient les membres réellement apparentés entre eux. La taille des points suit les étoiles.

🧬 Membres

Hundreds of models & providers. One command to find what runs on your hardware.

Distribute and run LLMs with a single file.

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware…

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No…

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs,…

Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic,…

动手学Ollama，CPU玩转大模型部署，在线阅读地址：https://datawhalechina.github.io/handy-ollam…

comfyui_LLM_party

LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt…

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model…

Go manage your Ollama models

A SOTA quantization algorithm for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA,…

Open-source LLM-based ASR model family for Chinese, dialect, accent, and multilingual speech, with FunASR,…

Interface for OuteTTS models.

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your…

Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs…

locally-uncensored

Plug-and-play local AI studio: uncensored chat, image & video generation, coding agent. Runs abliterated LLMs…

Llama 3+ inference in pure Java

The most advanced, fully offline client-side AI suite on Android today.

Arabic-first generative speech recognition — Audar-ASR-V1 (Flash + Turbo). #1 on the Open Universal Arabic…

Run AI ✨ assistant locally! with simple API for Node.js 🚀

A desktop app for running Large Language Models locally.

overlay-translator

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX…

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving,…

Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done.

★ 80 · GitHub ↗

Native AI inference for PHP 8.3+ - run ONNX, GGUF (llama.cpp) and RubixML models directly in your PHP process…

★ 56 · GitHub ↗

🔗 Familles voisines

llama-cpp 28 local-llm 50 local-ai 36 huggingface 108 llm-inference 76 mlx 36 apple-silicon 32 llamacpp 36

Mesuré à partir des topics GitHub communs aux deux projets, pondérés par leur rareté.