ggml

15 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

llama.cpp

LLM inference in C/C++

★ 132.6k

koboldcpp

KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.

★ 12.1k

LLMFarm

llama and other large language models on iOS and MacOS offline using GGML library.

★ 2k

gollama

Go manage your Ollama models

★ 1.8k

rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

★ 1.6k

gpu_poor

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

★ 1.4k

ComfyUI-MultiGPU

This custom_node for ComfyUI adds one-click "Virtual VRAM" for any UNet and CLIP loader as well MultiGPU…

★ 924

bark.cpp

Suno AI's Bark model in C/C++ for fast text-to-speech generation

★ 866

can-ai-code

Self-evaluating interview for AI coders

★ 597

minigpt4.cpp

Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

★ 573

clip.cpp

CLIP inference in plain C/C++ with no extra dependencies

★ 563

CrispASR

C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B…

★ 450

LLaMA-Cult-and-More

Large Language Models for All, 🦙 Cult and More, Stay in touch !

★ 449

HOT-Step-CPP

Turn dials. Summon bangers! NOW WITH MORE C++! Local AI music generation powered by GGML

★ 186 · GitHub ↗

edge-dit.cpp

edge-dit.cpp — a native C/C++ inference engine for Diffusion Transformers (DiT), designed for local and…

★ 54 · GitHub ↗

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.