llama-cpp

28 proyectos comparten este topic de GitHub

Las líneas conectan a los miembros que están mediblemente relacionados entre sí. El tamaño de los puntos refleja las estrellas.

🧬 Miembros

llamafile

Distribute and run LLMs with a single file.

★ 25.5k

llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your…

★ 10.9k

FluidVoice

Fastest and only macOS Dictation app with on-device STT and custom trained AI enhancement model. A local…

★ 9k

SenseVoice

Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID,…

★ 8.9k

ODS

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG,…

★ 3.8k

LLamaSharp

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

★ 3.8k

DeepCamera

Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen,…

★ 3k

OGAM

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs,…

★ 2.8k

maid

Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic,…

★ 2.6k

forge

A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows

★ 2.2k

node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model…

★ 2.1k

LLMUnity

Create characters in Unity with LLMs!

★ 1.7k

RCLI

Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG

★ 1.5k

Fun-ASR

Open-source LLM-based ASR model family for Chinese, dialect, accent, and multilingual speech, with FunASR,…

★ 1.4k

llama.go

llama.go is like llama.cpp in pure Golang!

★ 1.4k

atomic-agent

Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs…

★ 1.1k

compose-for-agents

Build and run AI agents using Docker Compose. A collection of ready-to-use examples for orchestrating…

★ 1k

can-ai-code

Self-evaluating interview for AI coders

★ 599

Audar-ASR-V1

Arabic-first generative speech recognition — Audar-ASR-V1 (Flash + Turbo). #1 on the Open Universal Arabic…

★ 560

graphrag-rs

GraphRAG-rs is a high-performance, state-of-the-art Rust implementation of GraphRAG (Graph-based Retrieval…

★ 522

catai

Run AI ✨ assistant locally! with simple API for Node.js 🚀

★ 498

overlay-translator

★ 424

KVSplit

Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache…

★ 361

ClawMem

On-device memory layer for AI agents. Claude Code, Hermes and OpenClaw. Hooks + MCP server + hybrid RAG…

★ 195

ScreenMind

AI-powered screen memory — captures, analyzes, and lets you search/chat your screen history. Powered by…

★ 193

kube-llmops

★ 122

llmaker

Selfhost modern LLM stacks. Run the whole fleet from your terminal

★ 98

FerryAI

Native AI inference for PHP 8.3+ - run ONNX, GGUF (llama.cpp) and RubixML models directly in your PHP process…

★ 56 · GitHub ↗

Medido a partir de los temas de GitHub compartidos por ambos proyectos, ponderado por cuán raros son cada uno de los temas.