llama-cpp

23 Projekte teilen dieses GitHub-Topic

Linien verbinden Mitglieder, die messbar miteinander verwandt sind. Die Punktgröße spiegelt die Sterne wider.

🧬 Mitglieder

Distribute and run LLMs with a single file.

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your…

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and…

Fastest and only macOS Dictation app with on-device STT and custom trained AI enhancement model. A local…

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG,…

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen,…

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs,…

Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs…

A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model…

Create characters in Unity with LLMs!

Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG

llama.go is like llama.cpp in pure Golang!

compose-for-agents

Build and run AI agents using Docker Compose. A collection of ready-to-use examples for orchestrating…

Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache…

Your car as a chat-room agent: Raspberry Pi 5 + dashcam + local AI. CodeWatch's sibling for the garage.

On-device memory layer for AI agents. Claude Code, OpenClaw and Hermes. Hooks + MCP server + hybrid RAG…

AI-powered screen memory — captures, analyzes, and lets you search/chat your screen history. Powered by…

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Run Ornith, Qwen, Nemotron & DeepSeek optimized on AMD Strix Halo — unified OpenAI-compatible server with…

★ 41 · GitHub ↗

Native AI inference for PHP 8.3+ - run ONNX, GGUF (llama.cpp) and RubixML models directly in your PHP process…

🔗 Verwandte Familien

gguf 21 local-ai 45 local-llm 42 speech-to-text 59 llamacpp 27 openai-api 61 tool-calling 30 metal 10

Gemessen anhand der von beiden Projekten geteilten GitHub-Themen, gewichtet nach der Seltenheit jedes Themas.