local-llm

42 progetti condividono questo topic GitHub

Le linee collegano membri che sono misurabilmente correlati tra loro. La dimensione dei punti riflette le stelle.

🧬 Membri

Ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory,…

Distribute and run LLMs with a single file.

local-deep-research

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google,…

open-multi-agent

TypeScript AI agent orchestration framework with dynamic workflows. Describe the goal, not the graph: a…

Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to…

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+…

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Harness LLMs with Multi-Agent Programming

The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling.…

Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open…

awesome-local-llm

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs…

TranslateBooksWithLLMs

Translate full-length books and documents with Ollama, OpenAI-compatible, Gemini, Mistral, DeepSeek, Poe or…

openai-edge-tts

Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs

On-device, real-time multimodal AI with features similar to GPT-Live

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX,…

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your…

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR…

locally-uncensored

Plug-and-play local AI studio: uncensored chat, image & video generation, coding agent. Runs abliterated LLMs…

Ouroboros — self-creating AI agent. Born Feb 16, 2026.

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX…

agents-from-scratch

Build AI agents from first principles using a local LLM - no frameworks, no cloud APIs, no hidden reasoning.

🚀 Self-hosted AI automation platform. Deploy n8n, Ollama, Flowise, RAG, Supabase & 30+ tools with one…

Autonomous AI pentesting engine, continuous offensive security across web, cloud, identity, CI/CD, IaC,…

The most advanced, fully offline client-side AI suite on Android today.

Open-source local-first AI agent for desktop work. No account, no telemetry: use local models with…

awesome-ai-companion

Open-source AI companions, desktop pets, long-term memory & proactive chat.…

AI-powered IDE for novel writing — local LLM + RAG, privacy-first, BYOK. For web fiction authors and…

Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default,…

Local coding agent with neat UI

Your car as a chat-room agent: Raspberry Pi 5 + dashcam + local AI. CodeWatch's sibling for the garage.

Open-source AI meeting notes for Mac. Records mic + system audio with no bot, transcribes on-device or via…

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD.…

sndr_core_engine

SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere…

Enterprise-ready self-hosted AI assistant runtime with sandboxed execution, secure credentials, approvals,…

Local-first desktop AI workbench for roleplay, multi-character chat, long-form writing, RAG, MCP tools,…

Selfhost modern LLM stacks. Run the whole fleet from your terminal

dgx-spark-inference-stack

Serve the home! Inference stack for your Nvidia DGX Spark aka the Grace Blackwell AI supercomputer on your…

Bounded, inspectable LLM inference pipelines from declared YAML — runs offline against Ollama or any…

Run Ornith, Qwen, Nemotron & DeepSeek optimized on AMD Strix Halo — unified OpenAI-compatible server with…

★ 41 · GitHub ↗

Native AI inference for PHP 8.3+ - run ONNX, GGUF (llama.cpp) and RubixML models directly in your PHP process…

🔗 Famiglie affini

local-ai 45 gguf 21 apple-silicon 37 mlx 29 openai-api 61 llama-cpp 23 llm-inference 65 openai-compatible 32

Misurato dai temi di GitHub condivisi da entrambi i progetti, ponderato in base a quanto è raro ciascun tema.