local-llm

60 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

Ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory,…

Distribute and run LLMs with a single file.

Udemy & Hotmart course downloader, YouTube downloader (yt-dlp GUI, 1,800+ sites) + desktop app for AI agents:…

★ 14.4k · GitHub ↗

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

local-deep-research

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google,…

open-multi-agent

Self-hosted TypeScript agent runtime with durable approvals and verifiable run records. Own it, approve it,…

Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to…

Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+…

Harness LLMs with Multi-Agent Programming

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server and Mac app…

Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open…

Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

awesome-local-llm

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

locally-uncensored

The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one…

openai-edge-tts

Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs

Adaptive Test-time Learning and Autonomous Specialization

★ 2.1k · GitHub ↗

On-device, real-time multimodal AI with features similar to GPT-Live

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend,…

Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B…

★ 2.1k · GitHub ↗

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your…

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

★ 1.6k · GitHub ↗

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX,…

open source grok bot. gawk bots automate your menial work via AI models and build you microapps to manage the…

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR…

A self-hosted job search app that writes tailored resumes and cover letters from your profile.

★ 1.4k · GitHub ↗

Ouroboros — self-creating AI agent. Born Feb 16, 2026.

halogen-flash-server

Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models,…

★ 1.1k · GitHub ↗

awesome-ai-companion

Open-source AI companions, desktop pets, long-term memory & proactive chat.…

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

★ 1k · GitHub ↗

agents-from-scratch

Build AI agents from first principles using a local LLM - no frameworks, no cloud APIs, no hidden reasoning.

The most advanced, fully offline client-side AI suite on Android today.

A minimalist, terminal-native coding agent written in C.

★ 941 · GitHub ↗

🚀 Self-hosted AI automation platform. Deploy n8n, Ollama, Flowise, RAG, Supabase & 30+ tools with one…

Autonomous AI pentesting engine, continuous offensive security across web, cloud, identity, CI/CD, IaC,…

Open-source local-first AI agent for desktop work. No account, no telemetry: use local models with…

AI-powered IDE for novel writing — local LLM + RAG, privacy-first, BYOK. For web fiction authors and…

本地优先的全栈 AI 创作工作站：AI对话 · AI漫画 · 漫剧创作 · 写作台 ·…

★ 529 · GitHub ↗

Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default,…

Local coding agent with neat UI

Open-source AI meeting notes for Mac. Records mic + system audio with no bot, transcribes on-device or via…

Your car as a chat-room agent: Raspberry Pi 5 + dashcam + local AI. CodeWatch's sibling for the garage.

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD.…

Turn your documents into a Markdown wiki you can read, that answers with citations. Works with any LLM…

★ 248 · GitHub ↗

deepseek-local-guide-ru

🐋 Полный гайд на русском: как установить и запустить DeepSeek…

★ 157 · GitHub ↗

Enterprise-ready self-hosted AI assistant runtime with sandboxed execution, secure credentials, approvals,…

AI, fully local on your computer.

★ 146 · GitHub ↗

sndr_core_engine

SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere…

Open-source AI teammates for your company. The self-hosted agent layer: build, run and govern AI agents on…

★ 126 · GitHub ↗

Small enough to run on your Mac. Smart enough to ask. An open-source computer use agent for macOS, with local…

★ 124 · GitHub ↗

Local-first desktop AI workbench for roleplay, multi-character chat, long-form writing, RAG, MCP tools,…

Selfhost modern LLM stacks. Run the whole fleet from your terminal

High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen…

★ 94 · GitHub ↗

glm-5.3-flash-2x-rtx-pro-6000-blackwell

Validated GLM-5.3 Flash recipe for 2x NVIDIA RTX PRO 6000 Blackwell 96GB: 262K context, EXL3/TR3, adaptive…

★ 61 · GitHub ↗

llama.cpp optimized for NVIDIA Tesla V100 (SM70): Qwen3.8-Flash-Next with MTP (prefill 3402 tok/s at 200K…

★ 59 · GitHub ↗

dgx-spark-inference-stack

Serve the home! Inference stack for your Nvidia DGX Spark aka the Grace Blackwell AI supercomputer on your…

Private, on-device AI desktop app — GGUF (llama.cpp) & MLX, running Muse-Glimmer and Qwen3.8 with their…

★ 48 · GitHub ↗

Bounded, inspectable LLM inference pipelines from declared YAML — runs offline against Ollama or any…

Agentic Runtime

★ 42 · GitHub ↗

Native AI inference for PHP 8.3+ - run ONNX, GGUF (llama.cpp) and RubixML models directly in your PHP process…

🔗 Familias relacionadas

gguf 27 llama-cpp 33 local-ai 58 apple-silicon 46 llm-inference 80 mlx 39 openai-api 68 qwen 87

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.