on-device-ai
29 projects share this GitHub topic
Lines connect members that are measurably related to each other. Dot size reflects stars.
🧬 Members
needle
Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and…
★ 14.3k
runanywhere-sdks
Production ready toolkit to run AI locally
★ 10.3k
GenieX
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
★ 8.5k
turbo-fieldfare
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
★ 7.1k
LiteRT-LM
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large…
★ 6.7k
cactus
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
★ 6.2k
thunderbolt
AI You Control: Choose your models. Own your data. Eliminate vendor lock-in.
★ 4.8k
Local-File-Organizer
An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B…
★ 3.4k
parlor
On-device, real-time multimodal AI with features similar to GPT-Live
★ 2.1k
nobodywho
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
★ 1.6k · GitHub ↗
RCLI
Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG
★ 1.5k
mlx-tune
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR…
★ 1.5k
ai
On-device LLM execution in React Native with Vercel AI SDK compatibility
★ 1.4k
muesli
Muesli: agent-native local meeting transcription + dictation for macOS (Granola + WisprFlow alternative)
★ 1.3k
Foundation-Models-Framework-Lab
A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.
★ 1.2k
SiliconScope
Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
★ 1k · GitHub ↗
TinyChatEngine
TinyChatEngine: On-Device LLM Inference Library
★ 970
Wax
Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple…
★ 790
sentient-os
An on-device LLM understands your entire life, then proactively offers to get your work done through computer…
★ 653
whisperIME
Android Input Method Editor (IME) based on Whisper
★ 606
Bonsai-Image-Demo
Generate images locally
★ 502
litert-samples
LiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.
★ 415
OfflineLLM
Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD.…
★ 274
deskmind
Small enough to run on your Mac. Smart enough to ask. An open-source computer use agent for macOS, with local…
★ 124 · GitHub ↗
AndroLLM
Open-source Android AI using LiteRT-LM with hardware acceleration, cloud providers, memory, and voice.
★ 100
Core-AI-Framework-Lab
A practical lab for exploring Apple's Core AI framework, model assets, specialization, and on-device…
★ 66
edge-dit.cpp
edge-dit.cpp — a native C/C++ inference engine for Diffusion Transformers (DiT), designed for local and…
★ 54 · GitHub ↗
awesome-EmbeddingGemma
EmbeddingGemma2 resources: local search apps, decision models, inference frameworks, tutorials, and datasets.…
★ 50 · GitHub ↗
LabLLM
A native macOS lab for teaching tiny language models to think — build the architecture, train the weights,…
★ 42
🔗 Related families
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.