on-device-ai

24 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

runanywhere-sdks

Production ready toolkit to run AI locally

14MB foundation model for tiny devices; phones, wearables, smart home, and robots.

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large…

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

AI You Control: Choose your models. Own your data. Eliminate vendor lock-in.

Local-File-Organizer

An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B…

On-device, real-time multimodal AI with features similar to GPT-Live

Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR…

On-device LLM execution in React Native with Vercel AI SDK compatibility

Foundation-Models-Framework-Lab

A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.

Muesli: agent-native local meeting transcription + dictation for macOS (Granola + WisprFlow alternative)

TinyChatEngine: On-Device LLM Inference Library

Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple…

Android Input Method Editor (IME) based on Whisper

Bonsai-Image-Demo

Generate images locally

An on-device LLM understands your entire life, then proactively offers to get your work done through computer…

LiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD.…

Open-source Android AI using LiteRT-LM with hardware acceleration, cloud providers, memory, and voice.

A native macOS lab for teaching tiny language models to think — build the architecture, train the weights,…

Core-AI-Framework-Lab

A practical lab for exploring Apple's Core AI framework, model assets, specialization, and on-device…

🔗 Related families

apple-silicon 37 local-ai 45 text-to-speech 76 metal 10 edge-ai 15 speech-recognition 89 llamacpp 27 vlm 47

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.