on-device-ai

23 proyectos comparten este topic de GitHub

Las líneas conectan a los miembros que están mediblemente relacionados entre sí. El tamaño de los puntos refleja las estrellas.

🧬 Miembros

runanywhere-sdks

Production ready toolkit to run AI locally

★ 10.3k

GenieX

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

★ 8.3k

LiteRT-LM

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large…

★ 6.1k

cactus

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

★ 5.5k

thunderbolt

AI You Control: Choose your models. Own your data. Eliminate vendor lock-in.

★ 4.7k

needle

Foundation model for tiny devices; 14mb, 26m params, 1-6k toks/sec on mobiles, wearables smart home and…

★ 3.3k

Local-File-Organizer

An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B…

★ 3.3k

parlor

On-device, real-time multimodal AI. Have natural voice and vision conversations with an AI that runs entirely…

★ 1.9k

react-native-executorch

Declarative way to run AI models in React Native on device, powered by ExecuTorch.

★ 1.7k

RCLI

Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG

★ 1.5k

ai

On-device LLM execution in React Native with Vercel AI SDK compatibility

★ 1.4k

mlx-tune

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR…

★ 1.4k

Foundation-Models-Framework-Lab

A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.

★ 1.2k

TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library

★ 959

TheWhisper

Optimized Whisper models for streaming and on-device use

★ 892

Wax

Single-file memory layer for AI agents, sub mili-second RAG on Apple Silicon. Metal Optimized On-Device. No…

★ 774

whisperIME

Android Input Method Editor (IME) based on Whisper

★ 609

Bonsai-Image-Demo

Generate images locally

★ 518

sentient-os

An on-device LLM understands your entire life, then proactively offers to get your work done through computer…

★ 377

local-llms-on-android

Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question…

★ 368

ClawMem

On-device memory layer for AI agents. Claude Code, Hermes and OpenClaw. Hooks + MCP server + hybrid RAG…

★ 195

OfflineLLM

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD.…

★ 192

Core-AI-Framework-Lab

A practical lab for exploring Apple's Core AI framework, model assets, specialization, and on-device…

★ 62 · GitHub ↗

Medido a partir de los temas de GitHub compartidos por ambos proyectos, ponderado por cuán raros son cada uno de los temas.