metal

11 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

A high-performance inference engine for AI models

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model…

Community maintained hardware plugin for vLLM on Apple Silicon

★ 1.9k · GitHub ↗

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG

Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple…

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console…

metal-flash-attention

FlashAttention (Metal Port)

Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache…

Core-AI-Framework-Lab

A practical lab for exploring Apple's Core AI framework, model assets, specialization, and on-device…

🔗 Familias relacionadas

apple-silicon 46 on-device-ai 29 cuda 82 llama-cpp 33 gemma 29 gemma4 8 local-ai 58 inference 81

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.