amd

14 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

A high-throughput and memory-efficient inference and serving engine for LLMs

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or…

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and…

QualityScaler - image/video AI upscaler app

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and…

Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for…

Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 -…

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL…

Build AI agents for your PC

halogen-flash-server

Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models,…

★ 1.1k · GitHub ↗

The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37…

★ 963 · GitHub ↗

Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon

🔗 Related families

cuda 82 rocm 8 qwen 87 nvidia 21 strix-halo 4 gpu 64 npu 4 inference 81

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.