amd

14 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

A high-throughput and memory-efficient inference and serving engine for LLMs

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or…

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and…

QualityScaler - image/video AI upscaler app

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and…

Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for…

Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 -…

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL…

Build AI agents for your PC

halogen-flash-server

Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models,…

★ 1.1k · GitHub ↗

The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37…

★ 963 · GitHub ↗

Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon

🔗 Familias relacionadas

cuda 82 rocm 8 qwen 87 nvidia 21 strix-halo 4 gpu 64 npu 4 inference 81

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.