blackwell

6 Projekte teilen dieses GitHub-Topic

Linien verbinden Mitglieder, die messbar miteinander verwandt sind. Die Punktgröße spiegelt die Sterne wider.

🧬 Mitglieder

A high-throughput and memory-efficient inference and serving engine for LLMs

SGLang is a high-performance serving framework for large language models and multimodal models.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and…

OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

TokenSpeed is a speed-of-light LLM inference engine.

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

🔗 Verwandte Familien

qwen 74 cuda 78 gpt-oss 11 kimi 20 llm-serving 17 moe 13 transformer 59 glm 25

Gemessen anhand der von beiden Projekten geteilten GitHub-Themen, gewichtet nach der Seltenheit jedes Themas.