blackwell

6 projets partagent ce topic GitHub

Les traits relient les membres réellement apparentés entre eux. La taille des points suit les étoiles.

🧬 Membres

A high-throughput and memory-efficient inference and serving engine for LLMs

SGLang is a high-performance serving framework for large language models and multimodal models.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and…

TokenSpeed is a speed-of-light LLM inference engine.

OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

🔗 Familles voisines

qwen 87 cuda 82 gpt-oss 11 kimi 23 llm-serving 21 moe 17 transformer 62 glm 27

Mesuré à partir des topics GitHub communs aux deux projets, pondérés par leur rareté.