sglang

9 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and…

★ 9.5k

Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

★ 6.4k

gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU…

★ 5.6k

InferenceX

Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 -…

★ 1.6k

MOSS-TTSD

MOSS-TTSD is a spoken dialogue generation model designed for expressive multi-speaker synthesis. It features…

★ 1.4k

MOVA

MOVA: Towards Scalable and Synchronized Video–Audio Generation

★ 1.1k

UniRL

UniRL is a Framework for Unified Multimodal Model Reinforcement Learning

★ 820

heron

Agent and LLM API performance monitoring via network packet probe. Measures performance of OpenClaw, Claude,…

★ 95

infercrane

Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely…

★ 51

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.