sglang

11 proyectos comparten este topic de GitHub

Las líneas conectan a los miembros que están mediblemente relacionados entre sí. El tamaño de los puntos refleja las estrellas.

🧬 Miembros

Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

★ 6.1k

gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU…

★ 5.4k

auto-round

A SOTA quantization algorithm for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA,…

★ 1.5k

MOSS-TTSD

MOSS-TTSD is a spoken dialogue generation model designed for expressive multi-speaker synthesis. It features…

★ 1.4k

InferenceX

Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 -…

★ 1.3k

GPTQModel

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and…

★ 1.2k

MOVA

MOVA: Towards Scalable and Synchronized Video–Audio Generation

★ 1.1k

UniRL

UniRL is a Framework for Unified Multimodal Model Reinforcement Learning

★ 860

Relax

An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale

★ 550

smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM,…

★ 421

heron

Agent and LLM API performance monitoring via network packet probe. Measures performance of OpenClaw, Claude,…

★ 66 · GitHub ↗

Medido a partir de los temas de GitHub compartidos por ambos proyectos, ponderado por cuán raros son cada uno de los temas.