sglang

15 Projekte teilen dieses GitHub-Topic

Linien verbinden Mitglieder, die messbar miteinander verwandt sind. Die Punktgröße spiegelt die Sterne wider.

🧬 Mitglieder

inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and…

★ 9.6k

Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

★ 6.9k

gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU…

★ 5.9k

kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

★ 2k · GitHub ↗

zero-to-sglang

Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch,…

★ 1.6k · GitHub ↗

InferenceX

Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 -…

★ 1.6k

MOSS-TTSD

A multilingual model for long-form, multi-speaker dialogue synthesis with flexible speaker control and…

★ 1.4k

MOVA

MOVA: Towards Scalable and Synchronized Video–Audio Generation

★ 1.1k

time-to-first-token

A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization,…

★ 1k · GitHub ↗

Spark-X2.6

Spark-x2.6 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models

★ 860 · GitHub ↗

UniRL

UniRL is a Framework for Unified Multimodal Model Reinforcement Learning

★ 820

deepseek-local-guide-ru

🐋 Полный гайд на русском: как установить и запустить DeepSeek…

★ 157 · GitHub ↗

heron

Agent and LLM API performance monitoring via network packet probe. Measures performance of OpenClaw, Claude,…

★ 103

infercrane

Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely…

★ 53

global-capacity-orchestrator-on-aws

AI/ML and HPC at planetary scale. One API. Every Accelerator. Any Region. MIT-0 licensed

★ 52 · GitHub ↗

Gemessen anhand der von beiden Projekten geteilten GitHub-Themen, gewichtet nach der Seltenheit jedes Themas.