moe

13 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

A high-throughput and memory-efficient inference and serving engine for LLMs

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

SGLang is a high-performance serving framework for large language models and multimodal models.

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4,…

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and…

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS,…

FlashInfer: Kernel Library for LLM Serving

GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models

MoBA: Mixture of Block Attention for Long-Context LLMs

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL…

Chinese-Mixtral

中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

MindSpore online courses: Step into LLM

Run Ornith, Qwen, Nemotron & DeepSeek optimized on AMD Strix Halo — unified OpenAI-compatible server with…

★ 41 · GitHub ↗

🔗 Related families

cuda 78 transformer 59 blackwell 6 llm-serving 17 qwen 74 peft 16 quantization 36 llm-inference 65

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.