moe

13 projets partagent ce topic GitHub

Les traits relient les membres réellement apparentés entre eux. La taille des points suit les étoiles.

🧬 Membres

A high-throughput and memory-efficient inference and serving engine for LLMs

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

SGLang is a high-performance serving framework for large language models and multimodal models.

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4,…

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and…

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS,…

FlashInfer: Kernel Library for LLM Serving

GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models

MoBA: Mixture of Block Attention for Long-Context LLMs

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL…

Chinese-Mixtral

中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

MindSpore online courses: Step into LLM

Run Ornith, Qwen, Nemotron & DeepSeek optimized on AMD Strix Halo — unified OpenAI-compatible server with…

★ 41 · GitHub ↗

🔗 Familles voisines

cuda 78 transformer 59 blackwell 6 llm-serving 17 qwen 74 peft 16 quantization 36 llm-inference 65

Mesuré à partir des topics GitHub communs aux deux projets, pondérés par leur rareté.