moe

13 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

A high-throughput and memory-efficient inference and serving engine for LLMs

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

SGLang is a high-performance serving framework for large language models and multimodal models.

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4,…

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and…

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS,…

FlashInfer: Kernel Library for LLM Serving

GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models

MoBA: Mixture of Block Attention for Long-Context LLMs

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL…

Chinese-Mixtral

中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

MindSpore online courses: Step into LLM

Run Ornith, Qwen, Nemotron & DeepSeek optimized on AMD Strix Halo — unified OpenAI-compatible server with…

★ 41 · GitHub ↗

🔗 Familias relacionadas

cuda 78 transformer 59 blackwell 6 llm-serving 17 qwen 74 peft 16 quantization 36 llm-inference 65

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.