mixture-of-experts

13 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy,…

Optimizing inference proxy for LLMs

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

Codebase for Aria - an Open Multimodal Native MoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's…

Chinese-Mixtral

中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM…

soft-moe-pytorch

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

PyTorch library for cost-effective, fast and easy serving of MoE models.

Project_Chronos

⚡ Zero-Stall MoE Inference via Lookahead Prediction & Async DMA Prefetching. Optimized for SSD I/O with…

Toy-scale unified multimodal model experiments — encoder-free understanding & generation with…

★ 47 · GitHub ↗

🔗 Familias relacionadas

llm-inference 76 lora 65 inference-engine 14 compression 22 gpu 93 inference 94 pipeline-parallelism 4 agentic-framework 33

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.