mixture-of-experts

13 projets partagent ce topic GitHub

Les traits relient les membres réellement apparentés entre eux. La taille des points suit les étoiles.

🧬 Membres

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy,…

Optimizing inference proxy for LLMs

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

Codebase for Aria - an Open Multimodal Native MoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's…

Chinese-Mixtral

中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM…

soft-moe-pytorch

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

PyTorch library for cost-effective, fast and easy serving of MoE models.

Project_Chronos

⚡ Zero-Stall MoE Inference via Lookahead Prediction & Async DMA Prefetching. Optimized for SSD I/O with…

Toy-scale unified multimodal model experiments — encoder-free understanding & generation with…

★ 47 · GitHub ↗

🔗 Familles voisines

llm-inference 76 lora 65 inference-engine 14 compression 22 gpu 93 inference 94 pipeline-parallelism 4 agentic-framework 33

Mesuré à partir des topics GitHub communs aux deux projets, pondérés par leur rareté.