mixture-of-experts

13 progetti condividono questo topic GitHub

Le linee collegano membri che sono misurabilmente correlati tra loro. La dimensione dei punti riflette le stelle.

🧬 Membri

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy,…

Optimizing inference proxy for LLMs

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

Codebase for Aria - an Open Multimodal Native MoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's…

Chinese-Mixtral

中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM…

soft-moe-pytorch

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

PyTorch library for cost-effective, fast and easy serving of MoE models.

Project_Chronos

⚡ Zero-Stall MoE Inference via Lookahead Prediction & Async DMA Prefetching. Optimized for SSD I/O with…

Toy-scale unified multimodal model experiments — encoder-free understanding & generation with…

★ 47 · GitHub ↗

🔗 Famiglie affini

llm-inference 76 lora 65 inference-engine 14 compression 22 gpu 93 inference 94 pipeline-parallelism 4 agentic-framework 33

Misurato dai temi di GitHub condivisi da entrambi i progetti, ponderato in base a quanto è raro ciascun tema.