mixture-of-experts

13 proyectos comparten este topic de GitHub

Las líneas conectan a los miembros que están mediblemente relacionados entre sí. El tamaño de los puntos refleja las estrellas.

🧬 Miembros

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy,…

Optimizing inference proxy for LLMs

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

Codebase for Aria - an Open Multimodal Native MoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's…

Chinese-Mixtral

中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM…

soft-moe-pytorch

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

PyTorch library for cost-effective, fast and easy serving of MoE models.

Project_Chronos

⚡ Zero-Stall MoE Inference via Lookahead Prediction & Async DMA Prefetching. Optimized for SSD I/O with…

Toy-scale unified multimodal model experiments — encoder-free understanding & generation with…

★ 47 · GitHub ↗

🔗 Familias relacionadas

llm-inference 76 lora 65 inference-engine 14 compression 22 gpu 93 inference 94 pipeline-parallelism 4 agentic-framework 33

Medido a partir de los temas de GitHub compartidos por ambos proyectos, ponderado por cuán raros son cada uno de los temas.