Home Projects soft-moe-pytorch
soft-moe-pytorch
Python

soft-moe-pytorch

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

by lucidrains · GitHub
Stars
Forks
License
Created
Last commit
Language
artificial-intelligencedeep-learningmixture-of-expertsMITPython
View on GitHub
In plain words

Implement a specialized AI model that improves performance in certain tasks using Pytorch.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
soft-moe-pytorch — GitHub preview card
📈 Star history
349348
2026-07-202026-08-31
📈 Track soft-moe-pytorch

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

soft-moe-pytorch has 348 stars on GitHub. It has been forked 10 times. soft-moe-pytorch is written mainly in Python. It has been in active development since 2023. soft-moe-pytorch is available under the MIT license. Its main topics are artificial-intelligence, deep-learning, mixture-of-experts, transformers.

Frequently asked questions

What is soft-moe-pytorch?

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

Is soft-moe-pytorch open source?

soft-moe-pytorch is an open-source project. It is released under the MIT license.

Is soft-moe-pytorch free?

Yes. soft-moe-pytorch is free and open source — you can use, modify and self-host it.

What license does soft-moe-pytorch use?

soft-moe-pytorch is available under the MIT license.

What language is soft-moe-pytorch written in?

soft-moe-pytorch is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — soft-moe-pytorch

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=lucidrains-soft-moe-pytorch)](https://olud.ai/project/lucidrains-soft-moe-pytorch.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.