Home› Projects› MEGABYTE-pytorch
MEGABYTE-pytorch
Python

MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

by lucidrains · GitHub
655
Stars
55
Forks
MIT
License
2023
Created
1 yr ago
Last commit
artificial-intelligence
Category
Python
Language
artificial-intelligenceattention-mechanismsdeep-learningMITPython
View on GitHub
In plain words

Predict long sequences of data using advanced AI techniques in your projects.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
MEGABYTE-pytorch — GitHub preview card
📈 Star history
656655
2026-07-202026-08-31
📈 Track MEGABYTE-pytorch

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

MEGABYTE-pytorch has 655 stars on GitHub. It has been forked 55 times. MEGABYTE-pytorch is written mainly in Python. It has been in active development since 2023. MEGABYTE-pytorch is available under the MIT license. Its main topics are artificial-intelligence, attention-mechanisms, deep-learning, learned-tokenization.

❓ Frequently asked questions

What is MEGABYTE-pytorch?

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

Is MEGABYTE-pytorch open source?

MEGABYTE-pytorch is an open-source project. It is released under the MIT license.

Is MEGABYTE-pytorch free?

Yes. MEGABYTE-pytorch is free and open source — you can use, modify and self-host it.

What license does MEGABYTE-pytorch use?

MEGABYTE-pytorch is available under the MIT license.

What language is MEGABYTE-pytorch written in?

MEGABYTE-pytorch is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — MEGABYTE-pytorch

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=lucidrains-megabyte-pytorch)](https://olud.ai/project/lucidrains-megabyte-pytorch.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →
robotic-transformer-pytorch
Implementation of RT1 (Robotic Transformer) in Pytorch
★ 455 · artificial-intelligence
sharesattention-mechanisms
muse-maskgit-pytorch
Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch
★ 918 · artificial-intelligence
sharesattention-mechanisms
Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes…
★ 5k · attention-mechanism
sharesattention-mechanisms
iTransformer
Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networ…
★ 538 · artificial-intelligence
sharesattention-mechanisms
recurrent-memory-transformer-pytorch
Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
★ 424 · artificial-intelligence
sharesattention-mechanisms
meshgpt-pytorch
Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch
★ 861 · artificial-intelligence
sharesattention-mechanisms
audiolm-pytorch
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google…
★ 2.6k · artificial-intelligence
sharesattention-mechanisms
PaLM-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architec…
★ 7.9k · artificial-intelligence
sharesattention-mechanisms
alphafold3-pytorch
Implementation of Alphafold 3 from Google Deepmind in Pytorch
★ 1.7k · artificial-intelligence
sharesattention-mechanisms
phenaki-pytorch
Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 m…
★ 790 · artificial-intelligence
sharesattention-mechanisms

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.