Home Projects recurrent-memory-transformer-pytorch
recurrent-memory-transformer-pytorch
Python

recurrent-memory-transformer-pytorch

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

by lucidrains · GitHub
Stars
Forks
License
Created
Last commit
Language
artificial-intelligenceattention-mechanismsdeep-learningMITPython
View on GitHub
In plain words

Implement a memory-enhanced AI model that can handle very long pieces of information effectively.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
recurrent-memory-transformer-pytorch — GitHub preview card
📈 Star history
425424
2026-07-202026-08-31
📈 Track recurrent-memory-transformer-pytorch

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

recurrent-memory-transformer-pytorch has 424 stars on GitHub. It has been forked 19 times. recurrent-memory-transformer-pytorch is written mainly in Python. It has been in active development since 2023. recurrent-memory-transformer-pytorch is available under the MIT license. Its main topics are artificial-intelligence, attention-mechanisms, deep-learning, long-context.

Frequently asked questions

What is recurrent-memory-transformer-pytorch?

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

Is recurrent-memory-transformer-pytorch open source?

recurrent-memory-transformer-pytorch is an open-source project. It is released under the MIT license.

Is recurrent-memory-transformer-pytorch free?

Yes. recurrent-memory-transformer-pytorch is free and open source — you can use, modify and self-host it.

What license does recurrent-memory-transformer-pytorch use?

recurrent-memory-transformer-pytorch is available under the MIT license.

What language is recurrent-memory-transformer-pytorch written in?

recurrent-memory-transformer-pytorch is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — recurrent-memory-transformer-pytorch

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=lucidrains-recurrent-memory-transformer-pytorch)](https://olud.ai/project/lucidrains-recurrent-memory-transformer-pytorch.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →
InfiniteBench
Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arx…
391 · benchmark
shareslong-context
robotic-transformer-pytorch
Implementation of RT1 (Robotic Transformer) in Pytorch
455 · artificial-intelligence
sharesattention-mechanisms
InfLLM
The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extre…
407 · large-language-models
shareslong-context
muse-maskgit-pytorch
Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch
918 · artificial-intelligence
sharesattention-mechanisms
LongWriter
[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
1.9k · fine-tuning
shareslong-context
Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes…
5k · attention-mechanism
sharesattention-mechanisms
ringattention
Large Context Attention
772 · large-language-models
shareslong-context
iTransformer
Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networ…
538 · artificial-intelligence
sharesattention-mechanisms
meshgpt-pytorch
Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch
861 · artificial-intelligence
sharesattention-mechanisms
audiolm-pytorch
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google…
2.6k · artificial-intelligence
sharesattention-mechanisms

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.