Home Projects memorizing-transformers-pytorch
memorizing-transformers-pytorch
Python

memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch

by lucidrains · GitHub
Stars
Forks
License
Created
Last commit
Language
approximate-nearest-neighborsartificial-intelligenceattention-mechanismMITPython
View on GitHub
In plain words

Implement and experiment with advanced memory techniques in AI models using PyTorch.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
memorizing-transformers-pytorch — GitHub preview card
📈 Star history
647646
2026-07-202026-08-31
📈 Track memorizing-transformers-pytorch

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch

memorizing-transformers-pytorch has 646 stars on GitHub. It has been forked 48 times. memorizing-transformers-pytorch is written mainly in Python. It has been in active development since 2022. memorizing-transformers-pytorch is available under the MIT license. Its main topics are approximate-nearest-neighbors, artificial-intelligence, attention-mechanism, deep-learning.

Frequently asked questions

What is memorizing-transformers-pytorch?

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch

Is memorizing-transformers-pytorch open source?

memorizing-transformers-pytorch is an open-source project. It is released under the MIT license.

Is memorizing-transformers-pytorch free?

Yes. memorizing-transformers-pytorch is free and open source — you can use, modify and self-host it.

What license does memorizing-transformers-pytorch use?

memorizing-transformers-pytorch is available under the MIT license.

What language is memorizing-transformers-pytorch written in?

memorizing-transformers-pytorch is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — memorizing-transformers-pytorch

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=lucidrains-memorizing-transformers-pytorch)](https://olud.ai/project/lucidrains-memorizing-transformers-pytorch.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →
oasysdb
In-memory vector store with efficient read and write performance for semantic caching and retri…
375 · approximate-nearest-neighbors
sharesapproximate-nearest-neighbors
MultiModalMamba
A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-…
473 · ai
sharesattention-mechanism
sign-language-translator
Python library & framework to build custom translators for the hearing-impaired and translate b…
359 · artificial-intelligence
sharesattention-mechanism
Star-Attention
Efficient LLM Inference over Long Sequences
392 · attention-mechanism
sharesattention-mechanism
reformer-pytorch
Reformer, the efficient Transformer, in Pytorch
2.2k · artificial-intelligence
sharesattention-mechanism
x-transformers
A concise but complete full-attention transformer with a set of promising experimental features…
5.9k · artificial-intelligence
sharesattention-mechanism
flamingo-pytorch
Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net…
1.3k · artificial-intelligence
sharesattention-mechanism
TimeSformer-pytorch
Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video class…
729 · artificial-intelligence
sharesattention-mechanism
nndl
邱锡鹏《神经网络与深度学习》(蒲公英书)理论书 v2 与通识版
19k · attention-mechanism
sharesattention-mechanism
GeoTransformer
[CVPR2022] Geometric Transformer for Fast and Robust Point Cloud Registration
966 · attention-mechanism
sharesattention-mechanism

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.