Home Projects performer-pytorch
performer-pytorch
Python

performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

by lucidrains · GitHub
Stars
Forks
License
Created
Last commit
Language
artificial-intelligenceattentionattention-mechanismMITPython
View on GitHub
In plain words

Implement a transformer model that uses a more efficient attention mechanism for various tasks.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
performer-pytorch — GitHub preview card
📈 Star history
1 1801 179
2026-07-202026-08-31
📈 Track performer-pytorch

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

An implementation of Performer, a linear attention-based transformer, in Pytorch

performer-pytorch has 1.2k stars on GitHub. It has been forked 150 times. performer-pytorch is written mainly in Python. It has been in active development since 2020. performer-pytorch is available under the MIT license. Its main topics are artificial-intelligence, attention, attention-mechanism, deep-learning.

Frequently asked questions

What is performer-pytorch?

An implementation of Performer, a linear attention-based transformer, in Pytorch

Is performer-pytorch open source?

performer-pytorch is an open-source project. It is released under the MIT license.

Is performer-pytorch free?

Yes. performer-pytorch is free and open source — you can use, modify and self-host it.

What license does performer-pytorch use?

performer-pytorch is available under the MIT license.

What language is performer-pytorch written in?

performer-pytorch is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — performer-pytorch

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=lucidrains-performer-pytorch)](https://olud.ai/project/lucidrains-performer-pytorch.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →
self-attention-cv
Implementation of various self-attention mechanisms focused on computer vision. Ongoing reposit…
1.2k · artificial-intelligence
sharesattentionattention-mechanism
lambda-networks
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with le…
1.5k · artificial-intelligence
sharesattentionattention-mechanism
Deepdive-llama3-from-scratch
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivati…
631 · attention
sharesattentionattention-mechanism
nanodl
JAX library for training sub-4B foundation models for edge
306 · attention
sharesattentionattention-mechanism
pytorch-original-transformer
My implementation of the original transformer model (Vaswani et al.). I've additionally include…
1.1k · attention
sharesattentionattention-mechanism
pytorch-GAT
My implementation of the original GAT paper (Veličković et al.). I've additionally included the…
2.7k · attention
sharesattentionattention-mechanism
neural_sp
End-to-end ASR/LM implementation with PyTorch
594 · asr
sharesattentionattention-mechanism
seq2seq-summarizer
Pointer-generator reinforced seq2seq summarization in PyTorch
358 · abstractive-summarization
sharesattentionattention-mechanism
OpenMythos
A theoretical reconstruction of the Claude Mythos architecture, built from first principles usi…
14.7k · ai
sharesattention
MultiModalMamba
A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-…
473 · ai
sharesattention-mechanism

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.