Home Projects transformer-in-transformer
transformer-in-transformer
Python

transformer-in-transformer

Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch

by lucidrains · GitHub
Stars
Forks
License
Created
Last commit
Language
artificial-intelligencedeep-learningimage-classificationMITPython
View on GitHub
In plain words

Classify images using a model that focuses on both individual pixels and larger sections of the image.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
transformer-in-transformer — GitHub preview card
📈 Star history
307306
2026-07-202026-08-31
📈 Track transformer-in-transformer

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch

transformer-in-transformer has 306 stars on GitHub. It has been forked 41 times. transformer-in-transformer is written mainly in Python. It has been in active development since 2021. transformer-in-transformer is available under the MIT license. Its main topics are artificial-intelligence, deep-learning, image-classification, transformers.

Frequently asked questions

What is transformer-in-transformer?

Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch

Is transformer-in-transformer open source?

transformer-in-transformer is an open-source project. It is released under the MIT license.

Is transformer-in-transformer free?

Yes. transformer-in-transformer is free and open source — you can use, modify and self-host it.

What license does transformer-in-transformer use?

transformer-in-transformer is available under the MIT license.

What language is transformer-in-transformer written in?

transformer-in-transformer is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — transformer-in-transformer

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=lucidrains-transformer-in-transformer)](https://olud.ai/project/lucidrains-transformer-in-transformer.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →
pytorch-vit
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
309 · hybrid-vit
sharesimage-classificationtransformers
computer-vision
Programming Assignments and Lectures for Stanford's CS 231: Convolutional Neural Networks for V…
508 · computer-vision
sharesimage-classification
AlphaTree-graphic-deep-neural-network
AI Roadmap:机器学习(Machine Learning)、深度学习(Deep Learning)、对抗神经网络(GAN),图神经网络(GNN),NLP,大数据相关的发展路书(roa…
3k · deep-learning
sharesimage-classification
bottleneck-transformer-pytorch
Implementation of Bottleneck Transformer in Pytorch
678 · artificial-intelligence
sharesimage-classification
vit-pytorch
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification wit…
25.4k · artificial-intelligence
sharesimage-classification
Natural_Language_Processing_with_Transformers
Natural Language Processing with Transformers 中译本,最权威Transformers教程
574 · bert
sharestransformers
catalyst
Accelerated deep learning R&D
3.4k · computer-vision
sharesimage-classification
Awesome-Backbones
Integrate deep learning models for image classification | Backbone learning/comparison/magic mo…
2k · cnn
sharesimage-classification
ultralytics
Ultralytics YOLO26, YOLO11, YOLOv8 — object detection, instance segmentation, semantic segmenta…
59.6k · computer-vision
sharesimage-classification
GFNet
[NeurIPS 2021] [T-PAMI] Global Filter Networks for Image Classification
511 · computer-vision
sharesimage-classification

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.