Home Projects attention-is-all-you-need-pytorch
attention-is-all-you-need-pytorch
Python

attention-is-all-you-need-pytorch

A PyTorch implementation of the Transformer model in "Attention is All You Need".

by jadore801120 · GitHub
Stars
Forks
License
Created
Last commit
Category
Language
attentionattention-is-all-you-needdeep-learningMITPython
View on GitHub
In plain words

Train and test a model that translates text using a self-attention mechanism.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
attention-is-all-you-need-pytorch — GitHub preview card
📈 Star history
9.8k9.7k
2026-07-042026-08-31
📈 Track attention-is-all-you-need-pytorch

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

A PyTorch implementation of the Transformer model in "Attention is All You Need".

attention-is-all-you-need-pytorch has 9.8k stars on GitHub. It has been forked 2.1k times. attention-is-all-you-need-pytorch is written mainly in Python. It has been in active development since 2017. attention-is-all-you-need-pytorch is available under the MIT license. Its main topics are attention, attention-is-all-you-need, deep-learning, natural-language-processing.

Frequently asked questions

What is attention-is-all-you-need-pytorch?

A PyTorch implementation of the Transformer model in "Attention is All You Need".

Is attention-is-all-you-need-pytorch open source?

attention-is-all-you-need-pytorch is an open-source project. It is released under the MIT license.

Is attention-is-all-you-need-pytorch free?

Yes. attention-is-all-you-need-pytorch is free and open source — you can use, modify and self-host it.

What license does attention-is-all-you-need-pytorch use?

attention-is-all-you-need-pytorch is available under the MIT license.

What language is attention-is-all-you-need-pytorch written in?

attention-is-all-you-need-pytorch is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — attention-is-all-you-need-pytorch

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=jadore801120-attention-is-all-you-need-pytorch)](https://olud.ai/project/jadore801120-attention-is-all-you-need-pytorch.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.