Home Projects BitNet-Transformers
BitNet-Transformers
Python

BitNet-Transformers

0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture

by Beomi · GitHub
Stars
Forks
Created
Last commit
Category
Language
Likely
Self-hostable
llmquantizationquantization-aware-trainingPythonSelf-hostable
View on GitHub
In plain words

Train large language models using a specific method that reduces memory usage on your computer.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
BitNet-Transformers — GitHub preview card
📈 Star history
317316
2026-07-202026-08-31
📈 Track BitNet-Transformers

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture

BitNet-Transformers has 316 stars on GitHub. It has been forked 35 times. BitNet-Transformers is written mainly in Python. It has been in active development since 2023. Its main topics are llm, quantization, quantization-aware-training, transformers.

Frequently asked questions

What is BitNet-Transformers?

0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture

Is BitNet-Transformers open source?

BitNet-Transformers is an open-source project.

Is BitNet-Transformers free?

Yes. BitNet-Transformers is free and open source — you can use, modify and self-host it.

What language is BitNet-Transformers written in?

BitNet-Transformers is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — BitNet-Transformers

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=beomi-bitnet-transformers)](https://olud.ai/project/beomi-bitnet-transformers.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.