Home Projects Pretrained-Language-Model
Pretrained-Language-Model
Python

Pretrained-Language-Model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

by huawei-noah · GitHub
Stars
Forks
Trending
Created
Last commit
Language
knowledge-distillationlarge-scale-distributedmodel-compressionPython
View on GitHub
In plain words

Access and optimize advanced language models for various natural language processing tasks.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
Pretrained-Language-Model — GitHub preview card
📈 Star history
3.17k3.16k
2026-07-122026-08-31
📈 Track Pretrained-Language-Model

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

Pretrained-Language-Model has 3.2k stars on GitHub. It has been forked 637 times. Pretrained-Language-Model is written mainly in Python. It has been in active development since 2019. Its main topics are knowledge-distillation, large-scale-distributed, model-compression, pretrained-models.

Frequently asked questions

What is Pretrained-Language-Model?

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

Is Pretrained-Language-Model open source?

Pretrained-Language-Model is an open-source project.

Is Pretrained-Language-Model free?

Yes. Pretrained-Language-Model is free and open source — you can use, modify and self-host it.

What language is Pretrained-Language-Model written in?

Pretrained-Language-Model is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — Pretrained-Language-Model

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=huawei-noah-pretrained-language-model)](https://olud.ai/project/huawei-noah-pretrained-language-model.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.