LoRA
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
Integrate a library that helps you fine-tune large language models using fewer resources in your projects.
From the README
pip install loralib # Alternatively # pip install git+https://github.com/microsoft/LoRA
- loralib/ contains the source code for the package loralib, which needs to be installed to run the examples we provide;
- examples/NLG/ contains an example implementation of LoRA in GPT-2 using our package, which can be used to reproduce the result in our paper;
- examples/NLU/ contains an example implementation of LoRA in RoBERTa and DeBERTa using our package, which produces competitive results on the GLUE benchmark;
Excerpts from the project README on GitHub. Copyright and licensing remain with the respective authors.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeCode for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
LoRA has 13.8k stars on GitHub. It has been forked 925 times. LoRA is written mainly in Python. It has been in active development since 2021. LoRA is available under the MIT license. Its main topics are adaptation, deberta, deep-learning, gpt-2.
What is LoRA?
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
Is LoRA open source?
LoRA is an open-source project. It is released under the MIT license.
Is LoRA free?
Yes. LoRA is free and open source — you can use, modify and self-host it.
What license does LoRA use?
LoRA is available under the MIT license.
What language is LoRA written in?
LoRA is written mainly in Python.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/microsoft-lora.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.