Awesome-Knowledge-Distillation-of-LLMs
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
Read a collection of research papers about improving large language models.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeThis repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
Awesome-Knowledge-Distillation-of-LLMs has 1.3k stars on GitHub. It has been forked 73 times. It has been in active development since 2024. Its main topics are alignment, compression, data-augmentation, data-synthesis.
What is Awesome-Knowledge-Distillation-of-LLMs?
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
Is Awesome-Knowledge-Distillation-of-LLMs open source?
Awesome-Knowledge-Distillation-of-LLMs is an open-source project.
Is Awesome-Knowledge-Distillation-of-LLMs free?
Yes. Awesome-Knowledge-Distillation-of-LLMs is free and open source — you can use, modify and self-host it.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/tebmer-awesome-knowledge-distillation-of-llms.html)
