knowledge-distillation
16 projets partagent ce topic GitHub
Les traits relient les membres réellement apparentés entre eux. La taille des points suit les étoiles.
🧬 Membres
awesome-knowledge-distillation
Awesome Knowledge Distillation
★ 3.9k
Pretrained-Language-Model
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
★ 3.2k
VLM_survey
Collection of AWESOME vision-language models for vision tasks
★ 3.1k
neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression…
★ 2.7k
ai-knowledge-graph
AI Powered Knowledge Graph Generator
★ 2.6k
EasyNLP
EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit
★ 2.2k
Awesome-Efficient-LLM
A curated list for Efficient Large Language Models
★ 2k
knowledge-distillation-pytorch
A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with…
★ 2k
Awesome-Knowledge-Distillation-of-LLMs
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break…
★ 1.3k
mdistiller
The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679…
★ 897
distill-sd
Segmind Distilled diffusion
★ 618
awesome-on-policy-distillation
A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of…
★ 572
Awesome-LLM-On-Policy-Distillation
A curated collection of papers and resources on On-Policy Distillation for Large Language Models.
★ 479
easydistill
a toolkit on knowledge distillation for large language models
★ 443
RKD
Official pytorch Implementation of Relational Knowledge Distillation, CVPR 2019
★ 419
logit-standardization-KD
[CVPR 2024 Highlight] Logit Standardization in Knowledge Distillation
★ 385
🔗 Familles voisines
Mesuré à partir des topics GitHub communs aux deux projets, pondérés par leur rareté.