Awesome-Knowledge-Distillation-of-LLMs

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

Tebmer/Awesome-Knowledge-Distillation-of-LLMs

View on GitHub ↗

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

Awesome-Knowledge-Distillation-of-LLMs grew +0.3% in the last 30 days, ranks 468th of 2,576 in Agent SDK / Framework, last commit 592 days ago.

Star trajectory

123 days tracked
2026-06-211.3k stars today2026-10-23
Momentum

+0.3% in 30d, below the Agent SDK / Framework median of +1.5%.

Maintenance

Last commit 592 days ago, staler than the median of 14d.

How it compares in Agent SDK / Framework

Awesome-Knowledge-Distillation-of-LLMs
1.3k
stars
+0.3% 30d
commit 592 days ago
Agent SDK / Framework median
308
stars
+1.5% 30d
commit ~14d ago
Leader · rea
367.9k
stars
+88983.3% 30d
commit today

Ranked 468th of 2,576 by stars.

Language
-
License
-
Contributors
2
Forks
76
Watchers
18
Open issues
1
Releases
0
Created
2024-02-08
Stars this week
+1

You've seen where Awesome-Knowledge-Distillation-of-LLMs stands today.

Get the moves before everyone else: the 5 Agent SDK / Framework repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain Awesome-Knowledge-Distillation-of-LLMs?

Claim this page to add your own call-to-action.

Claim this page