makeMoE
From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)
AviSoori1x/makeMoE
View on GitHub ↗From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)
makeMoE grew +0.4% in the last 30 days, ranks 62nd of 347 in Training Toolkits, last commit 725 days ago.
Star trajectory
80 days tracked2026-08-07820 stars today2026-10-26
Momentum
+0.4% in 30d, above the Training Toolkits median of +0.0%.
Maintenance
Last commit 725 days ago, staler than the median of 227d.
How it compares in Training Toolkits
makeMoE
820
stars
+0.4% 30d
commit 725 days ago
Training Toolkits median
325
stars
+0.0% 30d
commit ~227d ago
Leader · TTS
46.1k
stars
+0.2% 30d
commit 801 days ago
Ranked 62nd of 347 by stars.
- Language
- Jupyter Notebook
- License
- MIT License
- Contributors
- 2
- Forks
- 96
- Watchers
- 5
- Open issues
- 1
- Releases
- 0
- Created
- 2024-01-22
- Stars this week
- +0
You've seen where makeMoE stands today.
Get the moves before everyone else: the 5 Training Toolkits repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.