LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

rasbt/LLMs-from-scratch

View on GitHub ↗

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

LLMs-from-scratch grew +1.6% in the last 30 days, ranks 1st of 203 in Fine-Tuning (LoRA / PEFT), last commit 20 days ago.

Star trajectory

120 days tracked
2026-06-21107.1k stars today2026-10-23
Momentum

+1.6% in 30d, above the Fine-Tuning (LoRA / PEFT) median of +0.1%.

Maintenance

Last commit 20 days ago, fresher than the median of 257d.

How it compares in Fine-Tuning (LoRA / PEFT)

LLMs-from-scratch
107.1k
stars
+1.6% 30d
commit 20 days ago
Fine-Tuning (LoRA / PEFT) median
533
stars
+0.1% 30d
commit ~257d ago
Category leader
107.1k
stars
- 30d
you lead

Ranked 1st of 203 by stars.

Language
Jupyter Notebook
License
Other
Contributors
72
Forks
16.5k
Watchers
872
Open issues
2
Releases
0
Created
2023-07-23
Stars this week
+486

You've seen where LLMs-from-scratch stands today.

Get the moves before everyone else: the 5 Fine-Tuning (LoRA / PEFT) repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain LLMs-from-scratch?

Claim this page to add your own call-to-action.

Claim this page