OpenArch
PyTorch implementations of modern open-source LLM architectures (Llama, Qwen, DeepSeek, Gemma, GPT-OSS, Kimi, and more) — written from scratch for readability and learning, based on Sebastian Raschka's LLM Architecture Gallery.
anuj0456/OpenArch
View on GitHub ↗PyTorch implementations of modern open-source LLM architectures (Llama, Qwen, DeepSeek, Gemma, GPT-OSS, Kimi, and more) — written from scratch for readability and learning, based on Sebastian Raschka's LLM Architecture Gallery.
OpenArch grew +0.9% in the last 30 days, ranks 30th of 56 in Deep Learning Frameworks, last commit 52 days ago.
Star trajectory
66 days tracked+0.9% in 30d, above the Deep Learning Frameworks median of +0.1%.
Last commit 52 days ago, fresher than the median of 524.5d.
How it compares in Deep Learning Frameworks
Ranked 30th of 56 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere OpenArch sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's…
+1 (+0.1%) in 30d · Committed 752d ago · Jupyter Notebook · MIT
Shares Training Toolkits, Deep Learning Frameworks
PyTorch implementation of some attentions for Deep Learning Researchers.
+0 (+0.0%) in 30d · Committed 1,724d ago · Python · MIT
Shares Deep Learning Frameworks, Training Toolkits
GPU 性能与 AI Infra 学习项目:CUDA/Triton 算子、NCU/NSYS、vLLM/SGLang/TRT-LLM/ms-swift、PyTorch/DeepSpeed/ms-swift 训练、并行架构
+2 (+1.6%) in 30d · Committed 75d ago · Python · Apache-2.0
Shares Training Toolkits, Deep Learning Frameworks
GleamLM大语言模型全栈训练平台——核心代码用 PyTorch 从零实现,最低仅需 12GB 消费级显卡即可完整训练,另有一套工业代码与手写实现消费同一份数据逐层对照。模型训练支持CLI和可视化训练。
+1 (+1.5%) in 30d · Committed 65d ago · Python · Apache-2.0
Shares Training Toolkits, Deep Learning Frameworks
- sail-sg/Adan826
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
+2 (+0.2%) in 30d · Committed 531d ago · Python · Apache-2.0
Shares Training Toolkits, Deep Learning Frameworks
OpenChem: Deep Learning toolkit for Computational Chemistry and Drug Design Research
+10 (+1.3%) in 30d · Committed 1,092d ago · Python · MIT
Shares Deep Learning Frameworks, Training Toolkits
PyTorch implementations of various Deep Reinforcement Learning (DRL) algorithms for both single agent and…
+1 (+0.2%) in 30d · Committed 3,297d ago · Python · MIT
Shares Training Toolkits, Deep Learning Frameworks
DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatch (ICCV 2019)
+0 (+0.0%) in 30d · Committed 2,269d ago · Python · Other license
Shares Deep Learning Frameworks, Training Toolkits
The purpose of this repository is to make prototypes as case study in the context of proof of concept(PoC) and…
+0 (+0.0%) in 30d · Committed 1,062d ago · Python · GPL-2.0
Shares Training Toolkits, Deep Learning Frameworks
Minimal yet performant LLM examples in pure JAX
+5 (+1.8%) in 30d · Committed 2d ago · Python · Apache-2.0
Shares Training Toolkits, Deep Learning Frameworks
- Language
- Python
- License
- MIT License
- Contributors
- 1
- Forks
- 34
- Watchers
- 3
- Open issues
- 4
- Releases
- 0
- Created
- 2026-05-27
- Stars this week
- +2
You've seen where OpenArch stands today.
Get the moves before everyone else: the 5 Deep Learning Frameworks repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.