OpenArch

PyTorch implementations of modern open-source LLM architectures (Llama, Qwen, DeepSeek, Gemma, GPT-OSS, Kimi, and more) — written from scratch for readability and learning, based on Sebastian Raschka's LLM Architecture Gallery.

anuj0456/OpenArch

View on GitHub ↗

PyTorch implementations of modern open-source LLM architectures (Llama, Qwen, DeepSeek, Gemma, GPT-OSS, Kimi, and more) — written from scratch for readability and learning, based on Sebastian Raschka's LLM Architecture Gallery.

OpenArch grew +0.9% in the last 30 days, ranks 30th of 56 in Deep Learning Frameworks, last commit 52 days ago.

Star trajectory

66 days tracked
2026-09-16430 stars today2026-11-22
Momentum

+0.9% in 30d, above the Deep Learning Frameworks median of +0.1%.

Maintenance

Last commit 52 days ago, fresher than the median of 524.5d.

How it compares in Deep Learning Frameworks

OpenArch
430
stars
+0.9% 30d
commit 52 days ago
Deep Learning Frameworks median
498
stars
+0.1% 30d
commit ~524.5d ago
Leader · Speech
18.8k
stars
+0.9% 30d
commit today

Ranked 30th of 56 by stars.

Ranked by shared tags, then keywords, then stars
  1. From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's…

    +1 (+0.1%) in 30d · Committed 752d ago · Jupyter Notebook · MIT

    Shares Training Toolkits, Deep Learning Frameworks

  2. PyTorch implementation of some attentions for Deep Learning Researchers.

    +0 (+0.0%) in 30d · Committed 1,724d ago · Python · MIT

    Shares Deep Learning Frameworks, Training Toolkits

  3. GPU 性能与 AI Infra 学习项目:CUDA/Triton 算子、NCU/NSYS、vLLM/SGLang/TRT-LLM/ms-swift、PyTorch/DeepSpeed/ms-swift 训练、并行架构

    +2 (+1.6%) in 30d · Committed 75d ago · Python · Apache-2.0

    Shares Training Toolkits, Deep Learning Frameworks

  4. GleamLM大语言模型全栈训练平台——核心代码用 PyTorch 从零实现,最低仅需 12GB 消费级显卡即可完整训练,另有一套工业代码与手写实现消费同一份数据逐层对照。模型训练支持CLI和可视化训练。

    +1 (+1.5%) in 30d · Committed 65d ago · Python · Apache-2.0

    Shares Training Toolkits, Deep Learning Frameworks

  5. Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

    +2 (+0.2%) in 30d · Committed 531d ago · Python · Apache-2.0

    Shares Training Toolkits, Deep Learning Frameworks

  6. OpenChem: Deep Learning toolkit for Computational Chemistry and Drug Design Research

    +10 (+1.3%) in 30d · Committed 1,092d ago · Python · MIT

    Shares Deep Learning Frameworks, Training Toolkits

  7. PyTorch implementations of various Deep Reinforcement Learning (DRL) algorithms for both single agent and…

    +1 (+0.2%) in 30d · Committed 3,297d ago · Python · MIT

    Shares Training Toolkits, Deep Learning Frameworks

  8. DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatch (ICCV 2019)

    +0 (+0.0%) in 30d · Committed 2,269d ago · Python · Other license

    Shares Deep Learning Frameworks, Training Toolkits

  9. The purpose of this repository is to make prototypes as case study in the context of proof of concept(PoC) and…

    +0 (+0.0%) in 30d · Committed 1,062d ago · Python · GPL-2.0

    Shares Training Toolkits, Deep Learning Frameworks

  10. Minimal yet performant LLM examples in pure JAX

    +5 (+1.8%) in 30d · Committed 2d ago · Python · Apache-2.0

    Shares Training Toolkits, Deep Learning Frameworks

Language
Python
License
MIT License
Contributors
1
Forks
34
Watchers
3
Open issues
4
Releases
0
Created
2026-05-27
Stars this week
+2

You've seen where OpenArch stands today.

Get the moves before everyone else: the 5 Deep Learning Frameworks repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain OpenArch?

Claim this page to add your own call-to-action.

Claim this page