ai-infra-hpc
hpc 教程,包含集合通信(mpi、nccl)、cuda 编程、向量化 SIMD、RDMA 通信等
jinbooooom/ai-infra-hpc
View on GitHub ↗hpc 教程,包含集合通信(mpi、nccl)、cuda 编程、向量化 SIMD、RDMA 通信等
ai-infra-hpc grew +3.4% in the last 30 days, ranks 5th of 32 in GPU Kernels, last commit 209 days ago.
Star trajectory
66 days tracked+3.4% in 30d, above the GPU Kernels median of +0.8%.
Last commit 209 days ago, staler than the median of 7d.
How it compares in GPU Kernels
Ranked 5th of 32 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere ai-infra-hpc sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
GPT-2-style LLM built from scratch in C/CUDA with hand-written backprop, BPE tokenizer, FlashAttention…
+1 (+0.8%) in 30d · Committed 157d ago · Cuda · MIT
Shares Training Toolkits, GPU Kernels
GPU 性能与 AI Infra 学习项目:CUDA/Triton 算子、NCU/NSYS、vLLM/SGLang/TRT-LLM/ms-swift、PyTorch/DeepSpeed/ms-swift 训练、并行架构
+2 (+1.6%) in 30d · Committed 75d ago · Python · Apache-2.0
Shares Training Toolkits, GPU Kernels
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the…
-1 (-0.2%) in 30d · Committed 458d ago · Python · Apache-2.0
Shares Training Toolkits, Distributed Inference
Quantized LLM training in pure CUDA/C++.
+3 (+1.1%) in 30d · Committed 8d ago · C++ · Apache-2.0
Shares Training Toolkits, GPU Kernels
An Open Compiler Harness for Agentic GPU Programming
+49 (+30%) in 30d · Committed 4d ago · Rust · Apache-2.0
Shares GPU Kernels, Training Toolkits
- ifm-ai/xllm138
Light-weight infrastructure for express LLM pre-training
+21 (+18%) in 30d · Committed today · Python · Apache-2.0
Shares Training Toolkits, Distributed Inference
CUDA编程练习项目-Hands-on CUDA kernels and performance optimization, covering GEMM, FlashAttention, Tensor Cores…
-46 (-29%) in 30d · Committed 194d ago · Cuda · MIT
Shares Training Toolkits, GPU Kernels
Efficient Triton Kernels for LLM Training
+42 (+0.6%) in 30d · Committed today · Python · BSD-2-Clause
Shares GPU Kernels, Training Toolkits
🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
+55 (+5.3%) in 30d · Committed today · Python · Apache-2.0
Shares Training Toolkits, Distributed Inference
The most atomic way to train and inference a GPT in pure, dependency-free C
+5 (+0.6%) in 30d · Committed 96d ago · C · MIT
Shares GPU Kernels, Training Toolkits
- Language
- Cuda
- License
- MIT License
- Contributors
- 2
- Forks
- 74
- Watchers
- 7
- Open issues
- 0
- Releases
- 0
- Created
- 2024-07-23
- Stars this week
- +5
You've seen where ai-infra-hpc stands today.
Get the moves before everyone else: the 5 GPU Kernels repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.