mini-verl
verl for a single consumer GPU. PPO, GRPO and on-policy distillation on NVIDIA GPUs.
DaoyuanLi2816/mini-verl
View on GitHub ↗verl for a single consumer GPU. PPO, GRPO and on-policy distillation on NVIDIA GPUs.
mini-verl grew +2.0% in the last 30 days, ranks 190th of 370 in Training Toolkits, last commit 68 days ago.
Star trajectory
82 days tracked+2.0% in 30d, above the Training Toolkits median of +0.3%.
Last commit 68 days ago, fresher than the median of 199.5d.
How it compares in Training Toolkits
Ranked 190th of 370 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere mini-verl sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Halo is an open-source framework built by White Circle for training large language and multimodal models
+34 (+4.1%) in 30d · Committed today · Python · Other license
Shares Training Toolkits, Fine-Tuning (LoRA / PEFT), Reinforcement Learning / RLHF
- uclaml/SPPO590
The official implementation of Self-Play Preference Optimization (SPPO)
+1 (+0.2%) in 30d · Committed 668d ago · Python · Apache-2.0
Shares Reinforcement Learning / RLHF, Fine-Tuning (LoRA / PEFT), Training Toolkits
LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)
+0 (+0.0%) in 30d · Committed 1,137d ago · Python
Shares Training Toolkits, Reinforcement Learning / RLHF, Fine-Tuning (LoRA / PEFT)
[NeurIPS 2025] Flow x RL. "ReinFlow: Fine-tuning Flow Policy with Online Reinforcement Learning". Support VLAs…
+7 (+1.9%) in 30d · Committed 211d ago · Python · MIT
Shares Fine-Tuning (LoRA / PEFT), Reinforcement Learning / RLHF, Training Toolkits
Developer Hub for NVIDIA Alpamayo, containing ready-to-use recipes for fine-tuning, reinforcement-learning…
+30 (+14%) in 30d · Committed 11d ago · Python · Apache-2.0
Shares Fine-Tuning (LoRA / PEFT), Training Toolkits, Reinforcement Learning / RLHF
A framework for agentic tool use training with reinforcement learning
+1 (+0.5%) in 30d · Committed 228d ago · Python
Shares Reinforcement Learning / RLHF, Fine-Tuning (LoRA / PEFT), Training Toolkits
chatglm-6b微调/LORA/PPO/推理, 样本为自动生成的整数/小数加减乘除运算, 可gpu/cpu
+0 (+0.0%) in 30d · Committed 1,185d ago · Python · Apache-2.0
Shares Fine-Tuning (LoRA / PEFT), Training Toolkits, Reinforcement Learning / RLHF
An algorithm-focused interface for common llm training, continual learning, and reinforcement learning…
+3 (+2.9%) in 30d · Committed 9d ago · Python · Apache-2.0
Shares Fine-Tuning (LoRA / PEFT), Training Toolkits, Reinforcement Learning / RLHF
A Mac-local specialist-model factory for data, post-training, evaluation, packaging, and evidence-backed…
+0 (+0.0%) in 30d · Committed yesterday · Swift · MIT
Shares Training Toolkits, Fine-Tuning (LoRA / PEFT), Reinforcement Learning / RLHF
From-scratch PyTorch replications of classic and SOTA AI/ML papers: transformers, attention, GANs, diffusion…
Committed 17d ago · Jupyter Notebook · Apache-2.0
Shares Training Toolkits, Fine-Tuning (LoRA / PEFT), Reinforcement Learning / RLHF
- Language
- Python
- License
- Apache License 2.0
- Contributors
- 1
- Forks
- 75
- Watchers
- 53
- Open issues
- 1
- Releases
- 28
- Created
- 2026-07-27
- Stars this week
- +2
You've seen where mini-verl stands today.
Get the moves before everyone else: the 5 Training Toolkits repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.