paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
intentee/paddler
View on GitHub ↗Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
paddler grew +0.3% in the last 30 days, ranks 65th of 310 in Observability & Tracing, actively maintained, last commit today.
Star trajectory
123 days tracked+0.3% in 30d, below the Observability & Tracing median of +1.0%.
Last commit today, fresher than the median of 5d.
How it compares in Observability & Tracing
Ranked 65th of 310 by stars.
- Language
- Rust
- License
- Apache License 2.0
- Contributors
- 13
- Forks
- 97
- Watchers
- 13
- Open issues
- 26
- Releases
- 26
- Created
- 2024-04-27
- Stars this week
- +3
You've seen where paddler stands today.
Get the moves before everyone else: the 5 Observability & Tracing repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.