xllm

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

jd-opensource/xllm

View on GitHub ↗

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

xllm grew +1.6% in the last 30 days, ranks 107th of 490 in Local Runtime / Inference Engine, actively maintained, last commit today.

Star trajectory

123 days tracked
2026-06-211.6k stars today2026-10-23
Momentum

+1.6% in 30d, below the Local Runtime / Inference Engine median of +1.7%.

Maintenance

Last commit today, fresher than the median of 5.5d.

How it compares in Local Runtime / Inference Engine

xllm
1.6k
stars
+1.6% 30d
commit today
Local Runtime / Inference Engine median
414.5
stars
+1.7% 30d
commit ~5.5d ago
Leader · ollama
184.4k
stars
+1.6% 30d
commit today

Ranked 107th of 490 by stars.

Language
C++
License
Apache License 2.0
Contributors
106
Forks
315
Watchers
20
Open issues
84
Releases
11
Created
2025-08-12
Stars this week
+3

You've seen where xllm stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain xllm?

Claim this page to add your own call-to-action.

Claim this page