mojo-dllm

Local inference for diffusion language models (LLaDA, Dream), written in Mojo

dllm-labs/mojo-dllm

View on GitHub ↗

Local inference for diffusion language models (LLaDA, Dream), written in Mojo

mojo-dllm ranks 227th of 539 in Local Runtime / Inference Engine, actively maintained, last commit yesterday.

Star trajectory

21 days tracked
2026-11-01548 stars today2026-11-22
Momentum

- in 30d, below the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit yesterday, fresher than the median of 6d.

How it compares in Local Runtime / Inference Engine

mojo-dllm
548
stars
- 30d
commit yesterday
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 227th of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

    +97 (+4.9%) in 30d · Committed today · C++ · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization

  2. Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…

    +962 (+243%) in 30d · Committed 3d ago · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  3. The open-source AI engine for AMD Strix Halo. Text, embeddings, speech, image and video models in one binary…

    +360 (+41%) in 30d · Committed today · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  4. 37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs…

    +280 (+61%) in 30d · Committed yesterday · C · GPL-3.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  5. a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…

    +34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  6. CPU inference for the DeepSeek family of large language models in C++

    +2 (+0.6%) in 30d · Committed 415d ago · C++ · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization

  7. WeeLLM runs large diffusion models with as little as 4 GB of VRAM, without any quantization. It dynamically…

    +42 (+36%) in 30d · Committed 13d ago · Python

    Shares Local Runtime / Inference Engine, Inference Optimization

  8. LLM inference engine written from scratch in HIP for AMD Strix Halo (gfx1151) and Qwen3.8-Flash-Next - ~50…

    Committed 5d ago · C++ · AGPL-3.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  9. Get more intelligence from every bit. Better quantization formats and smarter calibration let larger, stronger…

    +9 (+10%) in 30d · Committed 16d ago · C++ · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine

  10. Native Windows vLLM 0.33.0 (Python 3.13/CUDA 13.0), plus a Python 3.14/CUDA 13.2 build; older versions on the…

    +5 (+7.9%) in 30d · Committed 2d ago · Python · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

Language
Python
License
Apache License 2.0
Contributors
8
Forks
9
Watchers
1
Open issues
91
Releases
2
Created
2026-10-04
Stars this week
+7

You've seen where mojo-dllm stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain mojo-dllm?

Claim this page to add your own call-to-action.

Claim this page