llama-kotlin

Run LLMs fully on-device on Android: a coroutine-first Kotlin API over llama.cpp (JNI, Flow streaming, cancellation).

ThalzeronLabs/llama-kotlin

View on GitHub ↗

Run LLMs fully on-device on Android: a coroutine-first Kotlin API over llama.cpp (JNI, Flow streaming, cancellation).

llama-kotlin ranks 177th of 177 in Web / Edge / On-Device Runtime, actively maintained, last commit 5 days ago.

Star trajectory

15 days tracked
2026-11-070 stars today2026-11-22
Momentum

- in 30d, below the Web / Edge / On-Device Runtime median of +1.8%.

Maintenance

Last commit 5 days ago, fresher than the median of 6d.

How it compares in Web / Edge / On-Device Runtime

llama-kotlin
0
stars
- 30d
commit 5 days ago
Web / Edge / On-Device Runtime median
311
stars
+1.8% 30d
commit ~6d ago
Leader · mlc-llm
23.4k
stars
+0.8% 30d
commit today

Ranked 177th of 177 by stars.

Ranked by shared tags, then keywords, then stars
  1. NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

    +83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2

    Shares Web / Edge / On-Device Runtime, Language Bindings

  2. A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console…

    Committed today · C# · BSD-3-Clause

    Shares Web / Edge / On-Device Runtime, Language Bindings

  3. True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference…

    +20 (+9.7%) in 30d · Committed yesterday · Kotlin · Other license

    Shares Web / Edge / On-Device Runtime, Language Bindings

  4. Swift package to run local LLMs on iOS, macOS, Linux

    +0 (+0.0%) in 30d · Committed 87d ago · Swift · MIT

    Shares Web / Edge / On-Device Runtime, Language Bindings

  5. TalaDB - An open-source embedded vector and document database for building local-first AI applications.

    Committed yesterday · Rust · Apache-2.0

    Shares Web / Edge / On-Device Runtime, Language Bindings

  6. 2bit quants, kernels and runtime for consumer devices.

    Committed 16d ago · C++ · Other license

    Shares Web / Edge / On-Device Runtime, Language Bindings

  7. A modular Swift SDK for audio processing with MLX on Apple Silicon

    +20 (+2.5%) in 30d · Committed yesterday · Swift · MIT

    Shares Web / Edge / On-Device Runtime, Language Bindings

  8. React Native Apple LLM plugin using Foundation Models

    +0 (+0.0%) in 30d · Committed 308d ago · Swift · MIT

    Shares Web / Edge / On-Device Runtime, Language Bindings

  9. Swift SDK for running chat, vision and speech models on iPhone and Mac with Apple's Core AI. Model download…

    +7 (+5.8%) in 30d · Committed 6d ago · Swift · BSD-3-Clause

    Shares Web / Edge / On-Device Runtime, Language Bindings

  10. On-device voice models and SDK: voice isolation, wake words, voice activity and voiceprints. In the browser…

    Committed today · Rust · Apache-2.0

    Shares Web / Edge / On-Device Runtime, Language Bindings

Language
Kotlin
License
Apache License 2.0
Contributors
1
Forks
0
Watchers
0
Open issues
5
Releases
6
Created
2026-10-31
Stars this week
+0

You've seen where llama-kotlin stands today.

Get the moves before everyone else: the 5 Web / Edge / On-Device Runtime repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain llama-kotlin?

Claim this page to add your own call-to-action.

Claim this page