llama-kotlin
Run LLMs fully on-device on Android: a coroutine-first Kotlin API over llama.cpp (JNI, Flow streaming, cancellation).
ThalzeronLabs/llama-kotlin
View on GitHub ↗Run LLMs fully on-device on Android: a coroutine-first Kotlin API over llama.cpp (JNI, Flow streaming, cancellation).
llama-kotlin ranks 177th of 177 in Web / Edge / On-Device Runtime, actively maintained, last commit 5 days ago.
Star trajectory
15 days tracked- in 30d, below the Web / Edge / On-Device Runtime median of +1.8%.
Last commit 5 days ago, fresher than the median of 6d.
How it compares in Web / Edge / On-Device Runtime
Ranked 177th of 177 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere llama-kotlin sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
+83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2
Shares Web / Edge / On-Device Runtime, Language Bindings
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console…
Committed today · C# · BSD-3-Clause
Shares Web / Edge / On-Device Runtime, Language Bindings
True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference…
+20 (+9.7%) in 30d · Committed yesterday · Kotlin · Other license
Shares Web / Edge / On-Device Runtime, Language Bindings
Swift package to run local LLMs on iOS, macOS, Linux
+0 (+0.0%) in 30d · Committed 87d ago · Swift · MIT
Shares Web / Edge / On-Device Runtime, Language Bindings
TalaDB - An open-source embedded vector and document database for building local-first AI applications.
Committed yesterday · Rust · Apache-2.0
Shares Web / Edge / On-Device Runtime, Language Bindings
2bit quants, kernels and runtime for consumer devices.
Committed 16d ago · C++ · Other license
Shares Web / Edge / On-Device Runtime, Language Bindings
A modular Swift SDK for audio processing with MLX on Apple Silicon
+20 (+2.5%) in 30d · Committed yesterday · Swift · MIT
Shares Web / Edge / On-Device Runtime, Language Bindings
React Native Apple LLM plugin using Foundation Models
+0 (+0.0%) in 30d · Committed 308d ago · Swift · MIT
Shares Web / Edge / On-Device Runtime, Language Bindings
Swift SDK for running chat, vision and speech models on iPhone and Mac with Apple's Core AI. Model download…
+7 (+5.8%) in 30d · Committed 6d ago · Swift · BSD-3-Clause
Shares Web / Edge / On-Device Runtime, Language Bindings
On-device voice models and SDK: voice isolation, wake words, voice activity and voiceprints. In the browser…
Committed today · Rust · Apache-2.0
Shares Web / Edge / On-Device Runtime, Language Bindings
- Language
- Kotlin
- License
- Apache License 2.0
- Contributors
- 1
- Forks
- 0
- Watchers
- 0
- Open issues
- 5
- Releases
- 6
- Created
- 2026-10-31
- Stars this week
- +0
You've seen where llama-kotlin stands today.
Get the moves before everyone else: the 5 Web / Edge / On-Device Runtime repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.