TensorSharp
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability
zhongkaifu/TensorSharp
View on GitHub ↗A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability
TensorSharp ranks 201st of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.
Star trajectory
22 days tracked- in 30d, below the Local Runtime / Inference Engine median of +1.9%.
Last commit today, fresher than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 201st of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere TensorSharp sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
The local AI app built for the Mac. Run LLMs like Qwen, Gemma and GPT-OSS on Apple Silicon, including models…
+17 (+28%) in 30d · Committed today · Swift · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime, Agent Frontends / Chat UI, Production Serving & Deployment
Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over…
+10 (+1.8%) in 30d · Committed yesterday · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization, Web / Edge / On-Device Runtime
True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference…
+20 (+9.7%) in 30d · Committed yesterday · Kotlin · Other license
Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Language Bindings, Inference Optimization
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
+83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2
Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization, Language Bindings
2bit quants, kernels and runtime for consumer devices.
Committed 16d ago · C++ · Other license
Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization, Language Bindings
A programmable system for high-performance model serving
Committed today · Rust · Apache-2.0
Shares Production Serving & Deployment, Local Runtime / Inference Engine, Inference Optimization, Language Bindings
⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.
+0 (+0.0%) in 30d · Committed 896d ago · Python · Apache-2.0
Shares Production Serving & Deployment, Inference Optimization, Local Runtime / Inference Engine, Web / Edge / On-Device Runtime
The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ…
+39 (+45%) in 30d · Committed today · C++ · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization, Agent Frontends / Chat UI
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX…
+227 (+2.8%) in 30d · Committed yesterday · Python · MIT
Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization, Production Serving & Deployment
a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…
+34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment, Language Bindings
- Language
- C#
- License
- BSD 3-Clause "New" or "Revised" License
- Contributors
- 14
- Forks
- 74
- Watchers
- 5
- Open issues
- 5
- Releases
- 6
- Created
- 2026-04-03
- Stars this week
- +3
You've seen where TensorSharp stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.