TensorSharp

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

zhongkaifu/TensorSharp

View on GitHub ↗

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

TensorSharp ranks 201st of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.

Star trajectory

22 days tracked
2026-10-31681 stars today2026-11-22
Momentum

- in 30d, below the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit today, fresher than the median of 6d.

How it compares in Local Runtime / Inference Engine

TensorSharp
681
stars
- 30d
commit today
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 201st of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. The local AI app built for the Mac. Run LLMs like Qwen, Gemma and GPT-OSS on Apple Silicon, including models…

    +17 (+28%) in 30d · Committed today · Swift · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime, Agent Frontends / Chat UI, Production Serving & Deployment

  2. Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over…

    +10 (+1.8%) in 30d · Committed yesterday · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization, Web / Edge / On-Device Runtime

  3. True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference…

    +20 (+9.7%) in 30d · Committed yesterday · Kotlin · Other license

    Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Language Bindings, Inference Optimization

  4. NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

    +83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2

    Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization, Language Bindings

  5. 2bit quants, kernels and runtime for consumer devices.

    Committed 16d ago · C++ · Other license

    Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization, Language Bindings

  6. A programmable system for high-performance model serving

    Committed today · Rust · Apache-2.0

    Shares Production Serving & Deployment, Local Runtime / Inference Engine, Inference Optimization, Language Bindings

  7. ⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.

    +0 (+0.0%) in 30d · Committed 896d ago · Python · Apache-2.0

    Shares Production Serving & Deployment, Inference Optimization, Local Runtime / Inference Engine, Web / Edge / On-Device Runtime

  8. The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ…

    +39 (+45%) in 30d · Committed today · C++ · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization, Agent Frontends / Chat UI

  9. A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX…

    +227 (+2.8%) in 30d · Committed yesterday · Python · MIT

    Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization, Production Serving & Deployment

  10. a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…

    +34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment, Language Bindings

Language
C#
License
BSD 3-Clause "New" or "Revised" License
Contributors
14
Forks
74
Watchers
5
Open issues
5
Releases
6
Created
2026-04-03
Stars this week
+3

You've seen where TensorSharp stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain TensorSharp?

Claim this page to add your own call-to-action.

Claim this page