tensai
A tiny neural-network framework in pure Go with AVX2 SIMD kernels (GOEXPERIMENT=simd)
mattn/tensai
View on GitHub ↗A tiny neural-network framework in pure Go with AVX2 SIMD kernels (GOEXPERIMENT=simd)
tensai grew +4.3% in the last 30 days, ranks 448th of 539 in Local Runtime / Inference Engine, last commit 16 days ago.
Star trajectory
82 days tracked+4.3% in 30d, above the Local Runtime / Inference Engine median of +1.9%.
Last commit 16 days ago, staler than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 448th of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere tensai sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS…
+3.4k (+37%) in 30d · Committed 5d ago · C · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization
2bit quants, kernels and runtime for consumer devices.
Committed 16d ago · C++ · Other license
Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization
- syv-ai/HyperQwen2.8k
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127…
+592 (+27%) in 30d · Committed 12d ago · Python · Apache-2.0
Shares Inference Optimization, Local Runtime / Inference Engine, Model Optimization
- RWKV/rwkv.cpp1.6k
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
+1 (+0.1%) in 30d · Committed 609d ago · C++ · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization
Suno AI's Bark model in C/C++ for fast text-to-speech generation
+0 (+0.0%) in 30d · Committed 735d ago · C++ · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization
RDNA-native LLM inference engine in Rust.
+95 (+13%) in 30d · Committed today · Rust · Other license
Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
+25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0
Shares Inference Optimization, Local Runtime / Inference Engine, Model Optimization
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM…
+8 (+1.5%) in 30d · Committed 10d ago · C++ · Other license
Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization
An innovative library for efficient LLM inference via low-bit quantization
+0 (+0.0%) in 30d · Committed 813d ago · C++ · Apache-2.0
Shares Inference Optimization, Model Optimization, Local Runtime / Inference Engine
PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving…
+3 (+0.9%) in 30d · Committed 19d ago · Rust · Other license
Shares Local Runtime / Inference Engine, Model Optimization, Inference Optimization
- Language
- Go
- License
- MIT License
- Contributors
- 2
- Forks
- 6
- Watchers
- 2
- Open issues
- 0
- Releases
- 34
- Created
- 2026-08-19
- Stars this week
- +0
You've seen where tensai stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.