TokenGate
Process all your context faster with LLMs that can skim and selectively read what matters
token-gate-llms/TokenGate
View on GitHub ↗Process all your context faster with LLMs that can skim and selectively read what matters
TokenGate ranks 272nd of 343 in Inference Optimization, actively maintained, last commit 5 days ago.
Star trajectory
24 days tracked- in 30d, below the Inference Optimization median of +1.6%.
Last commit 5 days ago, fresher than the median of 16d.
How it compares in Inference Optimization
Ranked 272nd of 343 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere TokenGate sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI…
+3 (+4.1%) in 30d · Committed 41d ago · Python · Apache-2.0
Shares Inference Optimization, Fine-Tuning (LoRA / PEFT)
Granite Switch — Build AI models like you build software
+17 (+15%) in 30d · Committed 2d ago · Python · Apache-2.0
Shares Inference Optimization, Fine-Tuning (LoRA / PEFT)
- intel/ipex-llm8.8k
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi…
-3 (-0.0%) in 30d · Committed 297d ago · Python · Apache-2.0
Shares Inference Optimization, Fine-Tuning (LoRA / PEFT)
SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by…
+2 (+0.7%) in 30d · Committed 524d ago · Python · MIT
Shares Inference Optimization, Fine-Tuning (LoRA / PEFT)
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…
+962 (+243%) in 30d · Committed 3d ago · C++ · MIT
Shares Inference Optimization
The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with…
+66 (+5.6%) in 30d · Committed 51d ago · Python · Apache-2.0
Shares Inference Optimization
- eagle-hq/EAGLE-41.2k
Official Inference Code of EAGLE-4
+334 (+38%) in 30d · Committed 8d ago · Python · Other license
Shares Inference Optimization
Library for faster pinned CPU <-> GPU transfer in Pytorch
-1 (-0.1%) in 30d · Committed 2,465d ago · Python · MIT
Shares Inference Optimization
🧱 Experimental library for building inference engines
Committed today · Python · Apache-2.0
Shares Inference Optimization
A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with…
+2 (+0.6%) in 30d · Committed 530d ago · Python · Apache-2.0
Shares Inference Optimization
- Language
- Python
- License
- Apache License 2.0
- Contributors
- 4
- Forks
- 8
- Watchers
- 0
- Open issues
- 0
- Releases
- 1
- Created
- 2026-10-19
- Stars this week
- +1
You've seen where TokenGate stands today.
Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.