TokenGate

Process all your context faster with LLMs that can skim and selectively read what matters

token-gate-llms/TokenGate

View on GitHub ↗

Process all your context faster with LLMs that can skim and selectively read what matters

TokenGate ranks 272nd of 343 in Inference Optimization, actively maintained, last commit 5 days ago.

Star trajectory

24 days tracked
2026-10-29118 stars today2026-11-22
Momentum

- in 30d, below the Inference Optimization median of +1.6%.

Maintenance

Last commit 5 days ago, fresher than the median of 16d.

How it compares in Inference Optimization

TokenGate
118
stars
- 30d
commit 5 days ago
Inference Optimization median
242
stars
+1.6% 30d
commit ~16d ago
Leader · supertonic
13.8k
stars
-0.1% 30d
commit 74 days ago

Ranked 272nd of 343 by stars.

Ranked by shared tags, then keywords, then stars
  1. Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI…

    +3 (+4.1%) in 30d · Committed 41d ago · Python · Apache-2.0

    Shares Inference Optimization, Fine-Tuning (LoRA / PEFT)

  2. Granite Switch — Build AI models like you build software

    +17 (+15%) in 30d · Committed 2d ago · Python · Apache-2.0

    Shares Inference Optimization, Fine-Tuning (LoRA / PEFT)

  3. Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi…

    -3 (-0.0%) in 30d · Committed 297d ago · Python · Apache-2.0

    Shares Inference Optimization, Fine-Tuning (LoRA / PEFT)

  4. SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by…

    +2 (+0.7%) in 30d · Committed 524d ago · Python · MIT

    Shares Inference Optimization, Fine-Tuning (LoRA / PEFT)

  5. Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…

    +962 (+243%) in 30d · Committed 3d ago · C++ · MIT

    Shares Inference Optimization

  6. The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with…

    +66 (+5.6%) in 30d · Committed 51d ago · Python · Apache-2.0

    Shares Inference Optimization

  7. Official Inference Code of EAGLE-4

    +334 (+38%) in 30d · Committed 8d ago · Python · Other license

    Shares Inference Optimization

  8. Library for faster pinned CPU <-> GPU transfer in Pytorch

    -1 (-0.1%) in 30d · Committed 2,465d ago · Python · MIT

    Shares Inference Optimization

  9. 🧱 Experimental library for building inference engines

    Committed today · Python · Apache-2.0

    Shares Inference Optimization

  10. A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with…

    +2 (+0.6%) in 30d · Committed 530d ago · Python · Apache-2.0

    Shares Inference Optimization

Language
Python
License
Apache License 2.0
Contributors
4
Forks
8
Watchers
0
Open issues
0
Releases
1
Created
2026-10-19
Stars this week
+1

You've seen where TokenGate stands today.

Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain TokenGate?

Claim this page to add your own call-to-action.

Claim this page