LLMRepos·Language Bindings LLM projects

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3

The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol

The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

The official Python SDK for Model Context Protocol servers and clients

Structured Outputs

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages

The official TypeScript SDK for Model Context Protocol servers and clients

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

Official inference library for Mistral models

Python bindings for llama.cpp

A fast inference library for running LLMs locally on modern consumer-class GPUs

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

Python package for easily interfacing with chat apps, with robust features and minimal code complexity.

Fast ML inference & training for ONNX models in Rust

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Python bindings for the Transformer models implemented in C/C++ using GGML library.

Nomic Developer API SDK

Agent-native flight & hotel search and booking — MCP server, CLI, and Python/JS SDKs. Hundreds of airlines plus the major booking sites, with per-flight reliability history. Free-cancellation hotel rates: hold the room with a small upfront charge, then pay the balance later by link, up to the hotel's own deadline.

OpenAI API client for Kotlin with multiplatform and coroutines capabilities.

LM Studio TypeScript SDK

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks

🚀Apache RocketMQ build in Rust🦀. Faster, safer, and with lower memory usage. ⭐ Star to support our work❤️!

Python SDK for Milvus Vector Database

[Acquired by The Guild] The Grafbase GraphQL Federation Gateway

A fast llama2 decoder in pure Rust.

The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry leaders, 100% pass rate on 3,830 PDFs. MIT/Apache-2.0.

MindSpore + 🤗Huggingface: Run any Transformers/Diffusers model on MindSpore with seamless compatibility and acceleration.

LM Studio Python SDK

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

Go SDK for Google Generative AI

Simple, modular, and observable Go framework for backend applications.

🎤 Lobe TTS - A high-quality & reliable TTS/STT library for Server and Browser

A modular Swift SDK for audio processing with MLX on Apple Silicon

Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.

MIT-licensed, COM-free .NET libraries for creating, reading, editing, converting, rendering, and extracting Office, PDF, email, OneNote, and text formats.

MCP server SDK/example implemented entirely in bash — build a Model Context Protocol server with no runtime dependency beyond a POSIX shell.

An SDK building Laravel MCP servers

JavaScript/Typescript SDK for Qdrant Vector Database

🪢 Langfuse Python SDK - Instrument your LLM app with decorators or low-level SDK and get detailed tracing/observability. Works with any LLM or framework