One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
LLMRepos·Interpretability & Alignment LLM projects
Updated dailyBrowse 53 open-source interpretability & alignment projects in Model Development. Compare GitHub stars, recent growth, languages, licenses, and repository activity.
Interpretability & Alignment
Browse 53 open-source interpretability & alignment projects in Model Development. Compare GitHub stars, recent growth, languages, licenses, and repository activity.
Top Interpretability & Alignment repositories
Ranked by current GitHub stars from the latest LLMRepos snapshot.
Showing 40 of 53
A JAX research toolkit for building, editing, and visualizing neural networks.
Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
Research of DeepSeek Engram Architecture based on Qwen-3 and Stable Diffusion series.
Observe how memory shapes an answer. Pensieve is an interactive system for visualizing, interpreting, and managing how Large Language Models (LLMs) “remember” a user. It bridges the gap between model-level mechanisms and user-level understanding, making AI memory observable, explainable, and partially controllable.
[ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the diverse strengths of multiple open-source LLMs. LLM-Blender cut the weaknesses through ranking and integrate the strengths through fusing generation to enhance the capability of LLMs.
Official Implementation for "Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models" (SIGGRAPH 2023)
[ICML 2026 & EMNLP 2026] Multimodal deep-research MLLM and benchmark. The first long-horizon multimodal deep-research MLLM, extending the number of reasoning turns to dozens and the number of search-engine interactions to hundreds.
Official implementation for "Blended Diffusion for Text-driven Editing of Natural Images" [CVPR 2022]
Underexposed Photo Enhancement Using Deep Illumination Estimation
A flexible, adaptive classification system for dynamic text classification
Named Entity Recognition using multilayered bidirectional LSTM
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Safety Workshop 2022
MS-Loss: Multi-Similarity Loss for Deep Metric Learning
A Python toolbox for conformal prediction research on deep learning models, using PyTorch.
Graph convolutional neural network for multirelational link prediction
EvaLearn is a pioneering benchmark designed to evaluate large language models (LLMs) on their learning capability and efficiency in challenging tasks.
A PyTorch implementation of ACM SIGKDD 2019 paper "Predicting Dynamic Embedding Trajectory in Temporal Interaction Networks"
(NeurIPS 2022) On Embeddings for Numerical Features in Tabular Deep Learning
Advanced Quantitative Factor Research: ML-powered stock return prediction with 72% performance improvement. Features comprehensive alpha factor library, systematic feature selection, and deep learning models (LSTM+ResNet achieving IC=0.06476).
Backdoors Framework for Deep Learning and Federated Learning. A light-weight tool to conduct your research on backdoors.
We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20 via OpenAI’s APIs.
Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs
End-to-end training of sparse deep neural networks with little-to-no performance loss.
The purpose of this repository is to make prototypes as case study in the context of proof of concept(PoC) and research and development(R&D) that I have written in my website. The main research topics are Auto-Encoders in relation to the representation learning, the statistical machine learning for energy-based models, adversarial generation networks(GANs), Deep Reinforcement Learning such as Deep Q-Networks, semi-supervised learning, and neural network language model for natural language processing.
[NeurIPS 2025] BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Models
Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs (ACL 2024)
TrojanZoo provides a universal pytorch platform to conduct security researches (especially backdoor attacks/defenses) of image classification in deep learning.
Deep Research
[USENIX Security 2025] PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models
Code and data for the research paper "Towards Open Set Deep Networks" A Bendale, T Boult, CVPR 2016
This is the repo of the research paper, "Evaluating Shallow and Deep Neural Networks for Network Intrusion Detection Systems in Cyber Security".
Embodied Agent Interface (EAI): Benchmarking LLMs for Embodied Decision Making (NeurIPS D&B 2024 Oral)
CORAL and CORN implementations for ordinal regression with deep neural networks.
Benchmarking LLMs via Uncertainty Quantification
RuLES: a benchmark for evaluating rule-following in language models
I replicated Ng's RYS method and found that duplicating 3 specific layers in Qwen2.5-32B boosts reasoning by 17% and duplicating layers 12-14 in Devstral-24B improves logical deduction from 0.22→0.76 on BBH — no training, no weight changes, just routing hidden states through the same circuit twice. Tools included. Two AMD GPUs, one evening.
Data Synthesis for Deep Research Based on Semi-Structured Data
Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
Deep neural network kernel for Gaussian process