LLM Interpretability

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

57 papers in the last four weeks, up 73% on the four weeks before. 0.6% of all new papers.

Jul 13Week of Sep 28

Latest papers 546

All topics

DMDIntel: Interpreting Large Language Models via Dynamic Mode Decomposition
Aug 13, 2026Amogh Joshi, Animesh Mukherjee, Sergey UtyuzhnikovFeature Attribution LLM Interpretability
IIT Kharagpur, India · University of Manchester, UK
Perturbation-based Regional Interpretability through Subtraction Mapping (PRISM): naming-error dissociations in language models and post-stroke aphasia
Aug 13, 2026Xiang Guan, Roger D. Newman-Norlund, Yong Yang +8Transformer Interpretability LLM Interpretability
Department of Computer Science and Engineering, University of South Carolina · Department of Communication Sciences and Disorders, University of South Carolina · ALLT.AI, LLC, Columbia, SC +3
Locating and Controlling Implicit Personalization in Large Language Models
Aug 12, 2026Yueru Yan, Siqi Wu, Thai LeLLM Personalization LLM Interpretability
Indiana University Bloomington, USA
Localizing Safety Alignment: MLP Layers and Mid-Network Blocks Encode Refusal Behavior in Large Language Models
Aug 12, 2026Mingyu Zong, Sampad Mohanty, Bhaskar KrishnamachariLLM Alignment LLM Interpretability
Department of Computer Science University of Southern California Los Angeles, CA 90007
Conflict and Congruency Effects in Large Language Models: In-Weight and In-Context Competition in a Verbal Conflict Task
Aug 11, 2026Xiaoyang Hu, Mike Angstadt, Shane Storks +5Knowledge Conflicts in Language Models LLM Interpretability
Department of Computer Science, Brown University · Department of Psychiatry, University of Michigan · Weinberg Institute for Cognitive Science, University of Michigan +3
Beyond a Bag of Features: Set-Level Instability in Sparse Autoencoders
Aug 11, 2026Nikolai Bolik, Lennart Stöpler, Artur AndrzejakRepresentation Learning LLM Interpretability
Heidelberg University
From Interpretability to Control: Insights from Six Years of the TrustNLP Workshop
Aug 11, 2026Rahul Gupta, Abhinav Mohanty, Anaelia Ovalle +10LLM Interpretability LLM Safety Alignment
Amazon AGI · Meta · Autodesk +3
Chemically Meaningful Textualization Enables Explainable Validation of Metal-Organic Frameworks by Large Language Models
Aug 11, 2026Guobin Zhao, Xiao-Yan LiLLM Evaluation LLM Interpretability
Department of Chemistry, National University of Singapore, 3 Science Drive 3, Singapore 117543, Singapore
Interpreting Language Model Hidden States at Scale
Aug 10, 2026Jordan Pettyjohn, Mansi Sakarvadia, Nathaniel Hudson +3LLM Interpretability Mechanistic Interpretability
University of Chicago · 2Illinois Institute of Technology · 3Argonne National Laboratory +1
Decodable But Not Detachable: Training Data Granularity Determines Parametric Modularity in Large Language Models
Aug 10, 2026Marcus Armstrong, Navid Ayoobi, Arjun MukherjeeLLM Interpretability Circuits in Language Models
Department of Computer Science University of Houston Houston, TX 77204
Intrinsic Structure: Spectral Identifiability for Mechanistic Interpretability
Aug 10, 2026Ashim Dhor, Pin-Yu ChenRepresentation Identifiability Parameter Identifiability
1IISER Bhopal · 2IBM Research
Thinking vs. NoThinking: Towards Interpreting Reasoning Mechanisms of Large Language Models via Sparse Autoencoders
Aug 8, 2026Bo Cheng, Qiaolin Lu, Yi Chang +1LLM Interpretability CoT Reasoning
School of Artificial Intelligence, Jilin University · The Hong Kong Polytechnic University · School of Artificial Intelligence, Jilin University Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, MOE, China +1
When Is a Steerable Concept Representation Real? Measurement Confounds in a Cross-Family Audit of Neuroscience Parallels in LLMs
Aug 8, 2026Yuqi Wu, Shengming Zhao, Jie ChenLanguage Model Steering LLM Auditing
College of Biomedical Engineering, Fudan University
Accurate Ensembles, Fragile Narratives: Multi-Scale Stacking and a Fidelity Audit of LLM-Generated Explanations for Credit Risk
Aug 8, 2026Gregorius Reynaldi Pratama, Kuo-Kun TsengFeature Attribution Faithfulness of Language Model Explanations
School of Computer Science and Technology Harbin Institute of Technology, Shenzhen Shenzhen, China
Measuring Concept Content in Text from LLM Activations: ESG Evidence from Concept Vectors and Linear Probes
Aug 7, 2026Luc Hazenoot, Zhaochun Ren, Amirhossein ZohrehvandLinear Probing LLM Interpretability
Leiden Institute of Advanced Computer Science, Leiden University
Finding Usable Weight Mechanisms with Tiled SVD
Aug 7, 2026Ash Manvi, Samreena TajreenLLM Interpretability Mechanistic Interpretability
Aquin Labs
From Behavior to Mechanism: Tracing Divergent Response Modes in Frontier Language Models
Aug 6, 2026Ali Jalal-KamaliLanguage Model Steering LLM Interpretability
USC Institute for Creative Technologies
Reasoning Errors Have a Region and a Direction in the Residual-Stream Trajectory of LLMs
Aug 6, 2026Hamed Damirchi, Ignacio Meza De la Jara, Damith Ranasinghe +2Language Model Error Detection LLM Interpretability
Australian Institute for Machine Learning · Adelaide University · Naval Group Pacific +1
Scaling Inherently Interpretable Language Models
Aug 6, 2026Guide Labs Team, Andreas Madsen, Aya Abdelsalam Ismail +7Language Model Steering LLM Interpretability
Guide Labs Team
Recovering Lesion Parameters from Aphasic Picture Naming Error Profiles in Large Language Models
Aug 5, 2026Yong Yang, Roger Newman-Norlund, Xiang Guan +10LLM Interpretability Causal Interventions in Language Models
Department of Computer Science and Engineering, University of South Carolina · Department of Communication Sciences and Disorders, University of South Carolina · ALLT.AI, LLC +3
Sensitivity, Causality, and Repair Dissociate: A Layer-Wise Analysis of Perturbation Robustness and Its Scaling
Aug 4, 2026Nathan Labiosa, David Buff, Ena Nayak +1LLM Interpretability Adversarial Robustness of Language Models
University of Southern California
Attention is Case-Sensitive
Aug 4, 2026Maximilian Dillitzer, Tin Stribor Sohn, Jason J. Corso +1LLM Interpretability VLM Interpretability
University of Applied Science Esslingen · Dr. Ing. h.c. F. Porsche AG · Karlsruhe Institute of Technology +1
Activation-Guided Neuron Intervention to Induce Alzheimer's-Related Computational Language Phenotypes in a Large Language Model
Aug 4, 2026Rui He, Ercong Nie, Hong Jiang +3Alzheimer's Disease LLM Interpretability
Grammar and Cognition Lab, Department of Translation & Language Sciences, Universitat Pompeu Fabra, Barcelona, Spain. · School of Foreign Languages, Shanghai Jiao Tong University, Shanghai, China. · Zhuhai People’s Hospital (The Affiliated Hospital of Beijing Institute of Technology, Zhuhai Clinical Medical College of Jinan University), Zhuhai, China. +4
Interpreting Black-Box Large Language Models with Sentence-Level Energy Landscapes
Aug 3, 2026Maryam Rezaee, Pooriya Safaei, Maryam Asgarinezhad +1Surrogate Modeling LLM Interpretability
Department of Mathematical Sciences, Sharif University of Technology, Tehran, Iran
GradCuit: Credit-Assigned Gradient Flow Enables Robust and Interpretable Test-Time Latent Reasoning
Aug 3, 2026Zhaoxin Yu, Qi Shen, Hengli Li +4Test-Time Optimization LLM Interpretability
NLCo Lab, Beijing Institute for General Artificial Intelligence · School of Artificial Intelligence, Beijing University of Posts and Telecommunications · School of Artificial Intelligence for Science, Peking University
Cultural Awareness is Represented but Not Decoded: Tracing Mythological Knowledge across 18 Open-Source LLMs
Aug 3, 2026Iaroslav Chelombitko, Ekaterina Chelombitko, Mika HämäläinenMultilingual Language Models LLM Interpretability
1DataSpike · 2Metropolia University of Applied Sciences, Helsinki, Finland · 3Neapolis University Pafos, Paphos, Cyprus
How Much Does a Reasoning Summary Reveal? An Observability Ladder for Large Language Models
Aug 3, 2026Andres Algaba, Francesca Carlon, Lynn Delcon +3LLM Evaluation LLM Interpretability
1Data Analytics Lab, Vrije Universiteit Brussel, Pleinlaan 5, 1050 Brussel, Belgium · 2imec-SMIT, Vrije Universiteit Brussel, Pleinlaan 9, 1050 Brussel, Belgium · School of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts 02138, USA
A Few Neurons Reveal When LLMs Misuse Tools: Sparse Detection and Selective Steering for Reliable Tool Use
Jul 31, 2026Yutong Ke, Ming Yin, Chongwen Zhao +1LLM Interpretability LLM Tool Use
Token-Level Diagnosis of Sycophancy in LLMs with Attribution-Guided Steering
Jul 31, 2026Hieu Nguyen, Mahammed Kamruzzaman, Anshuman Chhabra +1LLM Sycophancy LLM Interpretability
Bellini College of AI, Cybersecurity and Computing University of South Florida
Metaphor Tracer: A Theory-Informed Analysis of Hidden States
Jul 30, 2026Marc Heimann, Roxana Assadi Moghaddam, Olga Brovkina +2LLM Interpretability Representation Geometry in Language Models
Hermeneutic AI

Aug 13, 2026, cs.AIJ/K move · Enter open · S save

DMDIntel: Interpreting Large Language Models via Dynamic Mode Decomposition

Amogh Joshi, Animesh Mukherjee, Sergey Utyuzhnikov

IIT Kharagpur, India · University of Manchester, UK

Feature Attribution LLM Interpretability

Open paper AskPDF arXiv

In this work, we introduce DMDIntel which uses dynamic mode decomposition (DMD) to make the predictions made by LLMs in a classification task interpretable. It develops an input attribution pipeline, that first decomposes the hidden states of an LLM into prominent patterns, also known as modes, and then associates ranks to the input tokens based on the projection values on those modes. Rigorous experiments across three datasets and three model families consistently show that the ranked attribution of input tokens obtained using DMDIntel by far outperforms state-of-the-art techniques such as principal component analysis, integrated gradients and SHAP.

Momentum

Related topics

Latest papers 546