LLM Interpretability

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

57 papers in the last four weeks, up 73% on the four weeks before. 0.6% of all new papers.

Jul 13Week of Sep 28

Latest papers 546

All topics

SearchAtlas: Analyzing Agentic Search Strategies via Evidential Query Graphs
Sep 11, 2026Jiacheng Sang, Mengyuan Li, Sanxing Chen +3Agentic Search LLM Interpretability
Duke University · University of Pennsylvania
Distribution-aware Language Neuron Identification in Multilingual Large Language Models
Sep 11, 2026Minjun Kim, Inho Won, Junghun Yuk +3Multilingual Language Models LLM Interpretability
KAIST · KAIST InnoCORE PRISM-AI Center
TEFM: Token-Efficient Faithful Modeling for Structured Data
Sep 9, 2026Zhichao Hou, Lingdao Sha, Xueyu Mao +3LLM Interpretability Tabular Classification
North Carolina State University · Amazon Web Services
Do Reasoning Representations Help Humans Evaluate LLM Outputs?
Sep 8, 2026Jaewoo Lim, Sungbok Shin, Sanghyun HongLLM Evaluation LLM Interpretability
Oregon State University, Corvallis USA · Sogang University, Seoul, South Korea
Vision: Data-Centric Anchoring for Robust and Interpretable Agentic AI
Sep 8, 2026Arun Vignesh Malarkkan, Xinyuan Wang, Yanjie FuAI Agent Reliability Distribution Shift
School of Computing and Augmented Intelligence, Arizona State University, USA
From Echo Chambers to Epistemic Monoculture: Large Language Models Present Temporally Contingent Partisan Alignments as Knowledge
Sep 7, 2026Wend K. TamLLM Alignment LLM Interpretability
National Center for Supercomputing Applications at the University of Illinois at Urbana-Champaign
The Internal Anatomy of Strategic Choice in Large Language Models
Sep 7, 2026Vinícius Ferraz, Leon Houf, Enrico FerreaLLM Interpretability Strategic Reasoning Risks in Language Models
Institute of Management and KD2Lab, Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany · Singularity AI Research, Singularity.Inc, Vienna, Austria · BrainSpot Labs, BrainSpot.AI, London, UK +2
A Removal Based Approach to Improve LLM Faithfulness at Test-Time
Sep 7, 2026Qinglan Luo, S M A Nahian, John Guttag +2Faithfulness of Language Model Explanations LLM Auditing
MIT CSAIL · MGH, HMS
Necessary or Sufficient? Evaluating LLM Explanations With Behavioural Evidence
Sep 4, 2026Urja Pawar, Rajitha Ramanayake, Nabeel Kemal +6Faithfulness of Language Model Explanations LLM Auditing
BNY
Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning
Sep 3, 2026Kevin Du, Alexander Hoyle, Laura Ruis +1CoT Faithfulness Process Reward Models
ETH Zürich · Work done during an internship at Cohere. · MIT +1
A Circuit for Plural Reference: How LLMs Represent and Retrieve Singular and Plural Entities
Sep 3, 2026Anh Danh, Rick Nouwen, Massimo PoesioCoreference Resolution LLM Interpretability
Utrecht University · Queen Mary University of London
Large Language Models in Resolving Contextual Knowledge Conflicts
Sep 2, 2026Xinye Yang, Zhenyang Liu, Ruisi Li +1Knowledge Conflicts in Language Models LLM Interpretability
1Northwestern University, Evanston, IL · 2New York University, New York, NY · 3Computer & Information Science and Engineering, University of Florida, Gainesville, FL
Sparse Readout Prism: Explaining Logit-Lens Scores in Features Instead of Tokens
Sep 1, 2026Matteo He, William F. Shen, Xinchi Qiu +1Transformer Interpretability LLM Interpretability
Department of Computer Science and Technology, University of Cambridge
Beyond Scores: Understanding LLM-as-a-Judge Mechanisms in Summarization Evaluation
Sep 1, 2026Himil Vasava, Ming JiangLLM-as-a-Judge Language Model Generation Evaluation
University of Wisconsin-Madison
StateSwap: Probing Support-Elimination Hidden States in Multiple-Choice Questions
Sep 1, 2026Chao Gao, Haijiang Liu, Qiyuan Li +3Prompt Sensitivity Multiple-Choice Question Answering
Department of Computer Science, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands · School of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan, China · Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan University of Science and Technology, Wuhan, China
A Unified Mechanistic Analysis of Knowledge- and Safety-Based Refusals
Sep 1, 2026Yuri Son, Seunghee Kim, Hyuhng Joon Kim +1LLM Interpretability LLM Refusal Behavior
1Hanyang University · 2Samsung Electronics
S^3martCirc: Self-supervised Smart Circuit Discovery
Sep 1, 2026Wendy Zheng, Yinhan He, Liang Wu +1LLM Interpretability Mechanistic Interpretability
University of Virginia · Nokia
How Do Language Models Choose Between Context and Memory?
Sep 1, 2026Benjamin Shih, John Winnicki, Arianna CaoKnowledge Conflicts in Language Models LLM Interpretability
Stanford University · Perpetual Labs
CRAFT: Fine-Tuning Pre-hoc Explainability in AI-native 6G RAN
Sep 1, 2026Pranshav Gajjar, Vijay K Shah6G Networks LLM Interpretability
NextG Wireless Lab NCSU Raleigh USA
Latent Mechanisms of Language Control in Multilingual Language Models
Aug 31, 2026Ryo Mitsuhashi, Sabri Boughorbel, Majd HawaslyMultilingual Language Models Multilingual Language Model Evaluation
Princeton University New Jersey, USA · Prince Sattam bin Abdulaziz University Riyadh, Saudi Arabia · QCRI, Hamad Bin Khalifa University, Doha, Qatar
Verbalizing Multi-Token Concepts in LLMs
Aug 31, 2026Xijie Gong, Zimeng Huang, Tonghan WangLLM Interpretability
College of AI, Tsinghua University, Beijing, China
MURANO: Design, Run, and Reproduce Mechanistic Interpretability Experiments as Composable Pipelines
Aug 31, 2026Alireza Bayat Makou, Emirhan Böge, Phu Gia Hoang +5LLM Interpretability Interpretable ML
Ubiquitous Knowledge Processing (UKP) Lab, Technical University of Darmstadt, Germany · Cluster of Excellence “Reasonable Artificial Intelligence” (RAI), hessian.AI, Germany · National Research Center for Applied Cybersecurity ATHENE, Germany +1
Detecting Hidden Chain-of-Thought in Large Language Models with Linguistic, Behavioral, and Mechanistic Indicators
Aug 30, 2026Armaan Singh, Ryan Trinh Le, Jasmine Kaur +5LLM Evaluation LLM Interpretability
1Stanford University · 2York University · 3Facebook
How Language Models Organize and Structure Moral Knowledge
Aug 27, 2026Orion Reblitz-RichardsonMoral Reasoning Representation Geometry in Language Models
Distiller Labs
When Personality Meets Quantization: A Layer-wise MBTI Analysis of Quantized LLMs
Aug 26, 2026Yao Fu, Lijia Huang, Xiaomin Li +3LLM Quantization LLM Interpretability
Case Western Reserve University Cleveland, OH 44106, USA · Northeastern University Boston, MA 02115, USA · Microsoft Research Redmond, WA 98052, USA
RACE: Scalable Statistical Estimation of Functional Consistency in LLM Neurons
Aug 25, 2026Runyu Wang, Bo Liu, Xiaxin Zhang +6Transformer Interpretability LLM Interpretability
School of Transportation and Civil Engineering, Nantong University · Chongqing University of Post and Telecommunications · China Southern Power Grid Company Limited +1
Hidden in the Request: Explaining Unethical LLM Compliance through Token Relevance
Aug 24, 2026Or Biton, Tomer Krichli, Itai Allouche +1Language Model Decoding Language Model Safety Evaluation
Faculty of Electrical and Computer Engineering, Technion, Haifa, Israel
LITERARYBIGFIVE: Author-Personalized Text Generation in a Unified Interpretable Space
Aug 24, 2026Jinghui Zhang, Lang Gao, Ao Li +5Language Model Steering LLM Interpretability
MBZUAI · Shandong University · Independent Researcher +2
J-Miner: Recovering the Decision Logic of Fine-Tuned LLM Classifiers as Compact Rules
Aug 17, 2026Yunfan Gao, Xinyi Huang, Tao Sheng +3LLM Interpretability Interpretable ML
Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University · Shanghai Key Laboratory of Data Science, College of Computer Science and Artificial Intelligence, Fudan University · Meituan +1
SAEVerbalizer: Generating Explanations for Sparse Autoencoder Features via Representation Verbalization
Aug 13, 2026Weihan Meng, Hongzhu Guo, Yi Jing +5LLM Interpretability Sparse Autoencoders
Tsinghua University · Peking University · Fudan University

Sep 11, 2026, cs.CLJ/K move · Enter open · S save

SearchAtlas: Analyzing Agentic Search Strategies via Evidential Query Graphs

Jiacheng Sang, Mengyuan Li, Sanxing Chen, Yukun Huang+2

Duke University · University of Pennsylvania

Agentic Search LLM Interpretability LLM Agent Evaluation

Open paper AskPDF arXiv

LLM search agents are often evaluated on final-answer accuracy, overlooking the process. Analyzing a search strategy requires understanding how credible evidence is retrieved to address question constraints. This valuable information is buried in raw search trajectories that are long and difficult to parse. We introduce SearchAtlas, a framework that converts search trajectories into structured graphs whose edges represent how evidence is propagated across the reasoning trace, from the query that retrieves it to the final answer. Our automated parsing pipeline achieves a mean edge F1 of 86.0% against human-annotated graphs and remains consistent across repeated runs. We analyze five search agents on three benchmarks, revealing systematic differences in search scale and evidence aggregation. SearchAtlas exposes fragmented answer support, question constraints that do not reach the answer, and unverified parametric knowledge entering the response. These process failures are strongly associated with incorrect answers, even more so than an LLM judge given either the raw trajectory or the ordered query list, suggesting that the constructed graphs provide useful interpretability. Moreover, an audit of cases in which process-diagnostic scores disagree with final-answer correctness shows that they capture information not reducible to answer accuracy.

Momentum

Related topics

Latest papers 546