cs.CLDec 1, 2025

Latent Debate: A Surrogate Framework for Interpreting LLM Thinking towards Binary Decisions

Authors: Lihu Chen, Xiang Yin, Francesca Toni

Organizations: Imperial College London, United Kingdom.

Abstract

Understanding the internal `thinking' process of Large Language Models (LLMs) and %how this relates their connections to hallucinations remains a key challenge. To this end, we introduce latent debate, a structured surrogate framework for interpreting model outputs on True/False prediction tasks through the lens of internal latent arguments and interactions amongst them. Unlike human debates, latent debate captures the hidden supporting and attacking signals that arise within a model during a single inference. We first present a model- and task-agnostic conceptual framework, and then instantiate it symbolically to approximate the thinking process of LLMs towards binary decisions. Empirical studies demonstrate that our latent debate is a faithful structured surrogate model that has highly consistent predictions with the original LLM, while providing a form of interpretability. We also demonstrate that our latent debate provides a strong baseline for hallucination detection. Specifically, we identify strong correlations between debate patterns and hallucinations, such as a high degree of disagreement in the middle layers of the latent debate surrogate is linked to a higher risk of hallucinations. Our findings suggest that latent debate provides a new framework for understanding the internal processes of LLMs.

Figures & tables

Appendix figures & tables6 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Analyzing the Correlation Between Hallucinations and Knowledge Conflicts in Large Language Models

    Jun 7, 2026Lucrezia Laraspata, Giovanna Castellano, Gennaro VessioKnowledge Conflicts in Language ModelsLLM Interpretability

  2. Decision Models as Judges for Hallucination Detection

    Oct 27, 2026Haozheng Liu, Zhaoqian Xue, Zhongyin Wang +4LLM Hallucination DetectionLLM-as-a-Judge