Faithfulness of Language Model Explanations

Overview

This topic asks whether a model’s explanations identify the evidence and reasoning that actually influence its answers, rather than merely offering plausible justifications afterward. Researchers test this with counterfactual prompt and evidence edits, feature ablations, activation probes and patching, and citation or verifier checks across reasoning, medical, classification, and retrieval-augmented tasks. To improve faithfulness, methods include evidence-grounded generation, structured or executable reasoning, and training with faithfulness rewards. A central challenge is that correct answers and convincing explanations do not prove causal faithfulness, while metrics often disagree and improvements can trade off against accuracy, completeness, or brevity.

Latest papers

122 papers20 papers in the last four weeks, down 23% on the four weeks before. 0.2% of all new papers.

Sep 10, 2025

LIFT: Likelihood-Based Intervention Faithfulness Training

Chain-of-thought (CoT) reasoning improves LLM accuracy on complex tasks, but CoTs are often unfaithful; that is, the model does not rely on the stated reasoning steps to produce its answer. Existing methods to improve faithfulness require human annotations. We propose LIFT, which automatically scores each reasoning step by its causal influence: we replace it with a domain-matched but irrelevant fact and measure the drop in answer log-probability. We fine-tune on high-scoring CoT traces where interventions successfully disrupted reasoning, jointly optimizing for faithfulness and accuracy. LIFT improves faithfulness across three models (Mistral-7B-Instruct, Qwen3-8B, and Qwen3-4B-Instruct) and three benchmarks, with accuracy comparable to a model fine-tuned solely for accuracy.
Mar 17, 2025

Verbosity Tradeoffs and the Impact of Scale on the Faithfulness of LLM Self-Explanations

When asked to explain their decisions, LLMs can often give explanations which sound plausible to humans. But are these explanations faithful, i.e. do they convey the factors actually responsible for the decision? In this work, we analyse counterfactual faithfulness across 75 models from 13 families. We analyze the tradeoff between conciseness and comprehensiveness, how correlational faithfulness metrics assess this tradeoff, and the extent to which metrics can be gamed. This analysis motivates two new metrics: the phi-CCT, a simplified variant of the Correlational Counterfactual Test (CCT) which avoids the need for token probabilities while explaining most of the variance of the original test; and F-AUROC, which eliminates sensitivity to imbalanced intervention distributions and captures a model's ability to produce explanations with different levels of detail. Our findings reveal a clear scaling trend: larger and more capable models are consistently more faithful on all metrics we consider. Our code is available at https://github.com/google-deepmind/corr_faith.