Confidence Estimation in Language Models

Overview

The field studies whether language models can tell when their answers are likely to be wrong, which matters for deciding when to answer, abstain, retrieve evidence, or spend more computation. Methods include verbalized confidence, token probabilities and sampling-based agreement, as well as hidden-state probes, activation signals, post-hoc calibration, and conformal prediction. These approaches are tested across settings such as factual question answering, mathematical reasoning, code generation, multilingual tasks, and tool-using agents. A central challenge is that confidence signals can disagree or shift with prompts, training, and distribution changes; good calibration or error ranking alone does not guarantee useful decisions or reliable risk guarantees.

Latest papers

CardsList

271 papers39 papers in the last four weeks, down 13% on the four weeks before. 0.3% of all new papers.

  1. Popular but Wrong: Understanding and Mitigating LLM Overconfidence through Knowledge Popularity

    May 23, 2025Shiyu Ni, Keping Bi, Jiafeng Guo +1LLM Uncertainty EstimationLLM Hallucination Mitigation