stat.MLNov 2, 2026

Specification-Aware Predictive Uncertainty Decomposition

Authors: Roman Vashurin, Mikhail Seleznyov, Assel Yermekova, Fedor Chernogorskii, Danila Zykov, Elena Tutubalina, Alexander Panchenko, Preslav Nakov, 

Organizations: MBZUAI · AXXX · S-NLP · Huawei Technologies Ltd. · 

Abstract

Classical decompositions of predictive uncertainty, such as the information-theoretic one, are defined for a fixed representation xx of the input object. They do not consider that xx may be incomplete, nor do they measure how much the missing information can affect the prediction. In Large Language Models, users can clarify an underspecified input without any retraining. The clarified input can describe the user's unobserved intent z∗z^* more accurately and change the predictive uncertainty about the outcome. In this paper, we formalize this setting probabilistically and derive a three-term decomposition of prediction risk into specification, residual aleatoric, and epistemic uncertainties. We show that at the original information level, when only xx is available, the aleatoric uncertainty, represented by a Bayes risk, has two components. The first, which we call specification uncertainty, is the expected reduction in this Bayes risk from revealing the intent. The second is the residual aleatoric uncertainty, i.e., the Bayes risk that remains once the intent is known, averaged over its possible values zz given xx. The distinction is important, as specification uncertainty informs the decision to request clarification before making a prediction. We build approximations of these components and connect them to existing uncertainty measures. Our experiments across different domains and modalities show distinct roles for the three components. Specification uncertainty is the most informative for detecting underspecified inputs, while residual aleatoric uncertainty is the most informative for detecting in-distribution prediction errors.

Figures & tables

Appendix figures & tables11 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. The Role of Ambiguity in Error Prediction via Uncertainty Quantification

    Jun 1, 2026Ieva Raminta Staliūnaitė, James Bishop, Andreas VlachosUncertainty QuantificationLLM Uncertainty Estimation

  2. From Answers to Interpretations: Rethinking Ambiguity-Induced Aleatoric Uncertainty Estimation in LLMs

    Sep 3, 2026Omer Nahum, Niv Nayman, Jonathan Fhima +4LLM Uncertainty EstimationAleatoric Uncertainty

  3. Uncertainty Decomposition for Clarification Seeking in LLM Agents

    Jun 17, 2026Gregory MatsnevLLM AgentsLLM Uncertainty Estimation