Uncertainty Quantification

Also known as UQ

Overview

Uncertainty quantification studies what is unknown in a prediction or inference, where that uncertainty comes from, and how it should affect decisions. Common approaches include Bayesian methods, ensembles and Gaussian processes, which model predictive distributions; conformal prediction, which provides distribution-free coverage guarantees; and calibration methods that adjust confidence or intervals against observed errors. Researchers apply these tools to settings from medical imaging and physical simulations to language models, evaluating calibration, coverage, error detection and performance under distribution shift. A central challenge is that well-calibrated or narrow estimates do not always identify actual failures, so methods must be tested in the conditions and for the decisions where they will be used, while balancing reliability against computational cost.

Latest papers

CardsList

701 papers51 papers in the last four weeks, down 27% on the four weeks before. 0.4% of all new papers.

  1. Active Learning with Bayesian Multi-Fidelity Laplace Neural Operators for Oscillatory Parametric PDEs

    Feb 1, 2025Bongseok Kim, Haoyang Zheng, Michael Penwarden +1Dynamical SystemsSurrogate Modeling

  2. Statistical Uncertainty Quantification for Aggregate Performance Metrics in Machine Learning Benchmarks

    Jan 8, 2025Rachel Longjohn, Giri Gopalan, Emily CasletonUncertainty Quantification

  3. Label-Confidence-Aware Uncertainty Estimation in Natural Language Generation

    Dec 10, 2024Qinhong Lin, Yinglun Feng, Yuhao Zhang +2Uncertainty QuantificationLLM Uncertainty Estimation

  4. Survival of the Fittest Perturbations: Uncertainty-Aware Evolution of Adversarial Distributions for Robust Generalization

    Nov 5, 2024Junhao Dong, Zicheng Yu, Xinghua Qu +2Adversarial TrainingAdversarial Robustness

  5. Uncertainty measurement for complex event prediction in safety-critical systems

    Nov 2, 2024Maria J. P. Peixoto, Akramul AzimUncertainty QuantificationSensitivity Analysis

  6. Uncertainty Quantification in Machine Learning for Biosignal Applications -- A Review

    Nov 15, 2023Ivo Pascal de Jong, Andreea Ioana Sburlea, Matias Valdenegro-ToroUncertainty Quantification

  7. Training-Free Uncertainty Estimation for Embedding Models

    May 31, 2023Young-Jin Park, Addison Kristanto Julistiono, Hao Wang +2Representation LearningUncertainty Quantification

  8. Distribution-Free Uncertainty Quantification for Kernel Methods by Gradient Perturbations

    Dec 23, 2018Balázs Csanád Csáji, Krisztián Balázs KisConfidence Region EstimationUncertainty Quantification

  9. Analytical Standard Errors for Exploratory Factor Solutions

    Nov 12, 2018Xingwei Hu, Caihong Hu, Cheng-Kuang WuUncertainty QuantificationDimensionality Reduction

  10. Estimating Uncertain Spatial Relationships in Robotics

    Mar 27, 2013Randall Smith, Matthew Self, Peter CheesemanUncertainty QuantificationRobot State Estimation