Uncertainty Quantification
Uncertainty quantification (UQ) aims to assess and represent the confidence in predictions made by machine learning models, crucial for high-stakes applications where reliable predictions are paramount. Current research focuses on developing robust UQ methods, particularly addressing biases in predictions and efficiently quantifying uncertainty in large language models and deep neural networks, often employing techniques like conformal prediction, Bayesian methods, and ensemble learning. The ability to reliably quantify uncertainty enhances the trustworthiness and applicability of machine learning across diverse fields, from healthcare diagnostics and autonomous driving to climate modeling and drug discovery.
Papers
Generalizing Machine Learning Evaluation through the Integration of Shannon Entropy and Rough Set Theory
Olga Cherednichenko, Dmytro Chernyshov, Dmytro Sytnikov, Polina Sytnikova
Model-free quantification of completeness, uncertainties, and outliers in atomistic machine learning using information theory
Daniel Schwalbe-Koda, Sebastien Hamel, Babak Sadigh, Fei Zhou, Vincenzo Lordi
Uncertainty Quantification in Detecting Choroidal Metastases on MRI via Evolutionary Strategies
Bala McRae-Posani, Andrei Holodny, Hrithwik Shalu, Joseph N Stember
Leveraging viscous Hamilton-Jacobi PDEs for uncertainty quantification in scientific machine learning
Zongren Zou, Tingwei Meng, Paula Chen, Jérôme Darbon, George Em Karniadakis
Combining Statistical Depth and Fermat Distance for Uncertainty Quantification
Hai-Vy Nguyen, Fabrice Gamboa, Reda Chhaibi, Sixin Zhang, Serge Gratton, Thierry Giaccone
Uncertainty Aware Tropical Cyclone Wind Speed Estimation from Satellite Data
Nils Lehmann, Nina Maria Gottschling, Stefan Depeweg, Eric Nalisnick
Segmentation Re-thinking Uncertainty Estimation Metrics for Semantic Segmentation
Qitian Ma, Shyam Nanda Rai, Carlo Masone, Tatiana Tommasi
Data-Adaptive Tradeoffs among Multiple Risks in Distribution-Free Prediction
Drew T. Nguyen, Reese Pathak, Anastasios N. Angelopoulos, Stephen Bates, Michael I. Jordan
On Uncertainty Quantification for Near-Bayes Optimal Algorithms
Ziyu Wang, Chris Holmes