stat.MLOct 22, 2026

Prediction Uncertainty Controlled Computer Model Calibration

Authors: Ryan Heejoon Byun, Dayeon Yoon, Won Chang

Organizations: Department of Statistics, Seoul National University · Institute for Data Innovation in Science, Seoul National University

Abstract

Computer-model calibration is usually undertaken in service of prediction, yet neither Bayesian Kennedy-O'Hagan (KOH) calibration nor amortized simulation-based inference is built to control the predictive error of the calibrated simulator. When parameters are weakly identified or the data-model discrepancy is misspecified, the simulator-output bands induced by a nominal posterior level can be far from nominal. We propose a two-layer framework that targets predictive miscoverage directly. First, a conditional flow-matching model learns an amortized posterior for the calibration parameters, trained on simulator outputs perturbed with Gaussian-process discrepancies of varying structure. Second, conformal risk control arranges posterior draws for the target observation into nested candidate sets and selects the smallest one whose fixed-rank pointwise bands attain a prescribed time-averaged miscoverage on a synthetic calibration sample. Under exchangeability of calibration and target observations, the bands control expected miscoverage in finite samples. In a synthetic benchmark, the proposed bands are roughly 20% the width of KOH-MCMC bands with miscoverage near the 10% target. In calibrating an age-structured SEIR model to the 2010 Malawi measles outbreak, they are again sharper and near-nominal, and the weeks they fail to cover coincide with the asymmetric epidemic decline, exposing structural inadequacy of the mechanistic model.

Explore similar work

CardsList
  1. Simulation-based inference for rapid Bayesian parameter estimation in epidemiological models: a comparison with MCMC

    Jun 25, 2026Alina Bazarova, Johann Fredrik Jadebeck, Henrik Zunker +5Markov Chain Monte CarloSimulation-Based Inference

  2. Isotonic Conformal Prediction

    Jul 18, 2026Daniel Bensimon, Sean Xiang Yu, Eric D. Kolaczyk +1Conformal PredictionUncertainty Calibration

  3. A Ranking Approach for Measuring Calibration

    Sep 11, 2026Anirban Chatterjee, Rina Foygel BarberProbability CalibrationModel Calibration