cs.AINov 18, 2026

Risk-Controlled Correction for Frozen Multimodal Models under Missing Modalities

Authors: Hoang Pham Cong, Long D. Nguyen, Ho Viet Duc Luong, Nguyen Tran Minh Nhat, Binh P. Nguyen, Huynh Thi Thanh Binh

Organizations: Hanoi University of Science and Technology, Hanoi, Vietnam · Victoria University of Wellington, Wellington, New Zealand

Abstract

A deployed multimodal predictor may face missing modalities after its weights can no longer be changed. This raises a question that training-time repair does not answer: what part of the resulting error is still correctable from the information that remains? We show that this part is characterized by the Bayes gap, the difference between the model's prediction and the Bayes prediction given the observed modalities. For cross-entropy and squared error, excess risk measures this gap in the geometry of the loss; ambiguity in the observed modalities cannot be removed. Thus, a badly degraded prediction is not necessarily a correctable one. Estimating the Bayes prediction normally requires labels. However, when a model observing more modalities is conditionally correct, averaging its outputs conditional on the remaining modalities recovers this target without retrieval labels; with the same fixed blend and neighbors, it is no worse in expected cross-entropy or Brier risk than averaging hard labels. Some such assumption is unavoidable: otherwise the target is not identifiable from unlabeled data alone. GUARD (Gated Utility-Aware Recalibration for Deployment) leaves the deployed predictor unchanged. It estimates a candidate correction by retrieval, learns from deployment-matched labeled data when correction is likely to help, and calibrates a threshold on a held-out split by conformal risk control. Under exchangeability, the marginal probability that GUARD applies a correction whose loss increase exceeds a prescribed tolerance is bounded by a preset level, regardless of the learned score. In controlled experiments, correction gain follows headroom rather than raw error; across nine frozen model-dataset pairs spanning six domains, GUARD retains most of blanket correction's gain within harm budgets that blanket correction often exceeds.

Figures & tables

Appendix figures & tables22 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Do More Modalities Always Help? A Geometric Perspective on Missing-Modality Robustness

    Oct 3, 2026Songyuan Sui, Zhen Tan, Mohan Zhang +3Missing-Modality LearningMultimodal Robustness

  2. Conformal Fusion Under Missing Modalities

    Aug 7, 2026Alireza MoayedikiaMissing-Modality LearningGroup-Conditional Conformal Prediction

  3. Conformal Calibration for Multi-Modal Regression with Missing Modalities

    Aug 7, 2026Ilia AziziGroup-Conditional Conformal PredictionMultimodal Regression