cs.LGNov 1, 2026

MIRA: Mutual Information guided calibration for Reliable Test-Time Adaptation

Authors: Hyeongyu Kim, Mingyeong Jang, Youngjun Song, GeonHui Han, Dosik Hwang

Organizations: School of Electrical and Electronic Engineering, Yonsei University · Hyundai Motor Company · Department of Radiology and Center for Clinical Imaging Data Science, College of Medicine, Yonsei University · Artificial Intelligence and Robotics Institute, Korea Institute of Science and Technology

Abstract

Test-time adaptation (TTA) updates a deployed model using only unlabeled target data, but standard entropy-based methods often rely on deterministic confidence and can reinforce overconfident errors under distribution shift. We propose MIRA, Mutual Information guided calibration for Reliable Test-Time Adaptation, a source-free online adaptation method that uses lightweight last-layer Gaussian perturbations to probe prediction reliability. For each target batch, MIRA reuses a single feature extraction pass and samples perturbed classifiers around the source classifier, forming an efficient local predictive distribution. Rather than fitting a Bayesian posterior, MIRA treats the perturbation scale as a local probing radius and selects a batch-specific scale using mutual information (MI) and prediction agreement. The resulting perturbation-sensitivity signal identifies predictions that are confident and locally stable under classifier perturbations, while suppressing brittle predictions with high stochastic disagreement. MIRA then performs adaptation with an MI-confidence weighted entropy loss, which down-weights perturbation-sensitive or low-confidence samples before they drive entropy minimization. This weighted loss reduces the influence of brittle predictions that can otherwise cause harmful adaptation under distribution shift. The method requires no source data, retraining, model ensembles, or offline posterior fitting, and can be applied as a plug-and-play modification to entropy-minimization TTA. Experiments on distribution-shift benchmarks show improvements in accuracy, calibration, and negative log-likelihood, suggesting that mutual-information-guided perturbation probing and weighted adaptation yield more robust online TTA than deterministic confidence.

Figures & tables

Appendix figures & tables17 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. When Test-Time Adaptation Helps, Harms, or Becomes Inactive: A Condition-Level Study on CIFAR-10-C

    Aug 23, 2026Sreeja Guha Majumdar, Aratrika SahaTest-Time AdaptationCorruption Robustness

  2. Dual Strategies for Test-Time Adaptation

    Apr 19, 2026Nam Nguyen Phuong, Duc Nguyen The Minh, Phi Le Nguyen +2Distribution Shift RobustnessTest-Time Adaptation

  3. Backpropagation-Free Test-Time Adaptation via Probabilistic Gaussian Alignment

    Aug 21, 2025Youjia Zhang, Youngeun Kim, Young-Geun Choi +3Test-Time AdaptationDistribution Shift Robustness