cs.LGAug 11, 2026

Invertible Logits Transformation for Accuracy-Preserving Post-Hoc Uncertainty Calibration

Authors: Lening ZhaoQipeng ZhanLi Shen

Organizations: University of Pennsylvania

Abstract

Post-hoc calibration aligns a classifier's predicted confidences with its empirical accuracy without retraining. An ideal calibrator should correct nonlinear miscalibration, scale gracefully to large label spaces, and preserve the original predictions; existing methods typically violate at least one of these properties---temperature scaling lacks expressivity, more flexible parametric alternatives introduce parameters that grow with the number of classes CC, and other expressive methods do not preserve the rank ordering of class scores and may alter the predicted class. We propose \textbf{Invertible Logits Transformation (InvLT)}, which applies a learned scalar MLP f:RRf:\mathbb{R}\to\mathbb{R} element-wise to the pre-softmax logits. Sharing ff across all logit dimensions makes the parameter count independent of CC. Monotonicity of ff---and hence preservation of the argmax prediction---is softly encouraged via a paired inverse network rather than enforced through the numerical integration required by prior monotone calibrators; this avoids their computational overhead while empirically preserving the original classification accuracy in every setting we evaluate. Across standard image classification benchmarks and a range of architectures, InvLT consistently outperforms a broad set of post-hoc baselines on standard calibration metrics.

Explore similar work

CardsList
  1. Rethinking Post-Hoc Calibration in Semantic Segmentation

    Jul 2, 2026Tristan Kirscher, Kim-Celine Kahl, Balint Kovacs +5Multicalibration and CalibrationPost-Hoc

  2. CalArena: A Large-Scale Post-Hoc Calibration Benchmark

    May 28, 2026Eugène Berta, David Holzmüller, Francis Bach +1Multicalibration and CalibrationPost-Hoc