cs.CVJul 2, 2026

Rethinking Post-Hoc Calibration in Semantic Segmentation

Authors: Tristan KirscherKim-Celine KahlBalint KovacsMaximilian R. RokussKlaus Maier-HeinXavier CoubezPhilippe MeyerSylvain Faisan

Organizations: ICube, Institut Strauss · DKFZ · ICube

Abstract

Reliable confidence estimates are essential in semantic segmentation, yet modern models often remain miscalibrated. We investigate two overlooked issues in post-hoc calibration. First, adding a constant to all logits leaves softmax probabilities unchanged, but several standard calibrators depend on this arbitrary offset. In segmentation, this offset can vary across pixels or voxels, introducing spatially varying representation dependence. We characterize translation-invariant (TI) calibrators and construct TI counterparts of shift-sensitive methods. Second, calibrating with cross-entropy can degrade segmentation quality due to mismatched training and calibration objectives and limited calibration data. We investigate decision-preserving calibration under argmax- and order-preservation constraints. Since these constraints restrict affine softmax calibrators to temperature scaling, we introduce more expressive class-conditional affine calibrators that preserve decisions. Across natural-image and medical segmentation benchmarks, including corruption-based covariate shift, TI variants generally improve calibration, while decision-preserving variants prevent segmentation degradation by construction and retain strong calibration performance. Our findings provide practical design principles for post-hoc calibration in semantic segmentation.

Explore similar work

CardsList
  1. CalArena: A Large-Scale Post-Hoc Calibration Benchmark

    May 28, 2026Eugène Berta, David Holzmüller, Francis Bach +1Multicalibration and CalibrationPost-Hoc