cs.CVNov 6, 2026

Finite-sample Calibration Guarantees for Binary Segmentation

Authors: Bruno Viti, Martin Holler

Organizations: IDea Lab - The Interdisciplinary Digital Lab at the University of Graz, Austria

Abstract

Machine learning based segmentation models are frequently miscalibrated, producing for each pixel a label prediction whose associated confidence does not accurately reflect the true underlying probability. This limitation is particularly critical in high-stakes applications such as medical image segmentation. Although several calibration methods have been proposed, only a small subset of them provides theoretical guarantees on the calibration error, i.e., they do not typically ensure that, with high probability, the model exhibits a low calibration error. In this work, we develop a post-hoc calibration method for which formal calibration guarantees can be established. To achieve this, we derive from standard concentration inequalities an improved theoretical bound that explicitly accounts for the spatial dependence inherent in binary segmentation outputs. We empirically demonstrate that the proposed calibrator satisfies the derived guarantee and outperforms existing post-hoc calibration approaches.

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Rethinking Post-Hoc Calibration in Semantic Segmentation

    Jul 2, 2026Tristan Kirscher, Kim-Celine Kahl, Balint Kovacs +5Post-Hoc CalibrationModel Calibration

  2. Multi-Rater Calibrated Segmentation Models

    May 4, 2026Meritxell Riera-Marín, Javier García López, Júlia Rodríguez-Comas +2Inter-Rater ReliabilityImage Segmentation

  3. CalCErt: Bin-wise Certification of Confidence Calibration in Medical Image Classification

    Oct 2, 2026Leo Fillioux, Stergios Christodoulidis, Stergios Christodoulidis +2Model CalibrationProbability Calibration