stat.MLFeb 22, 2025

Rectifying Conformity Scores for Better Conditional Coverage

Authors: Vincent Plassier, Alexander Fishkov, Victor Dheur, Mohsen Guizani, Souhaib Ben Taieb, Maxim Panov, Eric Moulines

Organizations: Lagrange Mathematics and Computing Research Center · Mohamed bin Zayed University of Artificial Intelligence · Skolkovo Institute of Science and Technology · University of Mons · 

Abstract

We present a new method for generating confidence sets within the split conformal prediction framework. Our method performs a trainable transformation of any given conformity score to improve conditional coverage while ensuring exact marginal coverage. The transformation is based on an estimate of the conditional quantile of conformity scores. The resulting method is particularly beneficial for constructing adaptive confidence sets in multi-output problems where standard conformal quantile regression approaches have limited applicability. We develop a theoretical bound that captures the influence of the accuracy of the quantile estimate on the approximate conditional validity, unlike classical bounds for conformal prediction methods that only offer marginal coverage. We experimentally show that our method is highly adaptive to the local data structure and outperforms existing methods in terms of conditional coverage, improving the reliability of statistical inference in various applications.

Figures & tables

Appendix figures & tables13 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Co-optimization for Adaptive Conformal Prediction

    Mar 2, 2026Xiaoyi Su, Zhixin Zhou, Rui LuoConformal PredictionRegression Prediction Intervals

  2. Beyond Marginal Validity: Finite-Sample Guarantees for Localized Conformal Prediction

    Aug 6, 2026Anton Conrad, Rustam Isaev, Denis Belomestny +2Conformal PredictionStatistical Learning Theory

  3. Conformal Prediction Assessment: A Framework for Conditional Coverage Evaluation and Selection

    Mar 28, 2026Zheng Zhou, Xiangfei Zhang, Chongguang Tao +1Conformal Prediction