cs.CVOct 12, 2026

From Failure Prediction to Component Selection in Semantic Segmentation

Authors: Minhui Kang, Yiyao Zhang, Peizhe Long, Jiafeng Qi, Hongyu Jin, Jiayun Zheng

Organizations: School of Power Engineering, Jiangxi Electric Vocational and Technical College, Nanchang, Jiangxi, China · College of Information Science and Engineering, Shandong Agricultural University, Tai’an, Shandong, China · College of Aviation Manufacturing Industry, Nanchang Hangkong University, Jingdezhen, Jiangxi, China

Abstract

Reliable scene understanding requires deciding which predictions to trust, retain, or inspect. In semantic segmentation, component failure predictors support these decisions, but their predictive performance does not fully describe the value of the resulting selection. We develop a decision-centered evaluation framework that connects three questions: what an available score predicts, what can be learned from its existing fields, and what its ranking delivers. Across three segmentation systems on Cityscapes and ACDC at 90% retention, adapted MetaSeg reduces retained failure relative to forecast entropy in all twelve architecture-population comparisons, but does not establish a failure advantage over direct probability ranking. Image-nested source experiments reveal a different opportunity: reusing the full field set improves predictive and retained-loss performance under both learners in all three systems, while the raw OCRNet probe improves prediction with unresolved selective gains. Mapping a fixed prediction pair to conditional log-loss risk produces mixed selection effects, which we examine through the components exchanged by the two rankings. These findings distinguish the performance of a fitted score from the value obtainable from its inputs and the consequences of its use. The framework provides a practical basis for deciding whether to adopt an additional score, relearn existing fields, or revise a selection rule, and for explaining the gains and failures of component-level reliability methods.

Figures & tables

Appendix figures & tables25 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Semantic Feature Segmentation for Interpretable Predictive Maintenance in Complex Systems

    May 14, 2026Emilio Mastriani, Alessandro Costa, Federico Incardona +2Interpretable MLPredictive Maintenance

  2. LOCUS: A Distribution-Free Loss-Quantile Score for Risk-Aware Predictions

    Mar 2, 2026Matheus Barreto, Mário de Castro, Thiago R. Ramos +2Uncertainty Calibration