cs.CVOct 12, 2026

From Failure Prediction to Component Selection in Semantic Segmentation

Authors: Minhui Kang, Yiyao Zhang, Peizhe Long, Jiafeng Qi, Hongyu Jin, Jiayun Zheng

Organizations: School of Power Engineering, Jiangxi Electric Vocational and Technical College, Nanchang, Jiangxi, China · College of Information Science and Engineering, Shandong Agricultural University, Tai’an, Shandong, China · College of Aviation Manufacturing Industry, Nanchang Hangkong University, Jingdezhen, Jiangxi, China

Abstract

Reliable scene understanding requires deciding which predictions to trust, retain, or inspect. In semantic segmentation, component failure predictors support these decisions, but their predictive performance does not fully describe the value of the resulting selection. We develop a decision-centered evaluation framework that connects three questions: what an available score predicts, what can be learned from its existing fields, and what its ranking delivers. Across three segmentation systems on Cityscapes and ACDC at 90% retention, adapted MetaSeg reduces retained failure relative to forecast entropy in all twelve architecture-population comparisons, but does not establish a failure advantage over direct probability ranking. Image-nested source experiments reveal a different opportunity: reusing the full field set improves predictive and retained-loss performance under both learners in all three systems, while the raw OCRNet probe improves prediction with unresolved selective gains. Mapping a fixed prediction pair to conditional log-loss risk produces mixed selection effects, which we examine through the components exchanged by the two rankings. These findings distinguish the performance of a fitted score from the value obtainable from its inputs and the consequences of its use. The framework provides a practical basis for deciding whether to adopt an additional score, relearn existing fields, or revise a selection rule, and for explaining the gains and failures of component-level reliability methods.

Figures & tables

Appendix figures & tables25 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

May 14, 2026

Semantic Feature Segmentation for Interpretable Predictive Maintenance in Complex Systems

Predictive maintenance in complex systems is often complicated by the heterogeneity and redundancy of monitored variables,which can obscure fault-relevant information and reduce model interpretability. This work proposes a semantic feature segmentation framework that decomposes the monitored feature space into a canonical component,expected to retain the dominant predictive information, and a residual component containing structurally peripheral signals. The segmentation is defined through domain informed criteria and sets up monitoring variables into functional groups reflecting operational mechanisms such as throughput,latency,pressure,network activity,and structural state. To evaluate the effectiveness of this decomposition, we adopt a predictive perspective in which expected predictive risk is used as an operational proxy for task-relevant information. Experimental results obtained through time-aware cross-validation show that the canonical space consistently achieves lower predictive risk than the residual space across multiple temporal configurations, indicating that the semantic segmentation concentrates the most relevant information for fault anticipation. In addition, the canonical segments exhibit significantly stronger intra-segment coherence than inter-segment dependence, and this structural organization remains stable after redundancy reduction. When compared with the full feature space and with a Principal Component Analysis (PCA) representation, the canonical space carries out comparable predictive performance and furthermore preserves the semantic meaning of the original variables. These findings suggest that semantic feature segmentation provides an interpretable and information-preserving decomposition of monitoring signals, enabling competitive predictive performance without sacrificing the operational interpretability required in predictive maintenance applications.
Mar 2, 2026

LOCUS: A Distribution-Free Loss-Quantile Score for Risk-Aware Predictions

Modern machine learning models can be accurate on average yet still make mistakes that dominate deployment cost. We introduce Locus, a distribution-free wrapper that produces a per-input loss-scale reliability score for a fixed prediction function. Rather than quantifying uncertainty about the label, Locus models the realized loss of the prediction function using any engine that outputs a predictive distribution for the loss given an input. A simple split-calibration step turns this function into a distribution-free interpretable score that is comparable across inputs and can be read as an upper loss level. The score is useful on its own for ranking, and it can optionally be thresholded to obtain a transparent flagging rule with distribution-free control of large-loss events. Experiments across 13 regression benchmarks show that Locus yields effective risk ranking and reduces large-loss frequency compared to standard heuristics.
Apr 14, 2026

Rethinking Uncertainty in Segmentation: From Estimation to Decision

In medical image segmentation, uncertainty estimates are often reported but rarely used to guide decisions. We study the missing step: how uncertainty maps are converted into actionable policies such as accepting, flagging, or deferring predictions. We formulate segmentation as a two-stage pipeline, estimation followed by decision, and show that optimizing uncertainty alone fails to capture most of the achievable safety gains. Using retinal vessel segmentation benchmarks (DRIVE, STARE, CHASE_DB1), we evaluate two uncertainty sources (Monte Carlo Dropout and Test-Time Augmentation) combined with three deferral strategies, and introduce a simple confidence-aware deferral rule that prioritizes uncertain and low-confidence predictions. Our results show that the best method and policy combination removes up to 80 percent of segmentation errors at only 25 percent pixel deferral, while achieving strong cross-dataset robustness. We further show that calibration improvements do not translate to better decision quality, highlighting a disconnect between standard uncertainty metrics and real-world utility. These findings suggest that uncertainty should be evaluated based on the decisions it enables, rather than in isolation.