cs.CVOct 30, 2026

Measuring What Matters: A Causal Reliance Score for Histopathology Image Segmentation

Authors: Samuel Thomas, Daniel Tweneboah Anyimadu, Ahmed Karam Eldaly, Somaia Elsheikh, Mohammed M. Abdelsamea

Organizations: Department of Computer Science, University of Exeter, Exeter, UK · Nottingham University Hospitals NHS Trust

Abstract

Reliable histopathology segmentation requires models that rely on pathology-relevant structures rather than spurious background correlations. In this work, we argue that improving architectures alone is insufficient if models continue to rely on spurious correlations rather than pathology-relevant features. We introduce a causality-inspired evaluation framework based on controlled interventions that explicitly probes model sensitivity to foreground tissue structure and background/domain variation. Building on this, we propose the Causal Reliance Score (CRS), a metric that quantifies the relative sensitivity of model predictions to foreground perturbation versus background/domain variation under controlled interventions. To support this analysis, we design augmentation strategies that act as implicit counterfactual interventions during training, encouraging invariance to nuisance factors while preserving morphology. We demonstrate how these interventions reveal behavioural differences between models that are not captured by standard metrics such as Dice or IoU. While we instantiate our framework using a self-supervised transformer (CAUSE-ViT), the primary contribution of this work is not a new architecture, but a principled intervention-based methodology and evaluation metric for auditing model behaviour in medical image segmentation. Our results suggest that evaluating model behaviour through counterfactual interventions is essential for developing reliable and clinically robust medical image segmentation systems.

Figures & tables

Explore similar work

CardsList
  1. Leveraging Causal Reasoning Method for Explaining Medical Image Segmentation Models

    Feb 24, 2026Limai Jiang, Ruitao Xie, Bokai Yang +6Explainable Medical Image AnalysisMedical Image Segmentation

  2. C2RM-Seg: Causal Counterfactual Reasoning with Structural-Semantic Priors for Weakly Supervised Histopathological Tissue Segmentation

    Jun 24, 2026Hualong Zhang, Siyang Feng, Zihan Huan +4Computational PathologyWeakly Supervised Image Segmentation

  3. Benchmarking Computational Pathology Foundation Models For Semantic Segmentation

    Feb 21, 2026Lavish Ramchandani, Aashay Tinaikar, Dev Kumar Das +2Histopathology Image SegmentationPathology Foundation Models