Mitigating Spatial Blindness in Multiple Instance Learning for Whole-Slide Image Analysis
Organizations: College of Intelligence and Computing, Tianjin University, Tianjin, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China · Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE) Lab, USTC Suzhou Institute for Advanced Research, Suzhou, China · School of Biomedical Engineering, University of Science and Technology of China, Hefei, China ·
Abstract
Whole-slide multiple instance learning can predict diagnostic and prognostic labels from tissue composition while making limited use of spatial organization. Providing coordinates or a graph does not establish that a trained predictor uses tissue neighborhoods. We examine this gap as spatial blindness and hypothesize that early composition learning can weaken supervision of a spatial pathway. We introduce ResTopoMIL, which freezes a learned composition predictor before training a graph residual with a coordinate-reassignment separation loss. Permutation and information analyses distinguish architectural symmetry, available spatial information and the proposed optimization mechanism. On a controlled spatial task, staged training achieved an AUC of 0.987, compared with 0.684 for the same jointly trained architecture. Performance remained high on a composition-only task. Across four WSI classification and five survival benchmarks, ResTopoMIL improved mean primary performance on eight tasks; four improvements remained significant after Holm-adjusted patient-cluster tests. Coordinate-free residual controls recovered some of the gains, while neighborhood destruction reduced performance close to the composition anchor. Neighborhood-preserving transformations and anatomy-stratified perturbations further characterized this dependence. These results support fixing a composition reference as a practical intervention for learning spatial corrections, while retaining additional appearance capacity as a contributing explanation.
Figures & tables
| Method | Dice | Specificity | FROC |
|---|---|---|---|
| AB-MIL | 0.412 | 0.985 | 0.3952 |
| CLAM-SB | 0.459 | 0.987 | 0.4257 |
| DS-MIL | 0.259 | 0.863 | 0.4506 |
| TransMIL | 0.103 | 0.999 | 0.4866 |
| DTFD-MIL | 0.525 | 0.999 | 0.4712 |
| MHIM-MIL | 0.548 | 0.992 | 0.4815 |
| PANDA | BRCA | |||
|---|---|---|---|---|
| Schedule | Stat. | Full | Stat. | Full |
| 10 epochs | 0.9027 | 0.9426 | 0.9486 | 0.9838 |
| 20 epochs | 0.9029 | 0.9425 | 0.9488 | 0.9839 |
| Early stopping | 0.9028 | 0.9427 | 0.9487 | 0.9838 |
Multiple Instance Learning
Multiple Instance Learning learns from labeled sets of instances when labels apply to bags, enabling prediction without dense annotations.
See all 104 papers