Beyond the Dominant Label: Recovering Coexisting Lesion Evidence with Multiple Instance Learning
Organizations: USTC, Anhui, China · Anhui Province Key Laboratory of Biomedical Imaging and Intelligent Processing, Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Anhui, China
Abstract
Whole-slide images may contain coexisting lesions, yet weak supervision typically provides only the most severe diagnosis. We formulate this setting as dominant-label multiple instance learning, where the observed label is the maximum-severity element of a latent lesion set. Standard multiclass MIL treats it as a complete one-hot description and therefore suppresses lower-severity evidence whenever it co-occurs with a dominant lesion. We propose DomSet-MIL, a label-aware framework that aligns the annotation mechanism across bag and instance levels. Dominant-Label Censored Likelihood models the reported diagnosis without declaring unreported lesions absent. Severity-Ordered Residual Routing assigns patch evidence from high to low severity and preserves residual support for secondary findings, while top- pooling links local routing scores to bag prediction. Experiments across natural and controlled settings show that DomSet-MIL achieves state-of-the-art performance in dominant-label prediction while more effectively recovering latent coexisting-lesion evidence. These findings demonstrate that modeling the dominant-label mechanism can improve diagnostic prediction without sacrificing clinically meaningful secondary findings.
Figures & tables
| BRACS | EBRAINS-Mix | NSCLC-Mix | RCC-Mix | ||||||
| Method | M-AUC | BAcc | UER | M-AUC | BAcc | M-AUC | BAcc | M-AUC | BAcc |
| Published MIL methods | |||||||||
| ABMIL | 0.881 | 0.643 | 0.118 | 0.897 | 0.804 | 0.936 | 0.867 | 0.892 | 0.781 |
| CLAM-SB | 0.887 | 0.652 | 0.110 | 0.903 | 0.814 | 0.942 | 0.876 | 0.899 | 0.793 |
| DSMIL | 0.894 | 0.661 | 0.101 | 0.914 | 0.827 | 0.950 | 0.887 | 0.908 | 0.806 |
| TransMIL | 0.901 | 0.668 | 0.096 | 0.909 | 0.820 | 0.947 | 0.883 | 0.906 | 0.804 |
| Bag level | ROI level | |||||||
| EBRAINS-Mix | NSCLC-Mix | RCC-Mix | BRACS | |||||
| Method | Set-mAP | Hidden-R | Set-mAP | Hidden-R | Set-mAP | Hidden-R | ROI-mAP | Sec-ROI-R |
| ABMIL | 0.618 | 0.286 | 0.661 | 0.318 | 0.592 | 0.251 | – | – |
| DSMIL | 0.653 | 0.349 | 0.702 | 0.386 | 0.636 | 0.317 | 0.556 | 0.392 |
| DTFD-MIL (AFS) | 0.671 | 0.371 | 0.718 | 0.401 | 0.654 | 0.337 | – | – |
| SemaMIL | 0.664 | 0.362 | 0.712 | 0.396 | 0.649 | 0.331 | – | – |
| Variant | M-AUC | BAcc | UER | ROI-mAP | Sec-ROI-R |
|---|---|---|---|---|---|
| DomSet-MIL | 0.916 | 0.690 | 0.071 | 0.625 | 0.500 |
| DCL CE | 0.906 | 0.677 | 0.091 | 0.600 | 0.433 |
| SORR independent gates | 0.911 | 0.684 | 0.077 | 0.610 | 0.462 |
| Top- mean | 0.903 | 0.670 | 0.089 | 0.596 | 0.442 |
| Top- max | 0.909 | 0.680 | 0.081 | 0.606 | 0.455 |
| Top- noisy-OR | 0.905 | 0.674 | 0.086 | 0.599 | 0.446 |
Multiple Instance Learning
Multiple Instance Learning learns from labeled sets of instances when labels apply to bags, enabling prediction without dense annotations.
See all 96 papers