ExiST: Existence-Aware Self-Training for Semi-Supervised Multi-Organ Segmentation
Organizations: Saarland University, Germany · German Research Center for Artificial Intelligence (DFKI), Germany
Abstract
Semi-supervised multi-organ segmentation should learn more than a dozen organs from a handful of labeled scans, and the smallest organs occupy less than one percent of the foreground. We identify a failure mode of self-training that is specific to this regime. When a teacher misses a small organ in a scan, every voxel of that organ receives the confident pseudo-label background, and the student is trained toward the organ absence. Repeated over many scans, this loop extinguishes tail organs. In a pilot study, removing the gallbladder from the pseudo-labels reduced its Dice on AMOS from 36.5 to 1.0. We argue that a missing organ should be treated as unresolved rather than absent and propose Existence-aware Self-Training (ExiST). It builds pseudo-labels by leave-one-out consensus of independently trained networks, screens them with a quality gate on validation scans, and infers, per scan and per organ, whether the organ was found. For every unresolved organ, the background voxels of that scan receive the set-valued target, trained with a marginal cross-entropy that accepts either answer and a Dice term that skips uncertain voxels. We show that this loss never pushes a candidate organ toward absence and never favors one member of the set, which leaves the decision to labeled evidence. ExiST outperforms the current state-of-the-art methods and reaches 77.1 mean Dice on Synapse with 20% labeled scans and 75.9 on AMOS with 5% labeled scans.
Figures & tables
| Method | Avg. | Avg. | Dice (%) of each class | |||||||||||||
| Dice | ASD | Sp | RK | LK | Ga | Es | Li | St | Ao | IVC | PSV | Pa | RAG | LAG | ||
| V-Net (fully supervised) [ 37 ] | 62.09 ±1.2 | 10.28 ±3.9 | 84.6 | 77.2 | 73.8 | 73.3 | 38.2 | 94.6 | 68.4 | 72.1 | 71.2 | 58.2 | 48.5 | 17.9 | 29.0 | |
| General | UA-MT [ 57 ] | 20.26 ±2.2 | 71.67 ±7.4 | 48.2 | 31.7 | 22.2 | 0.0 | 0.0 | 81.2 | 29.1 | 23.3 | 27.5 | 0.0 | 0.0 | 0.0 | 0.0 |
| URPC [ 33 ] | 25.68 ±5.1 | 72.74 ±15.5 | 66.7 | 38.2 | 56.8 | 0.0 | 0.0 | 85.3 | 33.9 | 33.1 | 14.8 | 0.0 | 5.1 | 0.0 | 0.0 | |
| CPS [ 9 ] | 33.55 ±3.7 | 41.21 ±9.1 | 62.8 | 55.2 | 45.4 | 35.9 | 0.0 | 91.1 | 31.3 | 41.9 | 49.2 | 8.8 | 14.5 | 0.0 | 0.0 | |
| SS-Net [ 54 ] | 35.08 ±2.8 | 50.81 ±6.5 | 62.7 | 67.9 | 60.9 | 34.3 | 0.0 | 89.9 | 20.9 | 61.7 | 44.8 | 0.0 | 8.7 | 4.2 | 0.0 | |
| Method | Avg. | Avg. | Dice (%) of each class | |||||||||||||||
| Dice | ASD | Sp | RK | LK | Ga | Es | Li | St | Ao | IVC | Pa | RAG | LAG | Du | Bl | P/U | ||
| V-Net (fully supervised) [ 37 ] | 76.50 | 2.01 | 92.2 | 92.2 | 93.3 | 65.5 | 70.3 | 95.3 | 82.4 | 91.4 | 85.0 | 74.9 | 58.6 | 58.1 | 65.6 | 64.4 | 58.3 | |
| General | UA-MT [ 57 ] | 42.16 | 15.48 | 59.8 | 64.9 | 64.0 | 35.3 | 34.1 | 77.7 | 37.8 | 61.0 | 46.0 | 33.3 | 26.9 | 12.3 | 18.1 | 29.7 | 31.6 |
| URPC [ 33 ] | 44.93 | 27.44 | 67.0 | 64.2 | 67.2 | 36.1 | 0.0 | 83.1 | 45.5 | 67.4 | 54.4 | 46.7 | 0.0 | 29.4 | 35.2 | 44.5 | 33.2 | |
| CPS [ 9 ] | 41.08 | 20.37 | 56.1 | 60.3 | 59.4 | 33.3 | 25.4 | 73.8 | 32.4 | 65.7 | 52.1 | 31.1 | 25.5 | 6.2 | 18.4 | 40.7 | 35.8 | |
| SS-Net [ 54 ] | 33.88 | 54.72 | 65.4 | 68.3 | 69.9 | 37.8 | 0.0 | 75.1 | 33.2 | 68.0 | 56.6 | 33.5 | 0.0 | 0.0 | 0.0 | 0.2 | 0.2 | |
| Variant | Dice | ASD | Tail |
| (a) Foundation only, no self-training | 74.23 ±0.7 | 2.70 ±0.2 | 63.1 |
| (b) (a) + consensus, no relaxation | 75.20 ±0.6 | 2.76 ±0.0 | 63.9 |
| (c) (b) + LDR only † | 75.77 ±0.5 | 2.68 ±0.2 | 64.8 |
| (d) (b) + MOR only † | 72.83 ±0.9 | 6.71 ±0.8 | 66.2 |
| (e) (b) + LDR + MOR, standard Dice † | 73.53 ±1.0 | 3.05 ±0.7 | 63.8 |
| (f) Full † | 73.67 ±0.6 | 5.79 ±1.3 | 66.3 |
| Pseudo-labeler | Dice | Useful:harm. | Ga Dice |
| EMA teacher, hard labels | |||
| Consensus + LDR + MOR (ours) | n/a |