Dissecting Model Failures in Abdominal Aortic Aneurysm Segmentation through Explainability-Driven Analysis
Organizations: University of Texas at San Antonio · Drexel University · Northwestern University
Abstract
Computed tomography image segmentation of complex abdominal aortic aneurysms (AAA) often fails because the models assign internal focus to irrelevant structures or do not focus on thin, low-contrast targets. Where the model looks is the primary training signal, and thus we propose an Explainable AI (XAI) guided encoder shaping framework. Our method computes a dense, attribution-based encoder focus map ("XAI field") from the final encoder block and uses it in two complementary ways: (i) we align the predicted probability mass to the XAI field to promote agreement between focus and output; and (ii) we route the field into a lightweight refinement pathway and a confidence prior that modulates logits at inference, suppressing distractors while preserving subtle structures. The objective terms serve only as control signals; the contribution is the integration of attribution guidance into representation and decoding. We evaluate clinically validated challenging cases curated for failure-prone scenarios. Compared to a base SAM setup, our implementation yields substantial improvements. The observed gains suggest that explicitly optimizing encoder focus via XAI guidance is a practical and effective principle for reliable segmentation in complex scenarios.
Figures & tables
| Model | IoU (%) | Dice (%) | HD95 (mm) |
|---|---|---|---|
| Outer Wall | |||
| U–Net [ 26 ] | 68.81 | 77.21 | 14.98 |
| U–Net++ [ 39 ] | 68.23 | 78.13 | 22.15 |
| MedSAM [ 17 ] | 77.97 | 85.58 | 6.30 |
| nnU-Net [ 8 ] | 80.26 | 86.62 | 6.87 |
| SAM baseline [ 12 ] | 81.53 | 88.99 | 4.09 |
| Model | IoU (%) | Dice (%) | HD95 (mm) |
|---|---|---|---|
| Outer Wall | |||
| U–Net [ 26 ] | 65.14 | 74.15 | 17.98 |
| U–Net++ [ 39 ] | 65.58 | 76.20 | 23.74 |
| MedSAM [ 17 ] | 69.82 | 79.73 | 9.72 |
| nnU-Net [ 8 ] | 76.53 | 84.22 | 10.05 |
| SAM baseline [ 12 ] | 78.43 | 86.83 | 5.49 |
| Comp. | Outer Wall | Lumen | ||||||
|---|---|---|---|---|---|---|---|---|
| S | X | A | IoU | Dice | HD95 | IoU | Dice | HD95 |
| 78.4 | 86.8 | 5.4 | 82.1 | 89.6 | 2.6 | |||
| 92.9 | 96.2 | 0.4 | 91.3 | 95.4 | 0.6 | |||
| 93.3 | 96.4 | 0.6 | 90.0 | 94.6 | 1.0 | |||
| 94.7 | 97.1 | 0.2 | 93.8 | 96.7 | 0.6 | |||
| 95.0 | 97.3 | 0.3 | 94.6 | 97.1 | 0.5 | |||
Image Segmentation
Image segmentation assigns pixels or voxels to objects and regions, supporting measurement, scene understanding, and decisions across image domains.
See all 399 papers