SHAPE: Structure-aware Hierarchical Unsupervised Domain Adaptation with Plausibility Evaluation for Medical Image Segmentation
Authors: Linkuan Zhou, Yinghao Xia, Yufei Shen, Xiangyu Li, Wenjie Du, Cong Cong, Leyi Wei, Ran Su, +1 more
Organizations: School of Software, Northwestern Polytechnical University · School of Computer Science and Technology, Harbin Institute of Technology · School of Software Engineering, USTC · Australian Institute of Health Innovation, Macquarie University · Faculty of Applied Science, Macao Polytechnic University · School of Computer Software, Tianjin University
Unsupervised Domain Adaptation (UDA) is essential for deploying medical segmentation models across diverse clinical environments. Existing methods are fundamentally limited, suffering from semantically unaware feature alignment that results in poor distributional fidelity and from pseudo-label validation that disregards global anatomical constraints, thus failing to prevent the formation of globally implausible structures. To address these issues, we propose SHAPE (Structure-aware Hierarchical Unsupervised Domain Adaptation with Plausibility Evaluation), a framework that reframes adaptation towards global anatomical plausibility. Built on a DINOv3 foundation, its Hierarchical Feature Modulation (HFM) module first generates features with both high fidelity and class-awareness. This shifts the core challenge to robustly validating pseudo-labels. To augment conventional pixel-level validation, we introduce Hypergraph Plausibility Estimation (HPE), which leverages hypergraphs to assess the global anatomical plausibility that standard graphs cannot capture. This is complemented by Structural Anomaly Pruning (SAP) to purge remaining artifacts via cross-view stability. SHAPE significantly outperforms prior methods on cardiac and abdominal cross-modality benchmarks, achieving state-of-the-art average Dice scores of 90.08% (MRI->CT) and 78.51% (CT->MRI) on cardiac data, and 87.48% (MRI->CT) and 86.89% (CT->MRI) on abdominal data. The code is available at https://github.com/BioMedIA-repo/SHAPE.
Table 1: Quantitative comparison of different methods on the cardiac dataset. The best values are highlighted in bold , and the second-best are underlined .
Method
Abdominal MRI → Abdominal CT
Abdominal CT → Abdominal MRI
DSC(%) ↑
ASD(mm) ↓
DSC(%) ↑
ASD(mm) ↓
LIV
RK
LK
SPL
Avg
LIV
RK
LK
SPL
Avg
LIV
RK
LK
SPL
Avg
LIV
RK
LK
SPL
Avg
Supervised
90.59
93.78
91.82
92.43
92.16
2.45
1.16
0.96
1.85
1.61
89.51
90.35
89.26
91.63
90.19
2.18
1.83
1.16
2.24
1.85
W/o adaptation
39.36
26.14
42.46
52.36
40.08
32.16
18.11
25.31
35.26
27.71
35.14
48.26
33.51
49.25
41.54
31.51
22.62
13.16
34.63
25.48
CycleGAN [ 51 ]
81.94
83.12
81.38
80.88
81.83
12.63
8.51
5.19
16.06
10.60
84.31
84.37
79.48
81.06
82.31
6.38
4.78
10.55
15.70
9.35
AdaptSegNet [ 34 ]
80.07
84.45
82.17
83.03
82.43
9.97
5.68
6.19
19.22
10.27
82.34
86.55
75.92
90.00
83.70
7.94
10.15
7.29
4.40
7.45
Table 2: Quantitative comparison of different methods on the abdominal dataset. The best values are highlighted in bold , and the second-best are underlined .
Figure 2: Qualitative results of SHAPE and typical methods. Yellow arrows indicate areas where SHAPE outperforms competing methods.
Figure 3: (a) Feature distribution before adaptation. (b) Feature distribution after adaptation by AdaIN. (c) Feature distribution after adaptation by HFM.
Configuration
Modules
MRI → CT
CT → MRI
HFM
HPE
SAP
DSC ↑
ASD ↓
DSC ↑
ASD ↓
(a) Baseline
82.02
4.63
71.58
6.86
Individual Component Contributions
(b) Baseline + HFM
✓
85.67
3.43
75.46
5.36
(c) Baseline + HPE
✓
82.71
4.83
72.09
6.49
Combined Component Contributions
Table 3: Ablation study of the core components of SHAPE on the cardiac dataset. We evaluate the individual and combined contributions of our main modules over a strong baseline. The best results are highlighted in bold .
Figure 4: Comparison of the effectiveness of different feature modulation methods. Take the class inside the red dotted line as an example.
Figure 5: Hyperparametric sensitivity analysis of all adaptation segmentation tasks. The vertical axis is the mean Dice scores (%) of all classes.
Domain shift remains a major obstacle to the reliable deployment of machine learning models in high-stakes environments such as healthcare. While Domain adaptation aims to mitigate these effects, existing approaches suffer from limited expressiveness of latent representations and a reliance on handcrafted, static augmentations. In this work, we address these limitations by proposing a novel deep learning architecture for Unsupervised Domain Adaptation (UDA), specifically optimized for medical image segmentation. Our framework, ADualVUOT, integrates a dual-encoder Variational Autoencoder (VAE) with Continuous Normalizing Flows (CNFs) to increase modeling flexibility and posterior expressiveness. To achieve domain alignment, we leverage Unbalanced Optimal Transport (UOT) through the Gaussian-Gromov-Wasserstein (GGW) distance, which handles structural and topological discrepancies between domains. Furthermore, we incorporate an adversarial augmentation scheme to synthesize worst-case compositions, thus enhancing model robustness. Extensive experiments on medical imaging benchmarks show significant gains over prior OT-based approaches.
Evangelia Koskinioti, Yi Shen, Georgios Stamou +1
Department of Electrical and Computer Engineering, Duke University, NC, USA · Department of Mechanical Engineering, Duke University, NC, USA · Department of Electrical and Computer Engineering, National Technical University of Athens, Athens, Greece.
Source Free Unsupervised Domain Adaptation (SFUDA) is critical for deploying deep learning models across diverse clinical settings. However, existing methods are typically designed for low-gap, specific domain shifts and cannot generalize into a unified, multi-modalities, and multi-target framework, which presents a major barrier to real-world application. To overcome this issue, we introduce Tell2Adapt, a novel SFUDA framework that harnesses the vast, generalizable knowledge of the Vision Foundation Model (VFM). Our approach ensures high-fidelity VFM prompts through Context-Aware Prompts Regularization (CAPR), which robustly translates varied text prompts into canonical instructions. This enables the generation of high-quality pseudo-labels for efficiently adapting the lightweight student model to target domain. To guarantee clinical reliability, the framework incorporates Visual Plausibility Refinement (VPR), which leverages the VFM's anatomical knowledge to re-ground the adapted model's predictions in target image's low-level visual features, effectively removing noise and false positives. We conduct one of the most extensive SFUDA evaluations to date, validating our framework across 10 domain adaptation directions and 22 anatomical targets, including brain, cardiac, polyp, and abdominal targets. Our results demonstrate that Tell2Adapt consistently outperforms existing approaches, achieving SOTA for a unified SFUDA framework in medical image segmentation. Code are avaliable at https://github.com/derekshiii/Tell2Adapt.
Yulong Shi, Shijie Li, Ziyi Li +1
College of Medicine and Biological Information Engineering, Northeastern University · Engineering Research Center of Medical Imaging and Intelligent Analysis, Ministry of Education · Key Laboratory of Medical Image Computing, Ministry of Education, Northeastern University
Domain shift across imaging modalities and acquisition sites remains a significant barrier to the clinical deployment of segmentation models. Source-free unsupervised domain adaptation (SFUDA) addresses this by adapting a pretrained model to an unlabeled target domain without requiring access to sensitive source data. We introduce a novel SFUDA framework built on Symmetrical Flow Matching, a unified generative model that segments an input image and synthesizes a source-like image from a mask within the same learned flow. By initializing inference from a domain-agnostic Gaussian origin, the model preserves structural consistency across domains and grounds predictions in learned anatomy rather than shifted texture statistics. Our pipeline leverages this symmetry to generate reliable pseudo-labels and corresponding source-like synthetic images from unlabeled target data, creating a generative replay buffer that anchors source knowledge during a generative self-training stage that fine-tunes on a joint set of real target and synthetic source-like images. We evaluate on abdominal multi-organ and cardiac segmentation, covering cross-modality MRI<->CT shifts, and multi-site prostate segmentation. Our approach outperforms SFUDA baselines and is competitive with conventional UDA methods.
Tal Grossman, Noa Cahan, Hayit Greenspan
Faculty of Engineering, Tel Aviv University, Tel Aviv, Israel