Organizations: Center for AI and Data Science (CAIDAS), Julius-Maximilians-Universität Würzburg, Würzburg, Germany · Institute for Computational Imaging and AI in Medicine (CompAI), Technical University of Munich, Munich, Germany · Pattern Recognition Lab, Friedrich-Alexander Universität Erlangen-Nürnberg, Erlangen, Germany · Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
Transvaginal ultrasound (TVUS) and magnetic resonance imaging (MRI) provide complementary information for endometriosis image analysis, yet existing studies mainly focus on single-modality analysis or disease classification, leaving cross-modal ovarian segmentation largely unexplored. In this work, to tackle the increased difficulty of ovary segmentation in MRI due to ovaries' small target size and ambiguous boundaries with surrounding pelvic structures, we propose a dual branch framework for ovary segmentation across TVUS and MRI. More specifically, by adapting MedSAM3 with TVUS-derived prototype bank, we aim to align anatomically consistent feature representations across both modalities. Extensive experiments are conducted on endometriosis-related TVUS and MRI datasets. We observe quantitative and qualitative improvements of over 5 percentage points for the proposed dual-branch approach compared with multiple state-of-the-art methods. Furthermore, our ablation study shows the contribution of individual components such as the prototype bank and the importance of warm-up pretraining in the source TVUS domain.
Figures & tables
Figure 1: Overview of our cross-modal prototype-contrastive learning framework. Unpaired TVUS and MRI images are encoded in a shared representation space, where prototype contrastive learning promotes cross-modal anatomical consistency.
Figure 2: Performance comparison between proposed methods and baselines on MRI ovary segmentation. The best performance is bold. “FT” refers to the fully supervised LoRA finetuning on the MRI dataset. “Ours” denotes the proposed dual-branch approach with a MedSAM3 backbone.
Figure 3: Qualitative comparison of ovary segmentation results on MRI. Each row corresponds to one testing case, and the columns show the ground truth (GT) and segmentation results from different methods. "FT" denotes fine-tuning. The red dashed box indicates the valid evaluation region, with predictions outside it ignored during training and evaluation.
Warm-up phase
With
TVUS
MRI
Epoch(s)
Bank
mDice
mAP
✓
3
✓
61.02 ± 3.40
27.28 ± 0.98
✓
3
57.74 ± 4.19
28.37 ± 1.52
✓
✓
3
✓
17.92 ± 2.46
6.45 ± 2.25
0
✓
45.96 ± 5.49
24.92 ± 1.58
✓
5
✓
50.86 ± 6.70
27.63 ± 0.53
Table 1: Performance comparison about different prototype bank and warm-up setting. First 2 columns indicate which branch has been activated in the warm-up phase. All of the experiments use MedSAM3 as backbone model. The best performance of each metric is in bold , second best underlined .
λ
α
Value
mDICE
mAP
Value
mDICE
mAP
0.005
58.82±5.22
27.19±0.84
0.75
57.96±11.14
26.61±1.64
0.010
57.23±7.99
26.09±1.31
0.80
59.42±5.36
27.77±0.81
0.015
61.02±3.40
27.28±0.98
0.85
59.56±9.03
25.13±1.43
0.020
59.07±5.24
26.70±1.77
0.90
59.31±7.21
28.04±1.27
0.025
56.51±10.37
26.35±2.86
0.95
61.02±3.40
27.28±0.98
Table 2: Sensitivity analysis about key parameters. λ indicates the contrastive loss weight, while α denotes the EMA momentum for updating the TVUS prototype. The best performance of each metric is in bold .
Cross-modality medical image segmentation labels anatomy and disease across imaging types despite differences in appearance, resolution, and available annotations.
Multi-structure segmentation of the uterus is important for computer-assisted screening, diagnosis, and treatment planning of uterine diseases, where ultrasound and MRI provide complementary clinical information. However, developing a unified model across these modalities is challenging due to their substantially different image appearances, anatomical contexts, spatial resolutions, and label spaces. Moreover, existing datasets often define different segmentation targets, making joint learning challenging and potentially leading to negative transfer across heterogeneous tasks. To this end, we propose a Topology-informed Prompt-conditioned Universal Segmentation (TPUS) framework for segmenting multiple uterine structures across ultrasound and MRI. TPUS introduces a graph-based multi-dataset backbone comprising modality-specific stems and a modality-shared graph-based encoder-decoder to support modality-sensitive input adaptation, structural feature reasoning, and joint representation learning across heterogeneous uterine segmentation tasks. In addition, TPUS uses task-aware class prompts to condition the segmentation process for different datasets and label spaces, a dynamic convolutional adaptation module to generate task-specific output responses, and a topology-informed loss to encourage anatomically consistent predictions. Experiments on a uterine ultrasound dataset and a T2-weighted uterine myoma MRI dataset demonstrate that TPUS achieves Dice scores of 0.898 and 0.693 on the two held-out test sets, respectively, outperforming several generic and universal segmentation baselines. Source code can be accessed at https://github.com/YonghengSun1997/TPUS.
Yongheng Sun, Yuexi Gu, Jingwen Sun +2
Department of Radiology and BRIC, UNC at Chapel Hill, Chapel Hill, NC 27599, USA
Ovarian cancer is the deadliest gynecological malignancy; accurate and objective segmentation of adnexal masses and functional ovaries in ultrasound (US) remains challenging due to operator variability and morphological complexity. We present OvAi Focus (SynDiag s.r.l., Italy), a stand-alone AI software medical device that performs multi-class semantic segmentation of functional ovaries and adnexal masses, distinguishing cystic from solid components. The system was trained and independently validated on a multicenter dataset of 1,081 adult women from 6 centers across Italy and Israel. Segmentation achieved DICE scores of 0.87 (complete lesion), 0.85 (cystic), 0.68 (solid), and 0.62 (functional ovary), in line with or superior to state-of-the-art approaches across heterogeneous acquisition settings.
Niccolò Tallone, Francesca Salis, Pio Raffaele Fina +13
SynDiag s.r.l., Turin, Italy · Academic Division of Gynecology and Obstetrics, University of Turin, Azienda Ospedaliera Ordine Mauriziano, Turin, Italy · University of Turin +5
Robust medical image segmentation across imaging modalities is challenging because of large differences in appearance and intensity distributions. Models trained on a single modality often show substantial performance drops when applied to unseen domains. In this work, we develop a unified 3D pancreas segmentation framework that applies domain-adversarial learning to 4,604 heterogeneous CT and MRI scans to learn anatomical representations. A shared nnU-Net encoder-decoder is trained for whole-pancreas segmentation, with a latent domain discriminator encouraging CT-MRI feature alignment. The learned encoder is subsequently transferred to pancreatic head-body-tail segmentation using limited MRI-only subregion annotations. An average Dice score of 87.31% on the in-distribution test set and Dice scores ranging from 84.20% to 88.09% across external OOD datasets were achieved in whole pancreas segmentation. Dice scores of 80.53% on MRI and 83.05% on CT were achieved for downstream subregion segmentation, without using CT subregion annotations. These results demonstrate that a unified anatomical representation can support both cross-modality pancreas segmentation and label-efficient downstream transfer.
Ziliang Hong, Hongyi Pan, Halil Ertugrul Aktas +7
Department of Radiology, Northwestern University, Chicago, IL, USA · Division of Gastroenterology and Hepatology, Mayo Clinic Florida, Jacksonville, FL, USA · Department of Gastroenterology and Hepatology, Northwestern University, Chicago, IL, USA