ProFound: A moderate-sized vision foundation model for multi-task prostate imaging
Authors: Yipei Wang, Yinsong Xu, Weixi Yi, Shaheer Ullah Saeed, Natasha Thorley, Alexander Ng, Yukun Zhou, Wen Yan, +6 more
Organizations: UCL Hawkes Institute, University College London, London, UK · Department of Medical Physics and Biomedical Engineering, University College London, London, UK · School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, China · Centre for Bioengineering, Queen Mary University of London, London, UK · School of Engineering and Materials Science, Queen Mary University of London, London, UK · Digital Environment Research Institute, Queen Mary University of London, London, UK · Centre for Medical Imaging, University College London, London, UK · Department of Radiology, University College London Hospital NHS Foundation Trust, London, UK · Centre for Urology Imaging, Prostate, AI and Surgical Studies (COMPASS) Research Group, Division of Surgery and Interventional Science, University College London, London, UK · Division of Surgery and Interventional Science, University College London, London, UK · Institute of Ophthalmology, University College London, London, UK · Department of Urology, University College London Hospital, London, UK · Department of Urology, Comprehensive Cancer Center, Medical University of Vienna, Vienna, Austria · Department of Computer Science, University College London, London, UK
Many diagnostic and therapeutic clinical tasks for prostate cancer increasingly rely on multi-parametric MRI. Automating these tasks is challenging because they necessitate expert interpretations, which are difficult to scale to capitalise on modern deep learning. Although modern automated systems achieve expert-level performance in isolated tasks, their general clinical utility remains limited by the requirement of large task-specific labelled datasets. In this paper, we present ProFound, a domain-specialised vision foundation model for volumetric prostate mpMRI. ProFound is pre-trained using several variants of self-supervised approaches on a diverse, multi-institutional collection of 5,000 patients, with a total of over 22,000 unique 3D MRI volumes (over 1,800,000 2D image slices). We conducted a systematic evaluation of ProFound across a broad spectrum of 11 downstream clinical tasks on over 3,000 independent patients, including prostate cancer detection, Gleason grading, lesion localisation, gland volume estimation, zonal and surrounding structure segmentation. Experimental results demonstrate that finetuned ProFound consistently outperforms or remains competitive with state-of-the-art specialised models and existing medical vision foundation models trained/finetuned on the same data.
Figures & tables
Figure 1: Overview of the proposed prostate mpMRI foundation model.
Task name
Description
Dataset
Subtask
Cat.
PIRADS-Cls
Automating radiologist task by predicting
ReIMAGINE
PIRADS ≤3 , 3, 4, 5
mul-Cls
PIRADS score
-Risk
PIRADS <3 vs. ≥3
bin-Cls
PIRADS ≤3 vs. >3
bin-Cls
Grading-Cls
Predicting Gleason Grade Group on patients
PROMIS
GG ≤6 ,3+4,4+3,8,>8
mul-Cls
with MR-positive lesions
GG ≤3+4 vs. ≤6
bin-Cls
GG ≤4+3 vs. ≤3+4
bin-Cls
Table 1: Description of ProFound downstream tasks and extended analysis. Cat. = Category, Cls = classification, Seg = segmentation, Reg = regression, Loc = localisation, mul = multi-class, bin = binary, GG = Gleason group, FM = Foundation model
Figure 2: Performance on representative downstream tasks. ProFound achieves the highest Dice scores on both lesion segmentation tasks, while remaining comparable to SOTA specialised models on anatomy segmentation and prostate volume regression. ProFound shows a clear advantage in limited-label settings, demonstrating strong data efficiency. We also include a challenging task where ProFound provides more nuanced gains.
PIRADS-Cls
Grading-Cls
Cls
PCa-Loc
Loc
QWK
AUC
Spec
Sens
QWK
AUC
Spec
Sens
Params
AUC
Spec
Sens
Params
Baseline
0.207
73.2
50.0
49.1
-0.002
59.1
35.4
22.4
33.3
61.3
41.4
25.0
4.8
ViT
0.224
72.1
36.1
56.1
-0.035
47.4
20.8
13.2
123.0
60.5
41.3
26.2
136.3
ConvNeXt
0.010
59.7
38.9
22.2
0.087
59.6
39.6
21.9
29.5
62.4
43.2
30.0
39.5
RadFM
-0.002
73.4
47.2
62.6
0.013
55.7
25.0
18.9
66.4
60.3
38.5
22.7
79.6
RadDiag
0.076
73.3
55.6
54.4
0.147
72.0
47.9
50.4
33.3
63.5
42.7
27.0
119.4
Table 2: Performance comparison for PIRADS score classification, Gleason grade group classification, and localised cancer detection task. Spec = Specificity at 80% sensitivity; Sens = Sensitivity at 80% specificity, + denotes ProFound with frozen encoder (linear probing). The baseline model is ResNet18 for PIRADS-Cls and Grading-Cls tasks, and UNet for the PCa-Loc localisation task. The unit for the number of updated parameters is million.
Prostate cancer claims a life every 80 seconds. Early detection is needed to prevent disease progression, and both PSA density calculation and biopsy decisions rely on knowing the exact boundary of the gland. Conventional ultrasound at 6-12 MHz blurs this boundary, missing one in three high-risk cancers. Micro-ultrasound (29 MHz) improves resolution threefold but introduces dense acoustic speckle that obscures the outer wall; given the same image, two clinicians draw outlines differing by over 10% in area. Supervised methods are costly and generalise poorly across scanners. Can a foundation model segment the prostate with no training data? We present the first zero-shot pipeline for this modality: MedSAM, pre-trained on over 1.5 million medical images, localises the prostate; we then apply CLAHE to sharpen the outer wall, binary dilation to recover missed pixels, and Fourier smoothing (4 modes, s=1.05) to refine the boundary. MedSAM requires a spatial prompt, so we evaluate bounding-box and point-click strategies across 75 patients of the Micro-Ultrasound Prostate Segmentation dataset (2,621 slices). On the 20-patient held-out test set, the pipeline reduces mean boundary-distance error by 45% (Dice 0.749+/-0.043 to 0.865+/-0.029; HD95 217.2+/-36.9 to 120.1+/-26.1 px), reaching Dice 0.859 across the cohort. Its mean overlap shows no significant difference from the three non-expert rater groups (p>0.19), while segmenting 38-52% more consistently (lower inter-patient standard deviation). Point-click prompts fail regardless of placement (best Dice=0.350), because speckle gives no stable local contrast. Only an approximate bounding box is required, so any clinic can deploy it without data collection, annotation, or retraining.
Accurate segmentation of the prostate gland in multiparametric MRI (mpMRI) is a fundamental step for a wide range of clinical and research applications, including image registration, volume estimation, and radiomic analysis. However, manual delineation is time-consuming and subject to inter-observer variability, while general-purpose segmentation tools often fail to provide sufficient accuracy for prostate-specific tasks. In this work, we propose a dedicated deep learning-based approach for automatic prostate gland segmentation using the nnU-Net v2 framework. The model leverages multimodal mpMRI data, including T2-weighted imaging, diffusion-weighted imaging (DWI), and apparent diffusion coefficient (ADC) maps, to exploit complementary tissue information. Training was performed on 981 cases from the PI-CAI dataset using whole-gland annotations, and model performance was assessed through 5-fold cross-validation and external validation on an independent cohort of 54 patients from Hospital La Fe. The proposed model achieved a mean Dice score of 0.96 +/- 0.00 in cross-validation and 0.82 on the external test set, demonstrating strong generalization despite domain shift. In comparison, a general-purpose approach (TotalSegmentator) showed substantially lower performance, with a Dice score of 0.15, primarily due to under-segmentation of the gland. These results highlight the importance of task-specific, multimodal segmentation strategies and demonstrate the potential of the proposed approach for reliable integration into clinical research workflows. To facilitate reproducibility and deployment, the model has been fully containerized and is available as a ready-to-use inference tool.
Pablo Rodriguez-Belenguer, Gloria Ribas, Javier Aquerreta Escribano +3
Biomedical Imaging Research Group (GIBI230), Instituto de Investigación Sanitaria La Fe, Valencia, Spain
Micro-ultrasound (μUS) is a new, emerging, and promising imaging modality for prostate cancer (PCa) detection, but accurate identification of suspicious tissue remains highly dependent on clinical experience, leading to substantial inter-observer variability. Machine-learning assistance can reduce this variability; however, training reliable deep models is challenging because supervision is sparse and noisy -- typically limited to core-level histopathology outcomes (e.g., cancer grade and its percentage in a biopsy core) without pixel-level lesion annotations and under severe class imbalance. We introduce Prost-RL, which reframes μUS PCa detection as a spatially aware, policy-driven inference problem by learning where to look before decoding. Prost-RL integrates a lightweight reinforcement-learning policy into a foundation-model encoder-decoder to generate interpretable spatial attention maps that act as soft prompts for both cancer-likelihood heatmap prediction and image-level classification. We further propose Adaptive Policy Optimization (APO) to stabilize hybrid supervised-RL training and a noise-robust objective combining symmetric cross-entropy with negative-entropy regularization to mitigate weak-label noise and encourage sharp localization. On a cohort of 6,607 biopsy cores from 693 patients across five clinical sites, Prost-RL achieves 79.0±3.5 AUROC with 64.6±6.3% sensitivity at 80% specificity for core-level detection (+2.1 AUROC and +4.5 sensitivity points over the strongest baseline), and 79.3±5.8 AUROC for clinically significant cancer classification. The learned policy highlights biopsy-aligned regions, providing transparent, spatially grounded evidence alongside quantitative risk predictions. Code is available at: https://github.com/DeepRCL/Prost-RL.
Mohammad Mahdi Abootorabi, Sina Namazi, Armin Saadat +7
The University of British Columbia, Vancouver, BC, Canada · Vector Institute, Toronto, ON, Canada · Queen’s University, Kingston, ON, Canada +1