GUIDE-US: Grade-Informed Unpaired Distillation of Encoder Knowledge from Histopathology to Micro-UltraSound
Authors: Emma Willis, Tarek Elghareb, Paul F. R. Wilson, Minh Nguyen Nhat To, Mohammad Mahdi Abootorabi, Amoon Jamzad, Brian Wodlinger, Parvin Mousavi, +1 more
Organizations: Queen’s University, Kingston, Canada. · University of British Columbia, Vancouver, Canada∗. · Exact Imaging, Markham, Canada.
Purpose: Non-invasive grading of prostate cancer (PCa) from micro-ultrasound (micro-US) could expedite triage and guide biopsies toward the most aggressive regions, yet current models struggle to infer tissue micro-structure at coarse imaging resolutions. Methods: We introduce an unpaired histopathology knowledge-distillation strategy that trains a micro-US encoder to emulate the embedding distribution of a pretrained histopathology foundation model, conditioned on International Society of Urological Pathology (ISUP) grades. Training requires no patient-level pairing or image registration, and histopathology inputs are not used at inference. Results: Compared to the current state of the art, our approach increases sensitivity to clinically significant PCa (csPCa) at 60% specificity by 3.5% and improves overall sensitivity at 60% specificity by 1.2%. Conclusion: By enabling earlier and more dependable cancer risk stratification solely from imaging, our method advances clinical feasibility. Source code will be publicly released upon publication.
Figures & tables
Benign
ISUP 1
ISUP 2
ISUP 3
ISUP 4
ISUP 5
Total
5727
0
480
195
134
71
Table 1: Micro-US ISUP grade-group distribution (number of cores).
Benign
ISUP 1
ISUP 2
ISUP 3
ISUP 4
ISUP 5
Train
2083
1919
967
896
900
882
Val
260
240
121
111
112
110
Test
260
240
121
111
112
110
Table 2: PANDA ISUP distribution by split (number of WSIs).
Figure 1: Overview of the two-stage pathology-guided teacher-student framework for micro-US ISUP grading. In Stage 1 (top), a histopathology teacher model is trained on whole-slide images (WSIs) using attention-based multiple-instance learning (MIL) for aggregated patch embeddings and a multi-layer perceptron (MLP) for ISUP classification, with weights subsequently frozen. In Stage 2 (bottom), the micro-US student model undergoes multi-task training: an image encoder extracts the full image patches features, then the biopsy-region patches are aggregated via attention-based MIL into embeddings that are guided to match frozen pathology representations through contrastive knowledge distillation. Concurrently, an image decoder generates full-image cancer masks, enabling ROI isolation for weakly supervised segmentation guided by coarse histopathology reports.
Sens@40%Spec
Sens@60%Spec
Sens@80%Spec
Method
AUROC
Entropy
PCa
csPCa
PCa
csPCa
PCa
csPCa
SAM Kirillov et al. (2023)
69.2
8.4
76.2
73.1
67.0
65.4
52.5
44.6
MedSAM Kirillov et al. (2023)
73.5
8.1
80.8
79.9
71.6
72.2
57.1
51.4
ProTeUS Elghareb and Harmanani (2025)
76.0
7.4
85.4
87.2
76.2
79.5
61.7
58.7
ProstNFound+ Wilson et al. (2025)
77.9
7.32
89.4
92.1
79.1
82.5
64.5
60.2
Ours
78.4
6.78
89.3
92.6
80.3
86.0
64.7
64.3
Table 3: Quantitative results for micro-US models. AUROC, Entropy, and Sensitivity at multiple specificity operating points are reported as the mean across 5-fold cross-validation.
Figure 2: AUROC per ISUP grade group for biopsy-region features from the encoder, comparing our method (orange) to the ProstNFound+ baseline (blue).
Figure 3: Ablation studies. (a) Triplet loss vs. CLIP-style contrastive loss across key metrics. (b) Step-wise ablation of proposed components showing cumulative gain in Sens@60%Spec (csPCa) from the ProstNFound+ baseline. (c) Sensitivity to triplet-loss weight α (mean across folds) on Sens@60%Spec (csPCa).
Image Encoder
AUROC
Entropy
Sens@60%Spec
Sens@60%Spec (csPCa)
UNI-2
78.6
6.75
81.2
87.1
GigaPath
78.0
6.5
82.0
87.7
HistoSSLScaling
78.2
6.8
80.5
85.6
Table 4: Teacher robustness: swapping the pathology teacher encoder (same tiles, different feature extractors).
Figure 4: Qualitative comparison of cancer probability heatmaps between our method (top row) and the ProstNFound+ baseline (bottom row) on micro-US cases. The biopsy regions are overlaid on each image. The ground-truth ISUP grade and cancer involvement for each case are shown.
Unpaired cross-modal distillation transfers grade structure from histopathology into a micro-ultrasound (micro-US) encoder by aligning a pooled needle-region embedding to a frozen histopathology teacher under grade-group correspondence alone. A single objective is thereby required to serve two distinct functions: rendering patch features discriminative of tissue state, and selecting which patches enter the pooled representation. We decouple them. Weak spatial supervision derived from percentage involvement, recorded routinely at biopsy, constrains the predicted proportion of malignant tissue within each core, acting on the encoder features independently of the alignment objective. The alignment loss then operates on features that differ across a core, and attention concentrates on a subset of patches rather than remaining near-uniform. On 7,166 biopsy cores from 811 patients across seven centers under patient-level 5-fold cross-validation, the method reaches 67.1 macro AUC and 68.5 csPCa AUC, against 61.2 and 52.8 for the existing unpaired alignment method and 63.1 and 62.6 for the strongest unimodal baselines. Ablation against existing attention regularizers designed to prevent attention-uniformity collapse shows that such regularizers do not substitute for label-derived supervision: they constrain the attention distribution, whereas the signal required acts on the features that attention reads.
Obed Korshie Dzikunu, Emma Willis, Mohammad Mahdi Abootorabi +7
Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, Canada · Vector Institute, Toronto, Canada · School of Computing, Queen’s University, Kingston, Canada +3
Micro-ultrasound (μUS) is a new, emerging, and promising imaging modality for prostate cancer (PCa) detection, but accurate identification of suspicious tissue remains highly dependent on clinical experience, leading to substantial inter-observer variability. Machine-learning assistance can reduce this variability; however, training reliable deep models is challenging because supervision is sparse and noisy -- typically limited to core-level histopathology outcomes (e.g., cancer grade and its percentage in a biopsy core) without pixel-level lesion annotations and under severe class imbalance. We introduce Prost-RL, which reframes μUS PCa detection as a spatially aware, policy-driven inference problem by learning where to look before decoding. Prost-RL integrates a lightweight reinforcement-learning policy into a foundation-model encoder-decoder to generate interpretable spatial attention maps that act as soft prompts for both cancer-likelihood heatmap prediction and image-level classification. We further propose Adaptive Policy Optimization (APO) to stabilize hybrid supervised-RL training and a noise-robust objective combining symmetric cross-entropy with negative-entropy regularization to mitigate weak-label noise and encourage sharp localization. On a cohort of 6,607 biopsy cores from 693 patients across five clinical sites, Prost-RL achieves 79.0±3.5 AUROC with 64.6±6.3% sensitivity at 80% specificity for core-level detection (+2.1 AUROC and +4.5 sensitivity points over the strongest baseline), and 79.3±5.8 AUROC for clinically significant cancer classification. The learned policy highlights biopsy-aligned regions, providing transparent, spatially grounded evidence alongside quantitative risk predictions. Code is available at: https://github.com/DeepRCL/Prost-RL.
Mohammad Mahdi Abootorabi, Sina Namazi, Armin Saadat +7
The University of British Columbia, Vancouver, BC, Canada · Vector Institute, Toronto, ON, Canada · Queen’s University, Kingston, ON, Canada +1
Whole slide images (WSIs) provide rich diagnostic information for computational pathology, but their gigapixel scale, stain variation, scanner differences, tissue artifacts, and limited expert annotation make robust model training challenging. This paper presents a multi-source Masked Autoencoder (MAE) framework, named ProsMAE, for histopathology representation learning. Tiles from Prostate cANcer graDe Assessment (PANDA), CAncer MEtastases in LYmph nOdes challeNge 2017 (CAMELYON17), and BReAst Carcinoma Subtyping (BRACS) are used for ProsMAE pretraining to expose the encoder to diverse tissue morphology and acquisition conditions. The learned encoder is transferred for International Society of Urological Pathology (ISUP) grade classification through ProsCLS, using a frozen encoder and a linear classification head. ProsMAE achieved a higher mean validation quadratic weighted kappa (QWK) than the vanilla MAE frozen linear-probe baseline under the evaluated disjoint PANDA split. Repeated-split evaluation remains necessary to further establish robustness across split compositions.