ProtoCouncil: Multi-Encoder Anatomical Prototypes for Prostate Cancer Detection in Micro-Ultrasound
Organizations: The University of British Columbia, Vancouver, BC, Canada. · Vector Institute, Toronto, ON, Canada. · Queen’s University, Kingston, ON, Canada. · ProUro, Berlin, Germany. ·
Abstract
Purpose: Micro-ultrasound (US) is a promising modality for prostate cancer (PCa) detection, but identifying suspicious tissue depends heavily on clinical experience. Models trained on sparse, noisy core-level pathology offer little insight into their decisions and can fail under domain shift. Clinical use needs a traceable decision process and a flag for uncertain predictions. Methods: We introduce ProtoCouncil, in which three foundation encoders (MedSAM, DINOv3 and V-JEPA 2.1) learn case-based prototypes at three anatomical levels: whole gland, needle track and gland sectors. Prototypes are projected onto real training-core regions, and label-free fusion keeps every class logit as a bias plus an exact sum of prototype similarity contributions. Encoder disagreement triggers selective prediction. Results: In five-fold patient-level cross-validation (6,588 cores, 693 patients), ProtoCouncil reaches 82.9% AUROC for clinically significant PCa (csPCa, Grade Group 3), 4.3 points above the best previously published method. In zero-shot evaluation on two external cohorts, ProtoCouncil achieves higher all-cancer and csPCa AUROC than all previous methods. Nearest same-class exemplars match test-core tumor involvement better than random same-class cases. Externally, csPCa accuracy falls from 79% when encoders agree to 27% when two oppose the fused call. Abstaining on disagreement raises balanced accuracy by 7 and 15 points, while retaining 58% and 54% of the cores. Conclusion: ProtoCouncil grounds core-level predictions in exact similarity-based evidence from real, anatomically indexed training cases, which makes its reasoning interpretable. It achieves the highest csPCa AUROC across three cohorts and identifies unreliable predictions through encoder disagreement.
Figures & tables
| Cohort | Sites | Biopsy | Patients | Cores | Benign | GG1–2 | GG 3 | csPCa patients |
| A | 5 | Sys., TR | 693 | 6,588 | 5,709 (86.7%) | 480 (7.3%) | 399 (6.1%) | 117 |
| B | 2 | Sys. + targ., TR | 111 | 1,460 | 982 (67.3%) | 364 (24.9%) | 114 (7.8%) | 28 |
| C | 1 | Sys. + targ., TP | 42 | 558 | 433 (77.6%) | 105 (18.8%) | 20 (3.6%) | 6 |
| All | High-inv. | csPCa | Patient | ||||
| Method | AUROC | Sens@80 | AUROC | AUROC | Sens@60 | Sens@80 | AUROC |
| Cohort A (development, five-fold cross-validation) | |||||||
| MedSAM-UNETR Alzate-Grisales et al. (2023) | |||||||
| MedSAM-FT Ma et al. (2024) | |||||||
| MicroSegNet Jiang et al. (2024) | |||||||
| ProstNFound Wilson et al. (2024) | |||||||
| Cohort A (70%) | Cohort B (58%) | Cohort C (54%) | ||||
| BAcc | AUROC | BAcc | AUROC | BAcc | AUROC | |
| No abstention | ||||||
| Prost-RL Abootorabi et al. (2026) | 71.2 | 78.6 | 68.0 | 75.4 | 54.3 | 65.1 |
| ProtoCouncil (ours) | 74.1 | 82.9 | 72.4 | 80.0 | 70.3 | 79.5 |
| Abstention | ||||||
| Prost-RL, confidence | 77.6 | 81.9 | 76.2 | 81.4 | 70.4 | 81.9 |
Medical Imaging
Medical imaging uses computational methods to analyze, reconstruct, and interpret images for diagnosis, treatment planning, and monitoring.
See all 267 papers