q-bio.QMNov 15, 2026

Beyond AUC: Do Mammography Risk Models Predict When Cancer Occurs?

Authors: Svetlana Krasnova, Andrey Krylov, Dmitry Sorokin

Organizations: Faculty of Computational Mathematics and Cybernetics, Lomonosov Moscow State University, Moscow, Russia

Abstract

Longitudinal deep learning models for mammography-based breast cancer risk prediction output either per-year cumulative risks or a discrete distribution over the year of diagnosis, from which cumulative risks F1,...,F5 are derived. These models are evaluated almost exclusively with year-wise AUCs and the concordance index. We show that these metrics are largely insensitive to when cancer occurs: they can be high even for a model that carries no information about the year of diagnosis. We re-evaluate two recent longitudinal models (OA-BreaCR, LMV-Net) on CSAW-CC with a 5-year horizon using timing metrics computed on cancer cases only. Despite C-indices up to 0.75, neither orders cancer cases by time to diagnosis significantly better than chance (c_time 0.51 and 0.55, both 95% CIs covering 0.5). Weighted absolute timing error favours a constant "year 3" prediction over both models, so we use c_time as the primary timing metric. For Mirai's additive-hazard head, also used by LMV-Net, we analyse how per-year increments passed through a ReLU can collapse under severe class imbalance. We also propose a breast-level, two-stage model that separates whether from when. It matches LMV-Net in discrimination (C-index 0.745 vs. 0.746) but orders cancer cases better (c_time 0.58 vs. 0.51, paired 95% CI of the difference 0.01-0.13), on par with Mirai's published weights (0.57).

Figures & tables

Explore similar work

CardsList
  1. Longitudinal Multi-View Breast Cancer Risk Prediction

    Jul 13, 2026Solveig Thrun, Zijun Sun, Suaiba A. Salahuddin +5Breast CancerLongitudinal Medical Image Analysis

  2. MamaDino: A Hybrid Vision Model for Breast Cancer 3-Year Risk Prediction

    Feb 14, 2026Ruggiero Santeramo, Igor Zubarev, Florian JugBreast CancerMammography

  3. LoGo-MR: Screening Breast MRI for Cancer Risk Prediction by Efficient Omni-Slice Modeling

    Apr 13, 2026Xin Wang, Yuan Gao, George Yiasemis +13Medical Image AnalysisClinical Risk Prediction