Simultaneous Dual-View Mammogram Synthesis Using Denoising Diffusion Probabilistic Models
Authors: Jorge Alberto Garza-Abdala, Gerardo A. Fumagal-González, Eduardo de Avila-Armenta, Sadam Hussain, Jasiel H. Toscano-Martínezb, Diana S. M. Rosales Gurmendi, Alma A. Pedro-Pérez, Jose G. Tamez-Pena
Organizations: Tecnologico de Monterrey, School of Engineering and Sciences, Monterrey, Mexico · School of Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile · Tecnologico de Monterrey, School of Medicine and Health Sciences, Monterrey, Mexico
Breast cancer screening relies heavily on mammography, where the craniocaudal (CC) and mediolateral oblique (MLO) views provide complementary information for diagnosis. However, many datasets lack complete paired views, limiting the development of algorithms that depend on cross-view consistency. To address this gap, we propose a three-channel denoising diffusion probabilistic model capable of simultaneously generating CC and MLO views of a single breast. In this configuration, the two mammographic views are stored in separate channels, while a third channel encodes their absolute difference to guide the model toward learning coherent anatomical relationships between projections. A pretrained DDPM from Hugging Face was fine-tuned on a private screening dataset and used to synthesize dual-view pairs. Evaluation included geometric consistency via automated breast mask segmentation and distributional comparison with real images, along with qualitative inspection of cross-view alignment. The results show that the difference-based encoding helps preserve the global breast structure across views, producing synthetic CC-MLO pairs that resemble real acquisitions. This work demonstrates the feasibility of simultaneous dual-view mammogram synthesis using a difference-guided DDPM, highlighting its potential for dataset augmentation and future cross-view-aware AI applications in breast imaging.
Figures & tables
Figure 1: Real mammographic views. From left to right: CC; MLO; ∣CC−MLO∣ ; The three previous views were encoded into an RGB image, where Red=CC, Green=MLO, and Blue= ∣CC−MLO∣ .
Figure 2: Synthetic mammogram example. From left to right: A synthetic RGB mammogram after being normalized to 99%; CC view extracted from the synthetic RGB image; MLO view extracted from the synthetic RGB image; ∣CC−MLO∣ view extracted from the RGB image.
Statistic
Original
Synthetic
IoU
DSC
IoU
DSC
Mean
0.654
0.784
0.674
0.800
Mean difference (vs real)
N/A
N/A
0.020
0.016
Std
0.113
0.092
0.107
0.081
Min
0.000
0.000
0.261
0.414
Q1 (25%)
0.592
0.743
0.605
0.754
Table 1: Performance Statistics for Original and Synthetic Data
Figure 3: Synthetic mammograms with mask. From left to right: CC view; CC mask; MLO view; MLO mask.
Figure 4: IoU and DSC distributions for 2500 pairs of real and 500 pairs of synthetic mammograms’ masks.
Statistic
IoU
DSC
KS D
0.077∗
0.077∗
EMD
0.020
0.015
Table 2: KS and EMD tests for IoU and DSC, comparing both real and synthetic mammograms (0.005 < p < 0.05).
Multiview mammography relies on paired craniocaudal (CC) and mediolateral oblique (MLO) views to provide complementary projections of a 3D breast volume, enabling precise anomaly localization. However, acquiring high-quality, balanced datasets remains challenging for deep learning applications. We propose a novel method to synthesize multiview mammograms by leveraging the inherent geometric relationship between CC and MLO views. To enforce an implicit 3D consistency prior during generation, we develop an alignment module that searches a 2D affine transformation subspace to establish optimal anatomical correspondence. Leveraging this alignment, we introduce a pixel-space self-consistency loss based on the Earth Mover's Distance (EMD) between the 1D anteroposterior (AP) axis tissue distributions of the generated images. Integrated into a pretrained flow matching model, MammoFlow forces synthesized pairs to share physically plausible tissue distributions from the chest wall to the nipple. To our knowledge, this is the first work to guide multiview mammogram generation using implicit geometric tissue correspondence. Our method demonstrates superior image quality, passes expert radiologist evaluation, and generates physically consistent pairs that improve downstream classification AUC by 5%. Code is available at https://github.com/XYPB/MammoFlow
Yuexi Du, Leya Barrientos, Laura Sheiman +3
Department of Biomedical Engineering, Yale University · Department of Radiology & Biomedical Imaging, Yale University
Accurate breast cancer classification from mammography requires effective integration of complementary information from craniocaudal (CC) and mediolateral oblique (MLO) views, which provide a more complete characterization of breast abnormalities. However, existing multi-view learning approaches typically rely on feature-level aggregation or single-stage cross-attention, which can entangle view-specific and shared representations and restrict interaction to limited network depths. To address these limitations, we propose a token-centric dual-view learning framework that unifies prompt-based adaptation and cross-view fusion within a frozen vision transformer backbone. The framework reformulates inter-view interaction as structured token-level communication, where dedicated fusion tokens explicitly encode bidirectional information exchange between CC and MLO views via cross-attention, serving as intermediate carriers of cross-view dependencies rather than relying on direct feature fusion. Unlike conventional methods that apply fusion at a single layer, fusion modules are inserted at multiple transformer depths, enabling progressive and repeated interaction across the encoder hierarchy. Fusion tokens are reintegrated into the token sequence and refined by subsequent transformer layers, facilitating hierarchical propagation of complementary information while preserving view-specific structure. Experiments on VinDr-Mammo and CMMD datasets demonstrate consistent improvements over linear probing, prompt-only adaptation, and conventional fusion baselines. On the VinDr-Mammo BI-RADS classification task, the framework achieves 50.40% F1-score and 0.8090 AUC, including a 0.10 AUC improvement over a dual-view fusion baseline in the binary setting. Ablation studies further validate the effectiveness of token-based fusion and multi-depth interaction design.
Aysan Ghayouri Pirsoltan, Shima Babakordi, Mohammad Reza Mohammadi
School of Computer Engineering, Iran University of Science and Technology, Tehran, Iran · School of Computer Engineering, Iran University of Science and technology, Tehran, Iran
The ability to synthesize realistic X-ray images has catalyzed the development of AI models for X-ray image-guided procedures, which otherwise suffer from a lack of available annotated data. Prior work has demonstrated the effectiveness of mechanistic simulation of digitally reconstructed radiographs (DRRs) as a training data source for a myriad of tasks, including segmentation and anatomical landmark detection, with comparable or superior performance to real data training. However, mechanistic DRR synthesis still relies on the availability of annotated high-resolution anatomical models. Deriving these from CT images of real patients or specimens imposes an undesirable bottleneck on data quantity and variability. In this work, we explore two methods for synthesizing training data: (1) a 3D conditional latent diffusion model that generates CT volumes to use as inputs for mechanistic DRR generation without real, 3D anatomical models, and (2) a view-conditioned 2D diffusion model that produces synthetic X-rays. In controlled experiments, we demonstrate that synthetic 2D diffusion-based X-rays can be used to train an anatomical landmark detection model that generalized to real X-ray images with performance rivaling that of a model trained on real X-ray images. Thus, we provide preliminary evidence that synthetic, 2D diffusion-based training data can substitute for real X-ray data, identifying a promising avenue towards generating large, diverse datasets for training robust AI models in interventional X-ray imaging.
Sampath Rapuri, Jeremy Ko, Benjamin D. Killeen +2
Johns Hopkins University, Baltimore, MD 21218, USA