eess.IVMar 28, 2024

Incorporating synthetic data from diffusion models supports echocardiography downstream tasks

Authors: Milad Yazdani, Pooria Ashrafian, Moein Heidari, Alireza Rafiei Sardouei, Dena Shahriari, Ilker Hacihaliloglu

Organizations: Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC, Canada · School of Biomedical Engineering, University of British Columbia, Vancouver, BC, Canada · Department of Orthopaedics, University of British Columbia, Vancouver, BC, Canada · Department of Radiology, University of British Columbia, Vancouver, BC, Canada · 

Abstract

Purpose: Large labeled echocardiography datasets are costly to collect. We use diffusion models to generate synthetic training data for segmentation and cardiac phase classification. Approach: We study three generation approaches on CAMUS: an unconditional image space model, a latent model conditioned on plain English prompts or abstract tokens, and a ControlNet model conditioned on an abstract token and segmentation mask. We evaluate synthesis with Fréchet Inception Distance (FID) and augmentation using segmentation and classification of end diastole and end systole. We also evaluate segmentation within CardiacUDC and directly from CAMUS to CardiacUDC. Results: Conditioning on an abstract token and segmentation mask gives the lowest mean FID, 1.5 compared with 3.2 for the Semantic Diffusion Model. Abstract token augmentation gives the highest classification accuracy, improving ResNet-18 from 83.8% to 87.2% and VGG-16 from 74.5% to 78.7%. Synthetic augmentation gives the highest mean Dice of 87.6% for the CAMUS 2D U-Net and 84.6% for the CardiacUDC nnU-Net. When nnU-Net models are trained on CAMUS and evaluated directly on CardiacUDC, augmentation raises mean Dice from 74.6% to 75.2%. Conclusions: Incorporating synthetic images into training gives modest gains in CAMUS phase classification, segmentation within CAMUS and CardiacUDC, and direct segmentation from CAMUS to CardiacUDC.

Figures & tables

Explore similar work

CardsList
  1. LGESynthNet: Controlled Scar Synthesis for Improved Scar Segmentation in Cardiac LGE-MRI Imaging

    Mar 18, 2026Athira J. Jacob, Puneet Sharma, Daniel RueckertMedical Image SynthesisSynthetic Data Augmentation

  2. LISynSeg: Data-Centric Label-to-Image Synthesis for Cross-Modality Whole-Heart Segmentation

    Aug 31, 2026Jiacheng Wang, Ivana Isgum, Ipek OguzCross-Modality Medical Image SegmentationSynthetic Data Augmentation

  3. EAGT: Echocardiography Augmentation for Generalisability and Transferability

    May 14, 2026Soroush Elyasi, Sara Adibzadeh, Nasim Dadashi Serej +1Ultrasound Image SegmentationData Augmentation