cs.CVAug 26, 2026

Unsupervised Anatomical Feature Learning via Diffusion Models: Enhanced Medical Image Segmentation with Denoising Diffusion Probabilistic Models

Authors: Akshat G, Divyansh Gupta, Shaleen Bhatnagar, Shilpa Ankalaki, Tusar Kanti Mishra

Organizations: Manipal Institute of Technology Bengaluru, Manipal Academy of Higher Education, Manipal, India

Abstract

Acquiring pixel-level annotations for medical image segmentation is a severe bottleneck. Traditional U-Net architectures, while effective, learn local texture patterns and lack awareness of global anatomical structures, leading to boundary delineation failures in low-data regimes. This research paper proposes utilizing unsupervised Denoising Diffusion Probabilistic Models (DDPMs) to extract anatomical features. We train a DDPM on 21 unlabeled abdominal CT scans to learn structural representations, transferring the encoder weights to a downstream segmentation task evaluated on the BTCV multi-organ dataset. Diffusion pretraining significantly improved liver segmentation: Dice increased from 0.75±0.360.75\pm0.36 to 0.93±0.160.93\pm0.16 (p<5.33×10−26p < 5.33\times10^{-26}, 0.529 Cohen's d), Average Surface Distance (ASD) decreased by 66%, and 95th-percentile Hausdorff Distance (HD95) reduced by 45%. For kidney segmentation, Dice improved from 0.90±0.190.90\pm0.19 to 0.95±0.100.95\pm0.10 (p<4.01×10−11p < 4.01\times10^{-11}). Multi-organ pooled performance showed a 68% variance reduction and a 74% improvement in boundary precision (Dice 0.95±0.070.95\pm0.07). Crucially, frozen encoder models retained > 80% of fine-tuned performance without exposure to segmentation labels, proving the existence of learned anatomical priors. In low-data scenarios, diffusion-pretrained models maintained robust performance with only 50% (Dice: 0.92 liver, 0.94 kidney), 25%, and even 10% (Dice: 0.89 liver, 0.71 kidney) of labeled data. Using unlabeled images for diffusion-based pretraining successfully embeds robust anatomical features prior to human supervision, transforming U-Nets into anatomy-aware systems.

Figures & tables

Explore similar work

CardsList
  1. DiffuSAM: Diffusion-Based Prompt-Free SAM2 for Few-Shot and Source-Free Medical Image Segmentation

    Apr 27, 2026Tal Grossman, Noa Cahan, Lev Ayzenberg +1Source-Free Domain AdaptationImage Segmentation

  2. FOSCU: Feasibility of Synthetic MRI Generation via Duo-Diffusion Models for Enhancement of 3D U-Nets in Hepatic Segmentation

    Mar 31, 2026Youngung Han, Kyeonghun Kim, Seoyoung Ju +8Medical Image SegmentationSynthetic Data Augmentation