Medical Image Representation Learning

Overview

The field studies how models can encode useful structure from images such as CT, MRI, X-rays, ultrasound, retinal scans, and pathology slides, especially when expert labels are scarce. Common approaches include contrastive learning, masked image modeling and joint-embedding prediction, as well as vision-language alignment and anatomical or temporal supervision. Researchers test whether these representations transfer through linear probes, few-shot learning, segmentation, retrieval, and evaluation across hospitals or acquisition protocols. A central tension is that specialized pretraining can help on closely matched tasks, but performance is uneven across modalities and domains, and global features may miss small lesions or clinically important spatial detail.

Latest papers

CardsList

281 papers27 papers in the last four weeks, down 27% on the four weeks before. 0.2% of all new papers.

  1. Stochastic Siamese MAE Pretraining for Longitudinal Medical Images

    Dec 29, 2025Taha Emre, Arunava Chakravarty, Thomas Pinetz +9Masked AutoencodersSelf-Supervised Pre-Training

  2. Structure is Supervision: Multiview Masked Autoencoders for Radiology

    Nov 27, 2025Sonia Laguna, Andrea Agostini, Alain Ryser +9Medical Image Representation LearningMasked Autoencoders

  3. Latent Representation Learning from 3D Brain MRI for Latent Analysis and Prediction in Multiple Sclerosis

    Sep 28, 2025Trinh Ngoc Huynh, Nguyen Duc Kien, Nguyen Hai Anh +8Medical Image Representation LearningVariational Autoencoders

  4. Exploring the Capabilities of Large Language Model Encoders for Image-Text Retrieval in Chest X-rays

    Sep 17, 2025Hanbin Ko, Gihun Cho, Inhyeok Baek +5Image-Text RetrievalRadiology VLMs

  5. Diverse Normal Prototypes-Guided Contrastive Reconstruction for Medical Anomaly Detection

    Aug 27, 2025Luhu Li, Bin Liu, Bowen Lin +3Prototype LearningMedical Image Anomaly Detection

  6. Latent Space Analysis for Interpretable Uncertainty in Melanoma Classification

    Jun 23, 2025Ciro Listone, Aniello MuranoVariational AutoencodersSkin Lesion Classification

  7. Good Enough? An Investigation on the Impact of Label Quality in Large-Scale Medical Datasets

    May 27, 2025Alexander Jaus, Zdravko Marinov, Constantin Seibold +4Image SegmentationMedical Imaging Foundation Models

  8. Stochastic Optimal Control for Continuous-Time fMRI Representation Learning

    Feb 7, 2025Joonhyeong Park, Byoungwoo Park, Chang-Bae Bang +4Latent Dynamics ModelingSelf-Supervised Time Series Representation Learning

  9. Full-resolution MLPs Empower Medical Dense Prediction

    Nov 28, 2023Mingyuan Meng, Yuxin Xue, Dagan Feng +2Medical Image RegistrationMedical Image Segmentation

  10. Structure-Guided Self-Supervised Matching for One-Shot Medical Landmark Detection

    Mar 3, 2022Qingsong Yao, Zhen Huang, Ao Wang +4Few-Shot LearningImage Matching