Medical Image Representation Learning

Overview

The field studies how models can encode useful structure from images such as CT, MRI, X-rays, ultrasound, retinal scans, and pathology slides, especially when expert labels are scarce. Common approaches include contrastive learning, masked image modeling and joint-embedding prediction, as well as vision-language alignment and anatomical or temporal supervision. Researchers test whether these representations transfer through linear probes, few-shot learning, segmentation, retrieval, and evaluation across hospitals or acquisition protocols. A central tension is that specialized pretraining can help on closely matched tasks, but performance is uneven across modalities and domains, and global features may miss small lesions or clinically important spatial detail.

Latest papers

CardsList

281 papers27 papers in the last four weeks, down 27% on the four weeks before. 0.2% of all new papers.

  1. DBHiCo: Dual-Branch Hierarchical Contrastive Learning for MRI Image Classification

    Nov 14, 2026Chengsheng Zhanga, Wei Li, Chenghao Sun +2Medical Image ClassificationMulti-View Contrastive Learning

  2. Cracks in Embeddings: Robustness and Stability of JEPA-Based Chest X-Ray Representations

    Nov 13, 2026Zahid Mansur, Kalpana Yadav, Deepak MishraMedical Image Representation LearningAdversarial Robustness

  3. Where to Predict in Retinal OCT? Anatomy-Guided Target Selection for I-JEPA

    Nov 12, 2026Yunchu Feng, Wai Tak Lau, Kaveri A. ThakoorMedical Image Representation LearningSelf-Supervised Visual Representation Learning

  4. Anatomy-Activated Mixture-of-Experts for 3D Medical Vision-Language Pre-training

    Nov 7, 2026Szymon Płotka, Gizem Mert, Pedro R. A. S. Bassi +9Medical VLMsMedical Image Representation Learning

  5. REFORM-3D: A Representation-Centric Evaluation Framework for 3D Medical Vision Foundation Models

    Nov 6, 2026Maregu Assefa, Muzammal Naseer, Divya Velayudhan +2Medical Imaging Foundation ModelsMedical Image Representation Learning

  6. Agent-Driven Generative Priors for Pathology Image Synthesis and Segmentation

    Nov 4, 2026Sicheng Yang, Rui Tang, Haipeng Zhou +6Histopathology Image SynthesisComputational Pathology

  7. Representation Learning for 3D Brain Imaging: A Benchmark

    Nov 4, 2026Pierre Falconnier, Robin Trombetta, Nicolas Duchateau +1Medical Image Representation Learning3D Medical Imaging

  8. Mitigating Spurious Invariance in Contrastive Learning: A Probabilistic Self-Supervised Learning Framework for Medical Image Analysis

    Nov 3, 2026Wei Wei, Yading YuanSelf-Supervised LearningMedical Image Representation Learning

  9. Diagnosis by Composition: Detecting and Localizing Unseen Diseases by Composing Learned Radiological Findings

    Nov 3, 2026Kaihua Hou, Wei Liu, Yi Huang +10Medical Image AnalysisMedical Image Representation Learning

  10. Dual-VaDE: Efficient and Robust Prototype Learning via Variational Dual-Domain Mixture Priors

    Nov 3, 2026Wugeng Zheng, Song Wang, Jian WangPrototype LearningVariational Autoencoders

  11. Learning from Unlabeled Photographs for General Oral Image Analysis

    Nov 3, 2026Zhong-Shi Zhang, Zi-Li Yu, Xiao Xiao +4Medical Image Representation LearningMedical Image Analysis

  12. Findings-aware Language-Image Pretraining for CT Volume Interpretation

    Nov 2, 2026Takuro Shimaya, Junya Inoh, Masahiro SaikoMedical VLMsMedical Image Representation Learning

  13. LoRe-MIM: Lost-or-Replaced Masked Image Modeling for Self-Supervised Representation Learning in Whole-Body PET/CT

    Oct 29, 2026Amartya Bhattacharya, Bashirul Azam Biswas, Biratal Raj Wagle +4Medical Image Representation LearningMultimodal SSL

  14. Fisher Contrastive Learning to Mitigate Feature Suppression: A Case Study in Acute Promyelocytic Leukemia Diagnosis

    Oct 29, 2026Shushan Wu, Yongkai Chen, Xilin Gong +3Contrastive LearningSelf-Supervised Visual Representation Learning

  15. DINOv2 for PET: A Pre-Training Domain Benchmark Across Classification, Segmentation, and Prognosis

    Oct 29, 2026Roxanne De Maeyer, Yannick Brackenier, Vicky De Ridder +3Medical Image AnalysisMedical Image Representation Learning

  16. Systematic Morphometric Brain Autoencoding for Representation Learning in Neurodegenerative Diseases

    Oct 27, 2026Nuria Balbás-Esteban, Albert Belenguer-Llorens, Elaheh Moradi +3Medical Image Representation LearningSelf-Supervised Pre-Training

  17. Dense Representation Learning and Differentiable Shape Modeling for Spine Landmark Detection

    Oct 27, 2026Augustin Daridon, Sofiane Sifaoui, Ayman Assi +4Anatomical Landmark DetectionMedical Image Representation Learning

  18. MedVTok: A General-Purpose Medical Visual Tokenizer

    Oct 26, 2026Chenglong Ma, Yuanfeng Ji, Junzhi Ning +18Image TokenizationVisual Tokenization

  19. Low-rank MERA Decomposition of 3D OCT Image Volume for Compression, Denoising, Feature Extraction and Diagnosis of Retinal Diseases

    Oct 26, 2026Ivica Kopriva, Fei Shi, Marija Štanfel +4Optical Coherence TomographyMedical Image Representation Learning

  20. VTRL-Med: Progressive Visual Refinement with Topology-Guided Regularization for Medical Image Clustering

    Oct 23, 2026Guangyu Meng, Pengfei Gu, Peixian Liang +3Deep ClusteringMedical Image Analysis

  21. Learning Pathology-Sensitive Representations for Unsupervised Retinal OCT Anomaly Detection

    Oct 23, 2026Tania Haghighi, Sina Gholami, Behafarin Emam +5Medical Image Anomaly DetectionUnsupervised Anomaly Detection

  22. K-CLUE: A Segmentation-to-Clustering Framework for Ki67 Cell Typing

    Oct 23, 2026Ana Beatriz Vieira, Sara P. Oliveira, Diana Montezuma +3Histopathology Image ClassificationMedical Image Representation Learning

  23. UNIVERS: Learning UNIversal Voxel-wise Embedding via Randomized Synthesis for generalizable one-shot landmark localization

    Oct 21, 2026Derong Yu, Qingsong Zhao, Yanbing Yue +3Anatomical Landmark DetectionMedical Image Representation Learning

  24. ReSeg: Retraining-free segmentation of abdominal organs via generalizable semantic representation learning

    Oct 21, 2026Derong Yu, Guoyan ZhengZero-Shot Medical Image SegmentationDomain Generalization for Semantic Segmentation

  25. TAN: A Size- and Form-Adaptive Masked-Convolution Encoder for Tissue Graphs

    Oct 16, 2026Jan Herschel, Anselm von GladissMedical Image Representation LearningComputational Pathology

  26. L2GSSL: Label-Efficient Local-to-Global Self-Supervised Learning for Volumetric Healthcare Data

    Oct 15, 2026Po-Cheng Cheng, Hung-Hsuan ChenLung Nodule DetectionMedical Image Representation Learning