cs.CVAug 13, 2026

Evaluation of Clinically Steerable Retinal Image Generation from Foundation Model Latent Spaces

Authors: Zuzanna A. Wakefield-SkórniewskaBartłomiej W. Papież

Organizations: Big Data Institute, Nuffield Department of Population Health, University of Oxford, United Kingdom

Abstract

Medical foundation models learn latent representations of clinically meaningful phenotypes, yet their ability to support controllable image generation remains largely unexplored. We evaluate four retinal foundation models within the representation tokenizer framework and examine whether demographic and clinical information encoded in latent representations from foundation models is preserved during synthetic image generation. We show that generated representations and images faithfully inherit phenotype information when evaluated within their originating foundation models, consistently outperforming conventional latent diffusion on multiple downstream prediction tasks. However, these gains largely disappear when evaluated using classifiers trained on real images, revealing a previously uncharacterised synthetic-to-real representation gap. These findings demonstrate that foundation-model latent spaces provide a powerful substrate for controllable retinal synthesis while highlighting the need to better align synthetic representations with real-image distributions.

Explore similar work

CardsList
  1. Towards Interpretable Foundation Models for Retinal Fundus Images

    Mar 19, 2026Samuel Ofosu Mensah, Camila Roa, Kerol Djoumessi +1Fundus ImagesRetinal Imaging