cs.CVJun 2, 2026

CoralBay: A Self-Supervised CT Foundation Model

Authors: Ioannis GatopoulosNicolas KänzigSebastian OtáloraFei Tang

Abstract

Self-supervised learning has enabled large-scale pre-training on 2D natural images, producing general-purpose visual representations that transfer effectively across tasks. However, many medical imaging modalities, such as CT scans, are inherently three-dimensional and differ fundamentally from natural images in both structure and semantics. Volumetric modalities capture spatial continuity, organ anatomy, and intensity-based tissue properties (e.g., Hounsfield Units), which are not adequately modeled by 2D pre-training. To bridge this gap, we introduce CoralBay, a self-distillation framework that extends DINO by using a hierarchical 3D Swin backbone and applying self-distillation to concatenated multi-scale features, enabling data-efficient self-supervised learning of rich spatial representations that encode both global semantics and fine-grained local structure. As a result, CoralBay transfers effectively to a wide range of downstream radiological tasks, demonstrating strong and consistent performance across diverse anatomical targets. In addition, we contribute to the open-source \eva framework by introducing a public, reproducible 3D radiology leaderboard that unifies multiple datasets and establishes a standardized benchmark for evaluating volumetric representation learning methods.

Explore similar work

CardsList
  1. DALE-CT: Depth-Aware Foundation Models for Computed Tomography

    Jun 5, 2026Evan W. Damron, Mahmut S. Gokmen, Mitchell A. Klusty +3Computed Tomography DatasetDinov3

  2. MultiMedVision: Multi-Modal Medical Vision Framework

    May 9, 2026Frank Li, Bardia Khosravi, Mohammadreza Chavoshi +5Medical ImagingMultimodal Clinical Data