cs.CVNov 19, 2026

VoxForge: A Unified Foundation Model for Dense 3D Features Across MRI, CT and PET

Authors: Rushil Anirudh, Jayaraman J. Thiagarajan

Organizations: Amazon AGI

Abstract

A unified 3D medical foundation model promises reusable, frozen features that serve a wide variety of tasks such as segmentation, classification and registration on MRI, CT and PET as well as specialist models do. Generalist models still need separate backbones for localized and global tasks, specialist models are confined to a single modality, with the concern that spanning modalities under-emphasizes fine anatomy, and both typically rely on end-to-end fine-tuning to be competitive. We present VoxForge, a single encoder that integrates recent advances in 3D architecture, self-distillation and cross-modal curricula to learn transferable features from permissively licensed MRI and CT volumes. We evaluate it strictly frozen, the test a reusable foundation model must pass, against state-of-the-art generalist and specialist models on segmentation, classification and registration across MRI and CT, and on PET, which it never sees. VoxForge has the best or tied-best average rank in every task group, serves localized and global tasks across modalities at the level of state-of-the-art specialists, and is extremely label-efficient, matching top-performing models on TotalSegmentator CT with a tenth of the labels.

Figures & tables

Explore similar work

CardsList
  1. Learning Robust Visual Features in Computed Tomography Enables Efficient Transfer Learning for Clinical Tasks

    Apr 5, 2026Rubén Moreno-Aguado, Alba Magallón, Victor Moreno +2Medical Imaging Foundation ModelsMedical Image Representation Learning

  2. VoxCor: Training-Free Volumetric Features for Multimodal Voxel Correspondence

    May 13, 2026Guney Tombak, Ertunc Erdil, Ender KonukogluMedical Imaging Foundation ModelsCross-Modal Representation Learning

  3. MultiMedVision: Multi-Modal Medical Vision Framework

    May 9, 2026Frank Li, Bardia Khosravi, Mohammadreza Chavoshi +5Medical Imaging Foundation ModelsVision Transformer