cs.CVMar 24, 2026

NeuroSeg Meets DINOv3: Transferring 2D Self-Supervised Visual Priors to 3D Neuron Segmentation via DINOv3 Initialization

Authors: Yik San Cheng, Runkai Zhao, Weidong Cai

Organizations: The University of Sydney

Abstract

2D visual foundation models, such as DINOv3, a self-supervised model trained on large-scale natural images, have demonstrated strong zero-shot generalization, capturing both rich global context and fine-grained structural cues. However, an analogous 3D foundation model for downstream volumetric neuroimaging remains lacking, largely due to the challenges of 3D image acquisition and the scarcity of high-quality annotations. To address this gap, we propose to adapt the 2D visual representations learned by DINOv3 to a 3D biomedical segmentation model, enabling more data-efficient and morphologically faithful neuronal reconstruction. Specifically, we design an inflation-based adaptation strategy that inflates 2D filters into 3D operators, preserving semantic priors from DINOv3 while adapting to 3D neuronal volume patches. In addition, we introduce a topology-aware skeleton loss to explicitly enforce structural fidelity of graph-based neuronal arbor reconstruction. Extensive experiments on four neuronal imaging datasets, including two from BigNeuron and two public datasets, NeuroFly and CWMBS, demonstrate consistent improvements in reconstruction accuracy over SoTA methods, with average gains of 2.9% in Entire Structure Average, 2.8% in Different Structure Average, and 3.8% in Percentage of Different Structure. Code: https://github.com/yy0007/NeurINO.

Figures & tables

Explore similar work

CardsList
  1. Extending 2D foundational DINOv3 representations to 3D segmentation of neonatal brain MR images

    Feb 27, 2026Annayah Usman, Behraj Khan, Tahir Qasim SyedMedical Image Segmentation3D Medical Image Segmentation

  2. DINO-Med3D: Bridging Dimension and Domain Gaps in Volumetric Segmentation via Progressive Adaptation

    Jun 17, 2026Haoyu Hu, Xiyao Ma, Shiqi Liu +43D ViTsDomain Adaptation

  3. DINO-3DRA: Leveraging 2D Foundation Model Semantics for 3D Cerebral Aneurysm Segmentation

    Aug 7, 2026Jiayang Lu, Fengming Lin, Alejandro F. Frangi +1Medical Imaging Foundation ModelsTransfer Learning