cs.CVOct 2, 2026

FiberGeoText: A Vision-Language Model for Population- Level Organization of Superficial White Matter

Authors: Yuqian Chen, R. Jarrett Rushmore, Guikun Chen, Fan Zhang, Edward Yeterian, Nikos Makris, Yogesh Rathi, Lauren J. O'Donnell

Organizations: Department of Radiology, Mass General Brigham, Boston MA, USA · Harvard Medical School, Boston MA, USA · Department of Anatomy and Neurobiology, Boston University Chobanian & Avedisian School of Medicine, Boston MA, USA · Department of Psychology, Colby College, Waterville ME, USA · 

Abstract

The superficial white matter (SWM), a critical brain region for cognition across the lifespan and brain disease, contains abundant short-range association fibers whose organization remains incompletely characterized, in part because the short trajectories and highly variable cortical folding make correspondence across individuals challenging. Anatomically corresponding connections may vary in spatial location across individuals and therefore may not be adequately defined by geometric proximity alone. We introduce FiberGeoText (FGT), a vision-language model (VLM) for organizing short-range superficial white matter (SWM) streamlines reconstructed from ultra-high-resolution diffusion MRI into population-level clusters. FGT jointly represents three complementary properties of each streamline: its three-dimensional trajectory, its cortical anatomical context, and its shape. Cortical endpoint information from multiple parcellation schemes is expressed as text and encoded using a pretrained large language model (LLM), enabling heterogeneous anatomical descriptions to contribute to a common continuous representation. We evaluated FGT on acquired submillimeter 0.76 mm diffusion MRI data. Compared with state-of-the-art (SOTA) methods, FGT produced substantially greater cortical parcel coherence, within-cluster shape consistency, cluster-size consistency, and cross-subject correspondence. The trained model also generalizes well to unseen subjects with an average of 96.7% of the 5,000 learned clusters recovered, and high consistency of cluster structure between training and testing data. Together, these findings demonstrate that integrating geometric, anatomical, and shape information by learning multimodal deep embeddings with a VLM model enables robust learning of population-consistent SWM organization despite interindividual anatomical variability.

Explore similar work

CardsList
  1. TractoGraphVLM: A Unified Vision-Language Framework for White Matter Tractography

    Aug 16, 2026Gurucharan Marthi Krishna Kumar, Janine Dale Mendola, Amir ShmuelMedical VLMsNeuroimaging

  2. TractoRC: A Unified Probabilistic Learning Framework for Joint Tractography Registration and Clustering

    Mar 11, 2026Yijie Li, Xi Zhu, Junyi Wang +3ClusteringDiffusion MRI

  3. Tractogram foundation model

    Jun 3, 2026Guikun Chen, Yuqian Chen, Yijie Li +5Medical Imaging Foundation ModelsRepresentation Learning