cs.CVNov 14, 2026

DBHiCo: Dual-Branch Hierarchical Contrastive Learning for MRI Image Classification

Authors: Chengsheng Zhanga, Wei Li, Chenghao Sun, Jian Gong, Xinmei Tian

Organizations: University of Science and Technology of China, Hefei, 230026, Anhui, China · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, 230000, Anhui, China · Beijing Tiantan Hospital, Capital Medical University, Beijing Neurosurgical Institute, 100071, Beijing, China

Abstract

Automated Magnetic Resonance Imaging (MRI) image classification provides a crucial non-invasive approach for neurological diagnosis, yet it is fundamentally challenged by inherent acquisition noise and high inter-subject structural similarity, which obscure subtle pathological variations, thereby limiting the performance of deep neural networks. While contrastive learning (CL) offers a promising mitigation strategy, existing paradigms rely on rigid binary partitions that ignore negative sample heterogeneity, and they fail to capture the cross-view structural consistency vital for fine-grained anatomical alignment. To address these barriers, we propose Dual-Branch Hierarchical Contrastive Learning (DBHiCo), a novel framework explicitly designed to collaboratively enforce structural consistency and semantic discrimination. Specifically, DBHiCo leverages a natural anatomical multi-view pair (original and skull-stripped MRI scans), processing them through a dual-branch architecture to seamlessly integrate holistic structural robustness with localized intracranial details. Crucially, we introduce a hierarchical contrastive loss that discards conventional binary constraints in favor of a margin-ranked similarity hierarchy. This mechanism explicitly orders positive and negative pairs based on their structural and semantic difficulty, thereby amplifying the fine-grained semantic discriminability of the learned representations. Extensive experiments across three diverse neurological datasets demonstrate that DBHiCo achieves state-of-the-art performance, consistently outperforming existing MRI multi-view representation learning and advanced contrastive fine-tuning methods.

Figures & tables

Explore similar work

CardsList
  1. Contrastive Joint-Embedding Prediction for Representation Learning in Structural MRI

    Jul 12, 2026Fabian Mager, Lars Kai HansenContrastive LearningBrain Age Prediction

  2. Learning Subject-Specific Anatomical Representations via Manifold Expansion: Application to Accelerated Multi-Contrast MRI

    Oct 2, 2026Ruimin Feng, Wanyu Bian, Albert Jang +2Accelerated MRI ReconstructionMagnetic Resonance Imaging