cs.GRJun 25, 2025

X-SiT: Inherently Interpretable Surface Vision Transformers for Dementia Diagnosis

Authors: Fabian Bongratz, Tom Nuno Wolf, Jaume Gual Ramon, Christian Wachinger

Organizations: Lab for AI in Medical Imaging, Technical University of Munich, Munich, Germany · Munich Center for Machine Learning, Munich, Germany

Abstract

Interpretable models are crucial for supporting clinical decision-making, driving advances in their development and application for medical images. However, the nature of 3D volumetric data makes it inherently challenging to visualize and interpret intricate and complex structures like the cerebral cortex. Cortical surface renderings, on the other hand, provide a more accessible and understandable 3D representation of brain anatomy, facilitating visualization and interactive exploration. Motivated by this advantage and the widespread use of surface data for studying neurological disorders, we present the eXplainable Surface Vision Transformer (X-SiT). This is the first inherently interpretable neural network that offers human-understandable predictions based on interpretable cortical features. As part of X-SiT, we introduce a prototypical surface patch decoder for classifying surface patch embeddings, incorporating case-based reasoning with spatially corresponding cortical prototypes. The results demonstrate state-of-the-art performance in detecting Alzheimer's disease and frontotemporal dementia while additionally providing informative prototypes that align with known disease patterns and reveal classification errors.

Figures & tables

Explore similar work

CardsList
  1. vSV-ViT: Variable-size SuperVertex Vision Transformer for Cortical Surface Learning in Alzheimer's Disease

    May 26, 2026Geonwoo Baek, Ikbeom JangAlzheimer's Disease3D ViTs

  2. Explainability in mulimodal deep transformation models for stroke outcome prediction

    Apr 7, 2025Lisa Herzog, Jonas Brändli, Maurice Schneeberger +7Clinical Outcome PredictionExplainable Medical Image Analysis

  3. Bridging visual saliency and large language models for explainable deep learning in medical imaging

    May 7, 2026Paul Valery Nguezet, Elie Tagne Fute, Yusuf Brima +2Radiology Report GenerationMedical Image Classification