cs.CVAug 18, 2026

GSToken: Geometry-Structured Gaussian Tokens for Compact 3D Medical Image Representation

Authors: Xiaoduo Li, Quan Gu

Organizations: Taiyuan University of Technology · independent researcher

Abstract

Effective segmentation of multi-modal MRI is central to improving neural network accuracy in brain tumor recognition. Existing methods typically compress 3D volumes into token sequences via fixed patch encoding or learned attention pooling (e.g., TokenLearner). However, these compression schemes discard explicit spatial shape information; the resulting tokens convey no notion of lesion morphology or spatial extent. Meanwhile, end-to-end evaluation entangles a tokenizer's information retention with the reconstruction capacity of the downstream decoder, and the lack of a unified capacity contract across methods makes performance differences difficult to attribute. In this paper, we introduce Gaussian tokens to multi-modal brain tumor segmentation for the first time: each token carries not only a semantic feature but also a learned 3D center, anisotropic scale, and orientation, endowing the representation with explicit geometric support at negligible parameter cost. We further propose a frozen-token utility evaluation protocol: the trained tokenizer is frozen, its output is cast into a fixed-capacity serialized contract, and a shared lightweight Transformer probe independently measures each tokenizer's retained information under strictly matched conditions. Multi-seed paired statistical testing shows that GSToken consistently and substantially outperforms capacity-matched adaptive baselines under frozen probing, with uniform advantages across all tumor sub-regions, surface, and distance metrics. These results demonstrate that explicitly encoding spatial geometry within tokens significantly improves the information density of volumetric representations, offering a new design principle for compact 3D medical image representation and downstream reading.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. BrainG3N: A Dual-Purpose Tokenizer for Controllable 3D Brain MRI Generation

    Jun 17, 2026Max Van Puyvelde, Ibrahim Gulluk, Wim Van Criekinge +1Masked AutoencodersLatent Diffusion Models

  2. TokenGS: Decoupling 3D Gaussian Prediction from Pixels with Learnable Tokens

    Apr 16, 2026Jiawei Ren, Michal Jan Tyszkiewicz, Jiahui Huang +13D Gaussian Splatting3D ViTs