cs.CVNov 17, 2026

Leveraging Segmentation Representations for Efficient Classification: A Self-Configuring Framework Based on nnU-Net

Authors: Renjun Cai, Antonio Javier Gallego, Félix Fuentes-Hurtado

Organizations: Au Reikura School of Computing and Mathematical Sciences, University of Waikato, New Zealand · University Institute for Computing Research, University of Alicante, Spain

Abstract

We propose a self-configuring framework that extends the nnU-Net workflow to both segmentation and classification in 3D medical imaging. Building on nnU-Net's self-configuring method, the framework reuses representations learned by a segmentation model for image-level classification. Its encoder features and predicted segmentation probabilities are used by a lightweight classifier. Two information-sharing strategies are investigated. In the frozen-backbone branch, features are augmented with region-of-interest information, predicted foreground volume, and segmentation confidence. In the adaptation branch, the final encoder stage is partially fine-tuned for classification, with an auxiliary segmentation loss to preserve segmentation-related information. Additional five-fold experiments showed that more complex configurations did not consistently improve classification performance. On the public validation leaderboard, our selected framework achieved an Overall score of 0.8056. In the official FLARE 2026 Task 2 final evaluation, our framework ranked first overall, achieving the highest DSC, NSD, and AUROC across all four testing tasks, including two hidden testing tasks. Local inference measurements also remained below the challenge limits of 60s60 \mathrm{s} per case and 4GB4 \mathrm{GB} GPU memory. These results demonstrate the practical value of reusing segmentation representations for classification while maintaining a simple and efficient framework.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. LightMedSeg: Lightweight 3D Medical Image Segmentation with Learned Spatial Anchors

    Mar 7, 2026Kavyansh Tyagi, Vishwas Rathi, Puneet GoyalAnatomy-Guided Medical Image SegmentationMedical Image Segmentation

  2. APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms

    Jun 29, 2026Juntao Jiang, Jinsheng Bai, Linxuan Fan +3Medical Image Segmentation

  3. DAMamba-UNet3D: A Parameter-Efficient Mamba State Space U-Net with Dynamic Adaptive Scan for 3D Medical Image Segmentation

    Jul 21, 2026Mohammad Arafat Hussain, Ellen Grant, Yangming OuMambaU-Net