eess.IVAug 24, 2026

Multi-Stage Prompt-Guided Feature Modulation for Generalizable Brain Tumor Segmentation

Authors: Mohammad Mahdi Danesh Pajouh, Sara Saeedi

Organizations: University of Calgary

Abstract

Accurate brain tumor segmentation from magnetic resonance imaging (MRI) is essential for diagnosis, treatment planning, surgical guidance, and disease monitoring. However, developing automated segmentation models that generalize across diverse tumor characteristics, imaging protocols, acquisition sites, and patient populations remains challenging. Variations in tumor morphology and imaging distributions can substantially degrade performance outside the training domain. Consequently, improving the robustness and generalization of deep learning-based segmentation models has become a key objective in medical image analysis. To improve segmentation robustness, we propose Multi-Stage Dynamic Prompt nnU-Net, a prompt-conditioned extension of nnU-Net. Three independent dynamic prompt modules are inserted into the deepest encoder stages. Each module contains a learnable bank of ten 256-dimensional prompt vectors and uses globally pooled encoder features to generate image-specific prompt representations. These representations are projected into feature-wise scaling (γ)(γ) and shifting (β)(β) parameters that modulate encoder feature maps through Feature-wise Linear Modulation (FiLM), enabling adaptive feature conditioning at multiple semantic levels. Evaluation on the BraTS GOAT validation dataset demonstrated that the proposed Multi-Stage Dynamic Prompt nnU-Net outperformed the baseline nnU Net across the majority of evaluated metrics and tumor subregions. The proposed model achieved average lesion-wise Dice scores of 76.16% (ET), 80.04% (TC), and 86.42% (WT), compared with 74.38%, 78.14% and 84.01% for the baseline model. The results demonstrate that multi-stage dynamic prompt conditioning improves segmentation accuracy and boundary delineation for brain tumor segmentation.

Explore similar work

CardsList
  1. A Novel Global Context-aware Deep Neural Network for Enhanced Brain Tumor Segmentation using Magnetic Resonance Images

    May 28, 2026Sourjya Mukherjee, Ananya Bhattacharjee, R. MuruganU-NetMedical Image Segmentation

  2. Lightweight Vision Transformer-Based U-Net for Brain Tumor Segmentation from MRI

    Sep 24, 2026Sheekar Banerjee, Md. Srabon Chowdhury, Md. Mahbub Hasan Akash +1Hybrid CNN-Transformer ArchitecturesVision Transformer

  3. On the Role of MRI Sequences in Cross-Dataset Generalization for Brain Tumor Segmentation

    Aug 30, 2026Henrique Zan Grande, João G. Pitol, Lucas B. Schuck +3Domain AdaptationMagnetic Resonance Imaging