cs.CVNov 16, 2026

State-Message Interaction Adapter for Cross-Domain Few-Shot Segmentation

Authors: Hang Xing, Yan Xia, Yongjiang Liu, Siqi Zhang, Xueming Ding

Organizations: Wuxi Key Laboratory of Photovoltaic Equipment Advanced Manufacturing Technology, Wuxi, China · Wuxi Autowell Technology Co., Ltd., Wuxi, China · Department of Control Science and Engineering, School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, China

Abstract

Cross-domain few-shot segmentation adapts natural-image pretrained encoders to medical or industrial domains from a few pixel-annotated support masks. Within frozen DINOv3, intermediate per-head attention messages already carry target-background distinctions that baseline final-layer similarities and predictions do not consistently reflect. We propose the State-Message Interaction Adapter (SMIA) to learn how per-head messages should update each receiving token representation while keeping pretrained attention and FFN parameters frozen. Inserted right after per-head aggregation, SMIA conditions the transformation of each head's aggregated output (message) on each patch's pre-attention feature (state), allowing similar contextual messages to produce distinct or opposing updates depending on the receiving position. Because scarce support masks cover only limited state-message combinations, a shared low-rank bilinear map confines the learned interactions to low-dimensional state, message, and output subspaces. Added before each adapted block's frozen FFN, these updates yield adapted features that are refined by frozen FFNs and deeper blocks for linear readout. With only 0.51M trainable parameters and single-pass, support-free inference, SMIA achieves six-dataset mean mIoUs of 77.40% at 5 shots and 80.99% at 10 shots across 20 medical and industrial tasks, surpassing the strongest prior methods by +3.61 and +3.93 percentage points. In controlled 10-shot comparisons across three benchmarks on the same DINOv3 backbone, SMIA also outperforms parameter-matched AdaptFormer, LoRA, and ParaX with a better precision-recall balance.

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. SD-FSMIS: Adapting Stable Diffusion for Few-Shot Medical Image Segmentation

    Apr 3, 2026Meihua Li, Yang Zhang, Weizhao He +2Diffusion Models for Medical Image SegmentationFew-Shot Medical Image Segmentation

  2. PrAda: Few-Shot Visual Adaptation for Text-Prompted Segmentation

    May 19, 2026Gabriele Rosi, Fabio Cermelli, Carlo Masone +1VLM AdaptationText-Guided Image Segmentation