cs.CVNov 18, 2026

NativeSeg: Native Vision Language Segmentation of 3D Computed Tomography via Spatial Visual Tokens and Verified Local Zoom

Authors: Chengqian Ma, Gaole Dai, Zijie Meng, Weixuan Jin, Yijie Du, Yuexiao Ma, Xiawu Zheng, Fei Chao

Organizations: Peking University · Tsinghua University · Institute of Automation, Chinese Academy of Sciences · Nanyang Technological University · 

Abstract

Text prompted 3D computed tomography (CT) segmentation requires both full slice context and fine boundary precision across volumes where over 80%80\% of organ prompted slices lack the queried target. Existing medical vision language models (VLMs) are largely non native segmenters: they delegate pixel delineation outside the VLM by compressing reasoning into a 1D [SEG] vector for an external Segment Anything Model (SAM) decoder, quantizing masks into lossy discrete codebooks, or issuing box prompts to stateless external SAM tools without empty slice screening or spatial state memory. We introduce NativeSeg, a native vision language segmentation framework on Low Rank Adaptation (LoRA) adapted Qwen3.8-27B that performs dense mask decoding, volumetric triage, spatial error self diagnosis, and multiround local zoom directly over the VLM's 2D spatial visual tokens without external SAM decoders. NativeSeg decodes confidence maps from upper layer 2D spatial tokens fused with a five slice U-Net pathway, halts at zero zooms on >91%>91\% of standalone evaluations via a native presence gate (<pres>), localizes uncertain boundaries via a 20 cell multiscale error gate (<err>), and accepts zoomed updates only when predicted error decreases. Trained solely on adult CT, NativeSeg improves Round 00 DSC by +19.81+19.81 and +7.04+7.04 points over discrete codebook and 1D [SEG] readouts on the identical backbone, reaches 86.81%86.81\% adult and 87.04%87.04\% zero shot pediatric DSC, and safely refines 2D nnU-Net (89.52%89.52\% adult; 86.86%86.86\% pediatric), 3D SegVol (86.81%86.81\%), and 3D VoxTell (89.85%89.85\%).

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Automatic Segmentation of 3D CT scans with SAM2 using a zero-shot approach

    Mar 24, 2026Miquel Lopez Escoriza, Pau Amargant Alvarez3D Medical Image SegmentationZero-Shot Medical Image Segmentation

  2. OmniCT: Towards a Unified Slice-Volume LVLM for Comprehensive CT Analysis

    Feb 18, 2026Tianwei Lin, Zhongwei Qiu, Wenqiao Zhang +12Radiology VLMsMedical VLMs