Text-Guided Image Segmentation

Overview

Text-guided image segmentation studies how to turn class names, referring expressions, clinical reports, and instructions into precise pixel-level masks. Common approaches align language and visual features with contrastive learning or cross-attention, condition segmentation models such as Segment Anything with text prompts or lightweight adapters, and use generative models or multimodal reasoning to propose and refine masks. These methods support settings from open-vocabulary recognition to medical and remote-sensing segmentation, with training-free, few-shot, and supervised approaches. A central challenge is grounding varied or ambiguous language in accurate boundaries across domains while balancing robustness, reliability, and computational cost.

Latest papers

CardsList

103 papers13 papers in the last four weeks, up 117% on the four weeks before. 0.1% of all new papers.

  1. NativeSeg: Native Vision Language Segmentation of 3D Computed Tomography via Spatial Visual Tokens and Verified Local Zoom

    Nov 18, 2026Chengqian Ma, Gaole Dai, Zijie Meng +53D Medical Image SegmentationText-Guided Image Segmentation

  2. Counterfactual Analysis of Extent Leakage from Annotation-Derived Prompts in Vision-Language Medical Image Segmentation

    Nov 10, 2026Niran Nataraj, Ankita Das, C. Krishna Mohan +1Label LeakageData Leakage

  3. Prompt2Echo (P2Echo): Text-Prompted Multi-View Echocardiography Segmentation with One Model

    Nov 10, 2026Moein Heidari, Alvin Kimbowa, Mahdi Tabatabaei +8Ultrasound Image SegmentationEchocardiography

  4. Segment What It Can Draw: Querying a Text-to-Image Generator with Its Own Images for Skin Lesion Segmentation

    Nov 4, 2026Hongyu Cao, Guangfu Guo, Jinghan Zhang +3Skin Lesion SegmentationText-Guided Image Segmentation

  5. CAPTOR: text-encoder-free grounding by counting caption co-occurrence over the visual words of a frozen encoder

    Nov 3, 2026Elad Yoshai, Natan T. ShakedVision-Language GroundingText-Guided Image Segmentation

  6. From Visual Matching to Textual Conditioning: Cross-Domain Few-Shot Segmentation via Reference Inversion

    Nov 2, 2026Jiahao Nie, Yun Xing, Wenbin An +4Few-Shot Semantic SegmentationSemantic Segmentation

  7. RepConTUR: A Report-Conditioned Volumetric Multimodal Model for Abdominal Tumor Segmentation

    Oct 29, 2026Seunghwan Lee, Sangjoon Park, Jongmin Lee +4Medical Image Segmentation3D Medical Image Segmentation

  8. GarmentSegAgent: Autonomous Garment Segmentation for Web Fashion Images via Textual Self-Refinement

    Oct 27, 2026Jia Chen, Chao Huang, Xinrong Hu +3Text-Guided Image SegmentationSemantic Segmentation

  9. DROA-CLIPSeg: Prompt-Guided Thin Crack Segmentation in Low-Light Conditions

    Oct 24, 2026Vinita Shukla, Partibha Jangra, Vinayak Pathak +2Crack SegmentationImage Segmentation

  10. LLMSeg: Training-Free Text-Prompted Image Segmentation with B-Splines

    Oct 21, 2026Abdullah HamdiImage SegmentationText-Guided Image Segmentation

  11. Reliability-Guided Vision-Language Decoding with Text-Aware Skip Refinement for Medical Image Segmentation

    Oct 20, 2026Sivan Talaei, Fatemeh Daneshfar, Abdulhady Abas Abdullah +1Medical VLMsMedical Image Segmentation

  12. Efficient SAM3 Adaptation for Multi-Class Semantic Segmentation via Dense Competitive Representations

    Oct 20, 2026Wenbin Liao, Hao Zhu, Yike Ma +2Promptable Image SegmentationSemantic Segmentation

  13. Visual Memory and Textual Alignment for Cross-Modal Few-Shot Segmentation

    Oct 19, 2026Tianqi Wei, Zhi Chen, Xin Yu +2Few-Shot Semantic SegmentationText-Guided Image Segmentation

  14. FloodVLM-Pix: Language-Guided Pixel-Level Flood Understanding

    Oct 16, 2026Chengyang Zhang, Zhihao Wang, Zhiyu Long +4Remote Sensing VLMsText-Guided Image Segmentation

  15. Text-Guided Medical Image Segmentation via Residual Aggregation and Dense Alignment Representations

    Oct 10, 2026Jie Gui, Hang Tu, Yunfeng Dou +3Text-Guided Image SegmentationPromptable Image Segmentation

  16. VL-AcneSeg: A Vision-Language Framework for Region-Aware Acne Lesion Segmentation

    Sep 28, 2026Sukju Oh, Soo Ick Cho, Dae Hun Suh +1Text-Guided Image SegmentationMedical VLMs

  17. Multimodal Routing and Region Refinement for Language-Guided Medical Image Segmentation

    Sep 24, 2026Md Maklachur Rahman, Md Hasan Al Banna, Saraf Anjum +2Text-Guided Image SegmentationMedical Image Segmentation

  18. SIRA: Reasoning-Aware Surgical Instrument Segmentation via Query-Anchored Alignment

    Sep 18, 2026Zhibo Zhang, Qijie Wang, Zengqiang YanMedical Image SegmentationReasoning Segmentation

  19. PANORAMA: Panoptic Grounded Captioning via Mask Proposal Selection

    Sep 16, 2026Sara Pieri, Evangelos Kazakos, Shizhe Chen +2Image CaptioningPanoptic Segmentation

  20. ViCo-SAM3: Vision-Conditioned Alignment for Open-Vocabulary Camouflaged Object Segmentation

    Sep 14, 2026Qiangqiang Zhou, Wenjun Tang, Yong Chen +2Text-Guided Image SegmentationOpen-Vocabulary Semantic Segmentation

  21. InstEditSeg: Instruction-Driven Image Editing for Polyp and Skin Lesion Segmentation

    Sep 2, 2026Ziquan Liu, Zhewei Zhu, Xuyang ShiText-Guided Image SegmentationPolyp Segmentation

  22. Vision-Language-Guided Pseudo-Labels for Unsupervised Domain Adaptation in Semantic Segmentation for Waste Sorting

    Sep 1, 2026Udo Schlegel, Shubhangi, Gabriel Dax +3Unsupervised Domain AdaptationText-Guided Image Segmentation

  23. Text-to-seed generation: Training-free open-vocabulary seeded semantic segmentation via re-purposing diffusion as text-guided seed generator

    Aug 27, 2026Kumju Jo, Heesun Jung, Sungyong BaikOpen-Vocabulary Semantic SegmentationSemantic Segmentation

  24. DRAgent: Discriminative Reasoning Agent for Referring Expression Segmentation

    Aug 24, 2026Yujie Qi, Luyan ZhangReferring Expression SegmentationText-Guided Image Segmentation

  25. TEAMS: Text-prompted spatiotEmporal dual-heAd Mamba Snake

    Aug 18, 2026Ruicheng Zhang, Jianhui Lei, Kaiwen Shen +6Medical Image SegmentationText-Guided Image Segmentation