Referring Image Segmentation

Overview

Referring image segmentation studies how to identify and delineate the image region described by language, including expressions that distinguish one object from similar instances. Common approaches fuse vision and language features in segmentation networks, first ground a phrase to a box or region and then refine a mask, or adapt and prompt foundation models such as vision-language models and Segment Anything. Systems are commonly evaluated on RefCOCO, RefCOCO+, and RefCOCOg, with work also extending to video, remote sensing, and medical images. A central challenge is combining robust semantic and relational understanding with precise boundaries, while generalizing to unfamiliar domains and keeping inference and annotation costs manageable.

Latest papers

CardsList

51 papers8 papers in the last four weeks, up 167% on the four weeks before. 0.1% of all new papers.

  1. Open Vision Banana: A Fully Open Recipe for Generative Visual Perception

    Nov 11, 2026Arpit Jadon, Valentinos Pariza, Jona Ruthardt +4Open-Vocabulary Semantic SegmentationReferring Image Segmentation

  2. Where is My Mug? Training-Free Framework for Personalized Image Segmentation

    Nov 11, 2026Quang Qui-Vinh Nguyen, Hung Nguyen, Rang Nguyen +1Promptable Image SegmentationInteractive Image Segmentation

  3. Hint-Informed Self-Distillation for Reasoning Segmentation

    Nov 11, 2026Kunze Jiang, Yuchen Wang, Kang Li +1Reasoning SegmentationReferring Image Segmentation

  4. TopoDPO: Dense Preference Alignment for Structure-Sensitive Aerial Referring Segmentation

    Nov 1, 2026Huaiyuan Peng, Jisheng Dang, Wencan Zhang +6Referring Image SegmentationRemote Sensing Image Segmentation

  5. Cross-Scale Sparse Attention for Referring Segmentation in Remote Sensing

    Oct 24, 2026Yuxi Li, Lu Si, Xia Liao +4Referring Image SegmentationRemote Sensing Image Segmentation

  6. LLMSeg: Training-Free Text-Prompted Image Segmentation with B-Splines

    Oct 21, 2026Abdullah HamdiImage SegmentationText-Guided Image Segmentation

  7. Xiaomi-Lens-0 Technical Report

    Oct 16, 2026Pei Fu, Yike Liu, Yue Sun +13Large Vision-Language ModelsReferring Image Segmentation

  8. ContourVLA: A Closed-Loop Perception-Action Contour Policy for Generalized Referring Expression Segmentation

    Oct 8, 2026Ruicheng Zhang, Kaiwen Shen, Jiaqi Hou +6Referring Expression SegmentationReferring Image Segmentation

  9. 0.5%>100%: Bidirectional Reciprocal Learning for Referring Image Segmentation

    Sep 21, 2026Xiaoqiang Lu, Licheng Jiao, Lingling Li +5VLM AdaptationVision Foundation Model Adaptation

  10. Cost-efficient Active Learning for Referring Image Segmentation and Grounding

    Aug 31, 2026Junbeom Hong, Seonghoon Yu, Hyung Rok Jung +2Active LearningReferring Image Segmentation

  11. GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning

    Aug 25, 2026Shuaishuai Cao, Min Huang, Meng Tang +3Spatial Reasoning BenchmarksGeospatial Reasoning

  12. SOS! : A Streamlined Object-Conditional Transformer for Model-free Segmentation

    Aug 15, 2026Jiaqi Hu, Junwen Huang, Hongli Xu +4Image SegmentationReferring Image Segmentation

  13. FIRM: Fine-Grained Intra-Token Representation of Masks for Remote Sensing Reasoning Segmentation

    Aug 14, 2026Weidong Tang, Kaiyu Li, Yikai Wang +4Remote Sensing Image SegmentationReferring Image Segmentation

  14. DiCoR: Decoupled Referent Disambiguation and Contour Recalibration for Efficient Referring Remote Sensing Image Segmentation

    Aug 13, 2026Ziyang Gao, Zhizhuo Jiang, Jingjing Chang +5Remote Sensing Image SegmentationReferring Image Segmentation

  15. EgoAfford: Task-Oriented Affordance Grounding via Egocentric Referring Segmentation

    Aug 5, 2026Xinyuan Guan, Feifan Chen, Xinyu Zhan +3Multimodal GroundingLarge Language Model-Based Robot Planning

  16. CROSS: Cascaded Distillation and Dual-Constraint Grounding for Remote Sensing Referring Segmentation

    Aug 4, 2026Tingzhang Luo, Ruizhong Liu, Yichao Liu +3Referring Image Segmentation

  17. Better, Stronger, Faster, and Broader: Structured All-Mask Prediction for MLLM-Based Segmentation

    Aug 3, 2026Jiazhen Liu, Mingkuan Feng, Long ChenInstance SegmentationImage Segmentation

  18. VespaSeg: A Resource-Aware Ground-then-Segment Pipeline for Referring Expression Segmentation

    Aug 2, 2026Savindu Dilshan WickramasinghePromptable Image SegmentationEfficient VLM Inference

  19. GFR-SAM: Training-Free Referring Camouflaged Object Segmentation via Cross-Image Prompting

    Jul 13, 2026Yilong Yang, Jianxin Tian, Shengchuan Zhang +1Image SegmentationPromptable Image Segmentation

  20. Attribute Retrieving for Open-Vocabulary Endoscopic Compositional Referring Segmentation

    Jul 9, 2026Shun Liu, Nan Xi, Yang Liu +3EndoscopyMedical Imaging

  21. An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation

    May 31, 2026Bingyu Li, Da Zhang, Tao Huo +3Large Vision-Language ModelsReferring Image Segmentation

  22. FlowSeg: Dynamic Semantic Guidance for LLM-Conditioned Segmentation

    May 28, 2026Zekang Zhang, Guangyu Gao, Youyun Tang +7Text-Guided Image SegmentationReferring Image Segmentation

  23. PinPoint: Prompting with Informative Interior Points

    May 26, 2026Pouya Sadeghi, Shawn He, Pedro Pablo Guerrero Vela +3Image SegmentationPromptable Image Segmentation

  24. Image-Conditioned Instance Prompt Network for Referring Remote Sensing Image Segmentation

    May 23, 2026Biaoyu Ren, Qingsheng Wang, Cun Xu +2Remote Sensing Image SegmentationReferring Image Segmentation