Overview

Reasoning segmentation asks vision-language systems to identify the pixels belonging to targets described by complex instructions, scene context, or multi-step intent. Common approaches combine multimodal language models with chain-of-thought reasoning, attention or prompt-based localization, candidate-mask selection, and decoders such as SAM; some separate semantic interpretation from spatial grounding. Training uses supervised examples and increasingly reinforcement learning, while benchmarks cover still images and videos as well as settings such as medical, remote-sensing, and adverse-weather imagery. A central tension is how to improve reliable spatial and temporal grounding while keeping reasoning interpretable, efficient, and robust to unfamiliar queries and conditions.

Latest papers

CardsList

34 papers3 papers in the last four weeks, down 25% on the four weeks before. 0.0% of all new papers.

  1. Complexity-Aware Surgical Video Reasoning Segmentation with Digital Twin and Context Memory

    Oct 20, 2026Yiqing Shen, Mathias UnberathSurgical Video UnderstandingReasoning Segmentation

  2. GeoReason: Bridging Logical Reasoning and Spatial Fidelity in Remote Sensing Segmentation

    Oct 16, 2026Cheng Fan, Han Wu, Tingzhang Luo +3Reasoning SegmentationRemote Sensing Image Segmentation

  3. OPERA: A Unified Omnimodal Progressive Spatio-Temporal Reasoning Agent for Referring Video Segmentation

    Sep 27, 2026Jingchen Ni, Yuji Wang, Shannan Yan +3Unified Multimodal ModelsReferring Video Object Segmentation

  4. Skip the Talk, Re-Focus on Vision: Latent Reasoning for Reasoning Segmentation in Multimodal Large Language Models

    Sep 25, 2026Tianhang Guo, Yulin He, Wei Chen +3Reasoning SegmentationVLM Reasoning

  5. SIRA: Reasoning-Aware Surgical Instrument Segmentation via Query-Anchored Alignment

    Sep 18, 2026Zhibo Zhang, Qijie Wang, Zengqiang YanMedical Image SegmentationReasoning Segmentation

  6. GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning

    Aug 25, 2026Shuaishuai Cao, Min Huang, Meng Tang +3Spatial Reasoning BenchmarksGeospatial Reasoning

  7. FloodReasonBench: Benchmarking VLM Reasoning Segmentation for Embodied Flood Response at the Edge

    Aug 15, 2026Rajat Bhattacharjya, Yoomee Jung, Minwoo Kim +4Reasoning SegmentationVLM Evaluation

  8. DGSeg: Dynamic Gating of Semantic-Spatial Guided Predictions for Reasoning Segmentation

    Jul 6, 2026Ruizhe Zeng, Siyu Cao, Lu Zhang +1Text-Guided Image SegmentationVLM Reasoning

  9. STAC: Selective Spatiotemporal Aggregation and Compression for Video Reasoning Segmentation

    Jul 3, 2026Syed Ariff Syed Hesham, Yun Liu, Guolei Sun +4Video ReasoningReasoning Segmentation

  10. GEAR-Seg: A Grounded Explainable Agent for Reasoning Segmentation and Data Engine

    Jul 1, 2026Yanan Wang, Wen Li, Yibin Ying +1Text-Guided Image SegmentationVLM Reasoning

  11. Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoning

    Jun 8, 2026Xinyan Gao, Haoran Hao, Xiangyu YueImage SegmentationText-Guided Image Segmentation

  12. VideoSEG-O3: A Multi-turn Reinforcement Learning Framework for Reasoning Video Object Segmentation

    Jun 5, 2026Ming Dai, Sen Yang, Boqiang Duan +4Video Object SegmentationReferring Video Object Segmentation

  13. CR-Seg: Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation

    Jun 2, 2026Yifan Cao, Xiaocui Yang, Faxian Wan +3Text-Guided Image SegmentationPromptable Image Segmentation

  14. FlowSeg: Dynamic Semantic Guidance for LLM-Conditioned Segmentation

    May 28, 2026Zekang Zhang, Guangyu Gao, Youyun Tang +7Text-Guided Image SegmentationReferring Image Segmentation

  15. ReasonOps: Operator Segmentation for LLM Reasoning Traces

    May 28, 2026Daniel Lee, Owen Queen, James ZouLLM ReasoningReasoning Trace Analysis

  16. Can Segmentation Models Understand the World? Towards Proactive Affordance Reasoning via Visual Chain-of-Thought

    May 26, 2026Yuchen Guo, Junli Gong, Hongmin Cai +2Image SegmentationText-Guided Image Segmentation

  17. SegCompass: Exploring Interpretable Alignment with Sparse Autoencoders for Enhanced Reasoning Segmentation

    May 21, 2026Zhenyu Lu, Liupeng Li, Jinpeng Wang +4Image SegmentationText-Guided Image Segmentation

  18. SteerSeg: Attention Steering for Reasoning Video Segmentation

    May 14, 2026Ali Cheraghian, Hamidreza Dastmalchi, Abdelwahed Khamis +3Video Object SegmentationReferring Video Object Segmentation

  19. RCoT-Seg: Reinforced Chain-of-Thought for Video Reasoning and Segmentation

    May 8, 2026Junwei Wen, Deshui Miao, Guangming Lu +2Video Object SegmentationVideo Reasoning

  20. AnchorSeg: Language Grounded Query Banks for Reasoning Segmentation

    Apr 20, 2026Rui Qian, Chuanhang Deng, Qiang Huang +6Image SegmentationText-Guided Image Segmentation

  21. PixDLM: A Dual-Path Multimodal Language Model for UAV Reasoning Segmentation

    Apr 17, 2026Shuyan Ke, Yifan Mei, Changli Wu +4Image SegmentationRemote Sensing Image Segmentation

  22. Online Reasoning Video Object Segmentation

    Apr 13, 2026Jinyuan Liu, Yang Wang, Zeyu Zhao +3Video Object SegmentationReasoning Segmentation

  23. Efficient Reasoning via Thought Compression for Language Segmentation

    Apr 2, 2026Qing Zhou, Shiyu Zhang, Yuyu Jia +4Reasoning SegmentationCoT Compression

  24. GenMask: Adapting DiT for Segmentation via Direct Mask Generation

    Mar 25, 2026Yuhuan Yang, Xianwei Zhuang, Yuxuan Cai +6Image SegmentationVision Foundation Model Adaptation

  25. WeatherReasonSeg: A Benchmark for Weather-Aware Reasoning Segmentation in Visual Language Models

    Mar 18, 2026Wanjun Du, Zifeng Yuan, Tingting Chen +3VLM RobustnessVLM Reasoning

  26. StAR: Segment Anything Reasoner

    Mar 15, 2026Seokju Yun, Dongheon Lee, Noori Bae +3Reasoning SegmentationVLM Reasoning

  27. CORE-Seg: Reasoning-Driven Segmentation for Complex Lesions via Reinforcement Learning

    Mar 6, 2026Yuxin Xie, Yuming Chen, Yishan Yang +5Medical Image SegmentationReasoning Segmentation

  28. Discriminative Perception via Anchored Description for Reasoning Segmentation

    Mar 4, 2026Tao Yang, Qing Zhou, Yanliang Li +1Reasoning SegmentationVLM Reasoning