Reasoning Segmentation

Follow this topic Ask about this topic

Momentum

3 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 19

All topics

Revisit to Segment: Working Memory Distillation for Reasoning Segmentation
Sep 28, 2026Cilin Yan, Yilun Qiu, Wanyang Zhang +4Text-Guided Image Segmentation Multimodal Large Language Models
Xiaohongshu · NTU · PKU
OPERA: A Unified Omnimodal Progressive Spatio-Temporal Reasoning Agent for Referring Video Segmentation
Sep 27, 2026Jingchen Ni, Yuji Wang, Shannan Yan +3Unified Multimodal Models Referring Video Object Segmentation
Tsinghua University · University of California San Diego · ETH Zurich
SeGDeP: Semantic- and Geometric-Aware Decoupled Prompts for Reasoning Segmentation
Sep 8, 2026Linnan Zhao, Xu Liu, Lingling Li +3Text-Guided Image Segmentation Promptable Image Segmentation
Xidian University Xi’an, China
GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning
Aug 25, 2026Shuaishuai Cao, Min Huang, Meng Tang +3Spatial Reasoning Benchmarks Geospatial Reasoning
Central South University · Jiangxi Normal University · Hohai University +2
DGSeg: Dynamic Gating of Semantic-Spatial Guided Predictions for Reasoning Segmentation
Jul 6, 2026Ruizhe Zeng, Siyu Cao, Lu Zhang +1Text-Guided Image Segmentation VLM Reasoning
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China · Nanjing Artificial Intelligence Research of IA, Nanjing, 211100, China
STAC: Selective Spatiotemporal Aggregation and Compression for Video Reasoning Segmentation
Jul 3, 2026Syed Ariff Syed Hesham, Yun Liu, Guolei Sun +4Video Reasoning Reasoning Segmentation
School of EEE, Nanyang Technological University, Singapore · Institute for Infocomm Research, A*STAR, Singapore · VCIP, CS, Nankai University, Tianjin, China +4
GEAR-Seg: A Grounded Explainable Agent for Reasoning Segmentation and Data Engine
Jul 1, 2026Yanan Wang, Wen Li, Yibin Ying +1Text-Guided Image Segmentation VLM Reasoning
College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, China · ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University, Hangzhou 311215, China
Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoning
Jun 8, 2026Xinyan Gao, Haoran Hao, Xiangyu YueImage Segmentation Text-Guided Image Segmentation
MMLab, The Chinese University of Hong Kong · Nanjing University
VideoSEG-O3: A Multi-turn Reinforcement Learning Framework for Reasoning Video Object Segmentation
Jun 5, 2026Ming Dai, Sen Yang, Boqiang Duan +4Video Object Segmentation Referring Video Object Segmentation
School of Automation, Southeast University, Nanjing, China · Baidu Inc, Beijing, China · College of Information Science & Electronic Engineering, Zhejiang University, Hangzhou, China
CR-Seg: Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation
Jun 2, 2026Yifan Cao, Xiaocui Yang, Faxian Wan +3Text-Guided Image Segmentation Promptable Image Segmentation
School of Computer Science and Engineering, Northeastern University Shenyang 110819, China
FlowSeg: Dynamic Semantic Guidance for LLM-Conditioned Segmentation
May 28, 2026Zekang Zhang, Guangyu Gao, Youyun Tang +7Text-Guided Image Segmentation Referring Image Segmentation
School of Computer Science, Beijing Institute of Technology · School of Computer Science, University of Birmingham · WEI Lab, Institute of Information Science, Beijing Jiaotong University +1
ReasonOps: Operator Segmentation for LLM Reasoning Traces
May 28, 2026Daniel Lee, Owen Queen, James ZouCoT Evaluation CoT Reasoning
Stanford University
Can Segmentation Models Understand the World? Towards Proactive Affordance Reasoning via Visual Chain-of-Thought
May 26, 2026Yuchen Guo, Junli Gong, Hongmin Cai +2Image Segmentation Text-Guided Image Segmentation
Northwestern University · Northeastern University · South China University of Technology +2
SegCompass: Exploring Interpretable Alignment with Sparse Autoencoders for Enhanced Reasoning Segmentation
May 21, 2026Zhenyu Lu, Liupeng Li, Jinpeng Wang +4Image Segmentation Text-Guided Image Segmentation
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences · Peng Cheng Laboratory · University of Chinese Academy of Sciences +3
SteerSeg: Attention Steering for Reasoning Video Segmentation
May 14, 2026Ali Cheraghian, Hamidreza Dastmalchi, Abdelwahed Khamis +3Video Object Segmentation Referring Video Object Segmentation
1Macquarie University · 2York University · 3CSIRO Data61 +1
RCoT-Seg: Reinforced Chain-of-Thought for Video Reasoning and Segmentation
May 8, 2026Junwei Wen, Deshui Miao, Guangming Lu +2Video Object Segmentation Video Reasoning
Harbin Institute of Technology, Shenzhen · Pengcheng Laboratory · Pazhou Lab (Huangpu)
AnchorSeg: Language Grounded Query Banks for Reasoning Segmentation
Apr 20, 2026Rui Qian, Chuanhang Deng, Qiang Huang +6Image Segmentation Text-Guided Image Segmentation
College of Computer Science and Artificial Intelligence, Fudan University · 2BEDI Cloud
PixDLM: A Dual-Path Multimodal Language Model for UAV Reasoning Segmentation
Apr 17, 2026Shuyan Ke, Yifan Mei, Changli Wu +4Image Segmentation Remote Sensing Image Segmentation
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China · Shanghai Innovation Institute
MediRound: Multi-Round Entity-Level Reasoning Segmentation in Medical Images
Nov 15, 2025Qinyue Tong, Ziqian Lu, Jun Liu +3Interactive Medical Image Segmentation Text-Guided Image Segmentation
Zhejiang University, Hangzhou, Zhejiang, China · Zhejiang Sci-Tech University, Hangzhou, Zhejiang, China · National University of Singapore, Singapore

Sep 28, 2026, cs.CVJ/K move · Enter open · S save

Revisit to Segment: Working Memory Distillation for Reasoning Segmentation

Cilin Yan, Yilun Qiu, Wanyang Zhang, Rui Zu+3

Xiaohongshu · NTU · PKU

Text-Guided Image Segmentation Multimodal Large Language Models Reasoning Segmentation Knowledge Distillation

Open paper AskPDF arXiv

Multimodal large language models (MLLMs) have approached image segmentation by reasoning about visual content and predicting target locations. Their generated responses contain reasoning traces and localization proposals that can serve as working memory when revisiting the same image and query. Our exploration reveals that MLLMs benefit from using this self-generated working memory as context, leading to enhanced reasoning segmentation. Motivated by this finding, we seek to strengthen the backbone model's reasoning segmentation capabilities by distilling the guidance gained from revisiting prior attempts, enabling it to benefit with or without working memory at inference time. To this end, we propose Reasoning Segmenter with Working Memory (SWiM), a working-memory distillation framework for reasoning segmentation. Specifically, SWiM selects rollouts based on segmentation quality to construct working memory and uses the memory-conditioned model as a teacher. The teacher provides token-level distributional supervision along student-generated trajectories, while the student receives only the original image and query. Joint optimization of on-policy self-distillation and outcome-based reinforcement learning combines working-memory guidance with direct feedback on segmentation quality. Extensive experiments on reasoning segmentation benchmarks demonstrate that SWiM achieves state-of-the-art performance, validating the effectiveness of working-memory distillation.

Momentum

Related topics

Latest papers 19