VLM Reasoning

VLM: Vision-Language Model

Follow this topic Ask about this topic

Momentum

70 papers in the last four weeks, up 250% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28

Latest papers 541

All topics

Frame Differential On-Policy Self-Distillation for Video Reasoning
Sep 30, 2026Haiying He, Xin Zheng, Shaoli Hu +4On-Policy Self-Distillation Video Reasoning
HKUST · NKU · SEU +1
Soft Spatial Reasoning
Sep 30, 2026Rafi Ibn Sultan, Md. Sajid Alam Chowdhury, Saleh Zare Zade +4Visual Spatial Reasoning VLM Reasoning
Department of Computer Science, Wayne State University · Department of Radiation Oncology, Henry Ford Health · Department of Electrical and Computer Engineering, The Ohio State University +1
ThinkV2V: Unleashing the Reasoning Capability of MLLMs for Instruction-Guided Video Editing
Sep 29, 2026Donghao Zhou, Haoyang He, Fan Zhang +10Video Editing Benchmarks Video Diffusion Models
The Ohio State University
LoopVL: Recurrent Visual Intelligence
Sep 29, 2026Zhe Qian, Ziyang Gong, Zhongxing Xu +9Vision-Language Models Large Vision-Language Models
Gaoling School of Artificial Intelligence, Renmin University of China · Baidu · Shanghai Jiao Tong University +5
Composition, Not Conversation: VLMs Lose the Scene, Not the Thread
Sep 29, 2026L. D. M. S. Sai Teja, Ufaq Khan, N. Siva Gopala Krishna +5VLM Evaluation Visual Question Answering
NIT Silchar · MBZUAI · BML Munjal University +1
NeuronEye: Query-Guided Visual Concept Activation for Vision-Language Reasoning
Sep 29, 2026Ruiyu Yan, Bowen Chen, Shaowen Wan +1VLM Interpretability VLM Reasoning
New York University · New Jersey Institute of Technology
SAM Meets VLM: Parameter-Decoupled Full-Parameter Training for Unified Medical Reasoning and Segmentation
Sep 29, 2026Xuyang Cao, Enyou Liu, Jun Zhao +3Interactive Medical Image Segmentation Text-Guided Image Segmentation
JDH Algo, JD Health International Inc.
Spatial-OPSD: Self-Improving Spatial Reasoning via Label-Free Self-Distillation
Sep 29, 2026Zhenyu Liu, Zhangquan Chen, Keyi Chen +4Visual Spatial Reasoning 3D Spatial Reasoning
Tsinghua University · LMMs-Lab · Xi’an Jiaotong University
DSPO: Diversity-aware Subjective Policy Optimization for Robust Emotional Reasoning
Sep 29, 2026Cheng Ye, Weidong Chen, Bingyan Xu +1VLM Robustness Multimodal Reasoning
University of Science and Technology of China, Hefei
FocusVTC: Efficient and High-Performance Visual Text Compression with Adaptive Resolution
Sep 29, 2026FangZhi Zhong, Xuerui Qiu, Yuqi Pan +4Efficient VLM Inference VLM Reasoning
Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · Zhongguancun Academy +1
LeRF: Learning Reference Coordinate Frames for Perspective Taking Reasoning
Sep 28, 2026Bang Xiao, Wenqi Jia, Ozgur Kara +5Visual Spatial Reasoning Visual Reasoning
University of Illinois Urbana-Champaign · Zhiyuan College, Shanghai Jiao Tong University · University of California, Merced +2
ReVA: A Scene-Centric Dataset Beyond Repetition for Remote Sensing Video Question Answering
Sep 28, 2026Zhen Yao, Likai Wang, Yuming Yang +9Remote Sensing VQA Video QA
Lehigh University · University of Southern California · Qualcomm AI Research
Token-Disentangled Latent Test-Time Scaling for Vision-Language Reasoning
Sep 28, 2026Hao-Xuan Ma, Yihao Liu, Yutao Sun +8Test-Time Scaling for VLMs Test-Time Scaling
Qwen Business Unit of Alibaba · School of Artificial Intelligence, Nanjing University · National Key Laboratory for Novel Software Technology, Nanjing University +5
ReSight-SMC: Two-Stage Power Sampling via Island SMC with Visual Scouts
Sep 28, 2026Yaowen Zhang, Xiangyu Qiu, Junyi Hu +5Markov Chain Monte Carlo Large Vision-Language Models
Independent Researcher · University of Electronic Science and Technology of China · Tsinghua University
WM-VLM: Probing Internal World Models for Interleaved Visual-Textual Reasoning
Sep 28, 2026Yuheng Zha, Yilei Wang, Qiyue Gao +5World Model Learning 3D Spatial Reasoning
UC San Diego · Institute of Foundation Models, MBZUAI · Carnegie Mellon University
From Perception to Integration: Revisiting the Internal Dynamics of Reasoning in Vision-Language Models
Sep 28, 2026Rong Yu Xu, Prayag Tiwari, Shaolei ZhangEfficient VLM Inference VLM Interpretability
Shenzhen College of International Education · Halmstad University, Sweden · Renmin University of China
Distilling Visual Reasoning into Text Space
Sep 28, 2026Wenhan Yang, Nilay Naharas, Ali Payani +1CoT Distillation VLM Distillation
University of California, Los Angeles · Cisco Research
Geometric Encoding for Spatial Reasoning in Vision-Language Models
Sep 28, 2026Antonio Jun, Haoshui Yu, Zhengyi Lu +2Visual Spatial Reasoning VLM Reasoning
School of Arts and Sciences New York University New York City, United States · Dept. of Engineering and Computer Science Oakland University Rochester, United States
Beyond Retrieval Relevance: Scene-Grounded Risk Entailment for Vision-Language Driving
Sep 28, 2026Jiaxin Liu, Ruilin Yu, Liang Peng +8VLMs for Autonomous Driving Autonomous Driving
School of Vehicle and Mobility, Tsinghua University · Xiaomi EV · Jilin University
SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoning
Sep 28, 2026Ruifan Zuo, Guocheng Hu, Wanshui Gan +3Visual Spatial Reasoning VLM Reasoning
Shandong University · Shanghai AI Laboratory · Zhiyang Innovation Co., Ltd.
SCOPD: Sparse-Context On-Policy Self-Distillation for Efficient Vision-Language Models
Sep 28, 2026Ahmadreza Jeddi, Enming Zhang, Jasper Gerigk +12Efficient VLM Inference On-Policy Self-Distillation
University of Toronto · Vector Institute · Samsung AI Center Toronto +7
BIRD: Distilling Decision Boundaries into Rationales for MLLM Adaptation
Sep 27, 2026Anglin Liu, Yanlin Wu, Ruichao Chen +6VLM Adaptation VLM Reasoning
HKUST(GZ) · HKUST
Seeing and Solving Are Not Enough for Vision-Language Models
Sep 27, 2026Ziheng Wang, Mingxuan Xie, Yilin Liu +3VLM Evaluation Visual Question Answering
Sun Yat-sen University · Zhejiang University · The Hong Kong University of Science and Technology +2
SpatialSpeak: QA-Native Reconstruction with Local and Global Context for Spatial Chain-of-Thought Reasoning
Sep 27, 2026Yang Cao, Jiaxin Zhang, Dave Zhenyu Chen +4Visual Spatial Reasoning 3D Spatial Reasoning
Hong Kong University of Science and Technology · Harbin Institute of Technology · Huawei Noah’s Ark Lab
SphMind: Towards Robust, Training-Free VLM-based Spatial Reasoning with a 360 Camera
Sep 27, 2026Shriram Damodaran, Soumyaratna Debnath, Cheston Tan +1Test-Time Adaptation of VLMs 3D Spatial Reasoning
IHPC, A*STAR, Singapore
CCRV-Bench: Constraint-Based Evaluation of Causal Reasoning in Vision-Language Models
Sep 25, 2026Linyuan Gao, Yuan Wu, Yi ChangVLM Evaluation VLM Reasoning
School of Artificial Intelligence, Jilin University Changchun 130012, China · Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, Jilin University Changchun 130012, China · International Center of Future Science, Jilin University Changchun 130012, China
Multimodal Thinking with Renderable Programs
Sep 24, 2026Sunli Chen, Ding Zhong, Ziqiao Ma +6Multimodal Reasoning VLM Reasoning
University of Massachusetts Amherst · University of Michigan · University of Illinois Urbana-Champaign +1
Seeing Is Not Measuring: Tool-Augmented Metric Spatial Reasoning for Vision-Language Models
Sep 24, 2026Kai Glantz, Clemens GrangeTool Use in VLMs 3D Spatial Reasoning
Technical University of Munich
Looks the Same, Answers Differently: Flip-Direction Steering for Robust Vision-Language Reasoning
Sep 23, 2026Yeonsung Jung, Joonhyun Jeong, Hoang Pham +4VLM Robustness Counterfactual Evaluation of VLMs
Graduate School of AI, KAIST · NAVER Cloud · Department of Computer Science and Engineering, The Ohio State University +3
DrGait: Biomechanically Grounded Visual Reasoning for Interpretable Clinical Gait Analysis
Sep 23, 2026Xiangyu Yin, Shiqi Wang, Abrar Alamri +4Vision-Language Models Gait Analysis
University of Pittsburgh

Sep 30, 2026, cs.CVJ/K move · Enter open · S save

Frame Differential On-Policy Self-Distillation for Video Reasoning

Haiying He, Xin Zheng, Shaoli Hu, Shijun Xiao+3

HKUST · NKU · SEU+1

On-Policy Self-Distillation Video Reasoning VLM Reasoning RL for VLMs

Open paper AskPDF arXiv

Reinforcement learning (RL) has substantially improved the reasoning ability of multimodal language models through verifiable rewards and increasingly fine-grainedvisual or temporal credit assignment. In video reasoning, however, current RL methods typically train with a fixed sparse frame budget: increasing the number of frames makes autoregressive rollouts expensive, while too few frames may miss temporally localized events and fine-grained visual details. We present \textbf{Frame Differential On-Policy Self-Distillation (FD-OPSD)}, which transfers the useful evidence of dense frame observations to a sparse frame policy during RL training. FD-OPSD compares the policy's token level preferences for the same sampled response under sparse and dense views, and distills the resulting frame differential signal without an external teacher or dense autoregressive rollout. The method preserves sparse-frame rollouts and leaves inference unchanged. Across Qwen2.5-VL-7B and Qwen3-VL-4B on six video reasoning benchmarks, FD-OPSD yields higher overall average performance than the strongest corresponding GRPO, T-GRPO, or Video-KTR baselines across the 16, 32, and 64 frame evaluation settings. These results show that dense visual evidence can be transferred selectively during training through token level self-distillation while retaining sparse frame rollouts and unchanged inference.

Momentum

Related topics

Latest papers 541