Multimodal CoT Reasoning

CoT: Chain-of-Thought

Follow this topic Ask about this topic

Momentum

6 papers in the last four weeks, up 100% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 99

All topics

Latent Visual States for Efficient Multimodal Reasoning
Jun 23, 2026Xiuwei Chen, Wentao Hu, Yongxin Wang +8Efficient Multimodal Inference Large Vision-Language Models
Sun Yat-sen University · The Hong Kong Polytechnic University · MBZUAI +2
Chains That See, Answers That Don't: A Multi-Aspect Evaluation Recipe for Forced Chain-of-Thought on Video-MME
Jun 22, 2026Zhichao Fan, Yanhang Li, Zexin ZhuangVLM Evaluation Video QA
University of Illinois Urbana-Champaign Urbana, Illinois, USA · Northeastern University Boston, Massachusetts, USA · Southern Methodist University Dallas, Texas, USA
Look Light, Think Heavy: What Multimodal Chain-of-Thought Reasoning Can and Cannot Do
Jun 21, 2026Zhuoran Jin, Kejian Zhu, Hongbang Yuan +5Multimodal Reasoning VLM Reasoning
The Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
ThinkDeception: A Progressive Reinforcement Learning Framework for Interpretable Multimodal Deception Detection
Jun 17, 2026Jinhao Song, Shan Liang, Yiqun Yue +2RL for Language Model Reasoning Multimodal Large Language Models
Xi’an Jiaotong-Liverpool University · Suzhou, China
MathVis-Fine: Aligning Visual Supervision with Necessity via Progressive Dependency-Guided Training for Multimodal Mathematical Reasoning
Jun 16, 2026Wanshi Xu, Haokun Zhao, Haidong Yuan +2Multimodal Reasoning Multimodal Reward Modeling
School of ECE, Peking University · College of Computer Science and Artificial Intelligence, Fudan University · School of Software and Microelectronics, Peking University +1
Gen-VCoT: Generative Visual Chain-of-Thought Reasoning via Diffusion-Based RGB Intermediate Representations
Jun 15, 2026Zhiqiang Zhou, Junliang Dai, Xu lingVLM Interpretability Multimodal CoT Reasoning
Hunan Chemical Industry Vocational and Technical College, Zhuzhou, Hunan 412000, China
NeRD: Neuro-Symbolic Rule Distillation for Efficient Ontology-Grounded Chain-of-Thought in Medical Image Diagnosis
Jun 14, 2026Hongxi Yang, Yiwen Jiang, Siyuan Yan +8Medical Image Classification Multimodal CoT Reasoning
Department of Data Science & AI, Faculty of Information Technology, Monash University, Melbourne, Australia · AIM for Health Lab, Faculty of Information Technology, Monash University, Melbourne, Australia · Faculty of Engineering, Monash University, Melbourne, Australia +2
CORA: Analyzing and bridging thinking-answer gap in Multimodal RLVR via Consistency-Oriented Reasoning Alignment
Jun 12, 2026Jiayue Cao, Zhicong Lu, Xuehan Sun +6Multimodal Reward Modeling VLM Reasoning
University of Chinese Academy of Sciences · 2Wuhan University · 3Tsinghua University +1
SVoT: State-aware Visualization-of-Thought for Spatial Reasoning via Reinforcement Learning
Jun 10, 2026Chao Lei, Yanbei Jiang, Markus Hiller +4Visual Spatial Reasoning Reinforcement Learning with Verifiable Rewards
School of Computing and Information Systems The University of Melbourne Melbourne, Australia
ReasonRec: A Reasoning-Augmented Multimodal Agent for Unified Recommendation
Jun 8, 2026Yihua Zhang, Mingfu Liang, Jiyan Yang +11Efficient Multimodal Inference Multimodal CoT Reasoning
Meta AI · Michigan State University · The University of North Carolina at Chapel Hill +1
Optical Reasoning: Rethinking Images as an Expressive Reasoning Medium Beyond Text
Jun 8, 2026Yutong Bian, Dongjie Cheng, Heming Xia +2Visual Reasoning Multimodal Reasoning
The Hong Kong Polytechnic University
CRANE: Knowledge Editing for Reasoning MLLMs
Jun 8, 2026Han Huang, Hao Wang, Mengqi Zhang +3Knowledge Editing Knowledge Conflicts in Language Models
University of Chinese Academy of Sciences, Beijing 101408, China, and also with the New Laboratory of Pattern Recognition (NLPR), CASIA, Beijing 100045, China · Harbin Institute of Technology, Weihai 264209, China · School of Computer Science and Technology, Shandong University, Qingdao 266237, China
TVI-CoT: Text-Visual Interleaved Chain-of-Thought Reasoning for Multimodal Understanding
Jun 7, 2026Lianyu Hu, Xiaoyu Ma, Zeqin Liao +1Multimodal Large Language Models Multimodal Reasoning
College of Computing and Data Science of Nanyang Technological University, Singapore.
VTI-CoT: Visual-Textual Interleaved Chain of Thought for Video Reasoning
Jun 4, 2026Shufan Zhang, Ziyue Lin, Bairun Wang +4Video Reasoning VLM Reasoning
Beijing University of Posts and Telecommunications · University of Hong Kong · Beijing Shanwei Zhixing Technology Co., Ltd. +2
CR-Seg: Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation
Jun 2, 2026Yifan Cao, Xiaocui Yang, Faxian Wan +3Text-Guided Image Segmentation Promptable Image Segmentation
School of Computer Science and Engineering, Northeastern University Shenyang 110819, China
Spectral-Progressive Thought Flow for Lightweight Multimodal Reasoning
Jun 1, 2026Yixian Shen, Zhiheng Yang, Qi Bi +6Efficient Multimodal Inference Visual Spatial Reasoning
Informatics Institute, University of Amsterdam, Amsterdam, The Netherlands · University of Thessaly, Volos, Greece · Department of Computer Science, University College London +3
Attention-guided Fine-tuning of Multimodal Large Language Models Improves Chain-of-Thought Reasoning
Jun 1, 2026Sanchit Sinha, Guangzhi Xiong, Bohan Liu +2Fine-Tuning Multimodal Large Language Models
University of Virginia
Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs
May 31, 2026Wentao Mo, Yang LiuCoT Distillation 3D Spatial Reasoning
Wangxuan Institute of Computer Technology, Peking University
Reasoning Matters: Mitigate Hallucination in Multimodal Large Reasoning Models via Reasoning-Conditioned Preference Optimization
May 27, 2026Jiawei Kong, Hao Fang, Shunxiang Liao +5Multimodal Grounding Direct Preference Optimization
Tsinghua Shenzhen International Graduate School, Tsinghua University · Harbin Institute of Technology, Shenzhen
How and What to Imagine? Visual Thinking in Unified Multimodal Models for Cross-View Spatial Reasoning
May 26, 2026Qian Yang, Ankur Sikarwar, Huy Le +4Visual Spatial Reasoning Unified Multimodal Models
Mila - Québec AI Institute · Université de Montréal · McGill University +2
InterSketch: An Interleaved Reasoning Model with Self-correcting Visual Sketch and Stepwise Reward
May 26, 2026Zhiwei Ning, Wenwen Tong, Xiangli Kong +12Multimodal Reasoning VLM Reasoning
Shanghai Jiao Tong University · SenseTime Research · Shandong Normal University
MuCRASP: Multimodal Chain-of-thought Reasoning aware Structured Pruning
May 25, 2026Aritra Dutta, Somak AdityaVision-Language Models Efficient VLM Inference
Indian Institute of Technology, Kharagpur
Diversity Over Frequency: Rethinking Tool Use in Visual Chain-of-Thought Agents
May 25, 2026Dong-Hee Kim, Reuben Tan, Donghyun KimTool Use in VLMs Agentic Reasoning
Department of Artificial Intelligence, Korea University, Seoul, South Korea · 2Microsoft Research, Redmond, USA.
GeoMathCode: Understanding Interleaved Math-Code Reasoning for Geometry Problem Solving
May 25, 2026Yingji Zhang, Yong Dai, André FreitasLatent Visual Reasoning Mathematical Reasoning
X-Humanoid, China · Department of Computer Science, University of Manchester, UK · Idiap Research Institute, Switzerland +1
ETCHR: Editing To Clarify and Harness Reasoning
May 22, 2026Beichen Zhang, Yuhong Liu, Jinsong Li +3Tool Use in VLMs Multimodal Reasoning
The Chinese University of Hong Kong · Shanghai AI Laboratory · Shanghai Jiao Tong University +2
LatentOmni: Rethinking Omni-Modal Understanding via Unified Audio-Visual Latent Reasoning
May 21, 2026Yifan Dai, Zhenhua Wu, Bohan Zeng +18Cross-Modal Learning Audio-Visual Understanding
School of AI, Shanghai Jiao Tong University · 2Kling Team, Kuaishou Technology · 3Peking University +5
ProCrit: Self-Elicited Multi-Perspective Reasoning with Critic-Guided Revision for Multimodal Sarcasm Detection
May 20, 2026Yingjia Xu, Jiulong Wu, Bowen Zhang +3LLM Self-Correction Multimodal CoT Reasoning
School of Computer Science and Technology, Soochow University, Suzhou, China · Baidu Inc., Beijing, China · Zhipu AI, Beijing, China
EgoCoT-Bench: Benchmarking Grounded and Verifiable Operation-Centric Chain of Thought Reasoning for MLLMs
May 19, 2026Yang Dai, Dian Jiao, Tianwei Lin +1Egocentric Video QA CoT Reasoning
Zhejiang University · Hangzhou, Zhejiang, China
Beyond the Cartesian Illusion: Testing Two-Stage Multi-Modal Theory of Mind under Perceptual Bottlenecks
May 18, 2026Yajing Zhou, Xiangyu KongAudio-Visual Understanding Visual Spatial Reasoning
College of Computer Science, Beijing Information Science and Technology University, No.55 Taihang Road, Changping District, Beijing, 102206, China
TTE-Flash: Accelerating Reasoning-based Multimodal Representations via Think-Then-Embed Tokens
May 15, 2026Jianpeng Cheng, Xian Wu, Jiangfan Zhang +10Efficient Multimodal Inference Multimodal Embedding
1Meta AI

Jun 23, 2026, cs.CVJ/K move · Enter open · S save

Latent Visual States for Efficient Multimodal Reasoning

Xiuwei Chen, Wentao Hu, Yongxin Wang, Zisheng Chen+7

Sun Yat-sen University · The Hong Kong Polytechnic University · MBZUAI+2

Efficient Multimodal Inference Large Vision-Language Models Multimodal Reasoning Latent Visual Reasoning Multimodal CoT Reasoning Multimodal Foundation Models+1

Open paper AskPDF arXiv

The integration of visual evidence has significantly enhanced the capabilities of large multimodal models. However, this integration predominantly relies on generating discrete outputs (etc., code or box coordinates) to invoke external tools, a process that introduces rigid dependencies and substantial latency. To overcome these limitations, we propose {EVA} (LatEnt Visual StAtes), a novel framework that natively generates continuous latent visual representations. These internal representations manifest as an adaptive sequence of Latent_slot tokens, serving as intermediate visual thoughts during the reasoning process. These Latent_slot tokens are then trained end-to-end with the discrete text tokens. This co-optimization, notably, causes extreme policy deviation in the 'transition window' following the Latent_slot tokens. We develop D-GSPO (Decouple-GSPO) to target this root cause by decoupling the optimization of latent and discrete components. To support SFT, we construct EVA-230K, a high-quality text-image interleaved CoT dataset encompassing a diverse range of real-world scenes, documents, charts and OCR tasks. Extensive experiments across multiple benchmarks confirm that EVA achieves significant performance gains while enhancing inference efficiency.

Momentum

Related topics

Latest papers 99