Multimodal CoT Reasoning

CoT: Chain-of-Thought

Follow this topic Ask about this topic

Momentum

6 papers in the last four weeks, up 100% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 99

All topics

OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoning
Oct 1, 2026Haibo Wang, Jiteng Mu, Jialu Li +5Audio-Visual Understanding RL for Language Model Reasoning
University of California, Davis · Adobe Research
Rethinking Multi-Image Re-Representation in Multi-Image Understanding
Sep 30, 2026Gengyuan Zhang, Xiao Han, Xinyu Xie +2Visual Representation Learning Multimodal CoT Reasoning
LMU Munich · MCML
MG-Thinker: Bi-Axial Self-Reflection for Multi-Image Reasoning Grounding
Sep 29, 2026Heyu Huang, Chi Chen, Zonghao Guo +3Multimodal Grounding Multimodal CoT Reasoning
Huazhong University of Science and Technology Wuhan, China · Tsinghua University Beijing, China
Reasoning with Image Generation
Sep 14, 2026Nishad Singhi, Hector Garcia Rodriguez, Aditya Arora +2Tool Use in VLMs VLM Reasoning
Technical University of Darmstadt & hessian.AI
Reason What Matters: Retrieval-Grounded Reasoning for Universal Multimodal Embeddings
Sep 14, 2026Mingzhou Jiang, Peixi Wu, Hang Cheng +7Multimodal IR Efficient Multimodal Inference
Tsinghua Shenzhen International Graduate School, Tsinghua University · School of Artificial Intelligence and Data Science, USTC · Kuaishou Technology +1
Beyond Generation and Accuracy: Diagnosing and Enhancing Visual Chain-of-Thought for Geometry Problem Solving
Sep 11, 2026Zhitong Dong, Jicai Pan, Yingguo Gao +3Mathematical Reasoning Multimodal CoT Reasoning
1Key Laboratory of New Generation Artificial Intelligence Technology, Southeast University Group · 2Ant
MCPO: Modality-Contrastive Preference Optimization for Multimodal Chain-of-Thought Compression
Sep 4, 2026Guangheng Yang, Zhenliang Ni, Zhenkai Wu +4Efficient Multimodal Inference Multimodal Large Language Models
Huawei Technologies Ltd. Shanghai, China
Learning Where Outcomes Change:Credit-Addressable Reasoning for Multimodal Geometry
Aug 31, 2026Jiani Guo, Junjie Wang, Jie Wu +5RL for Language Model Reasoning Credit Assignment in RL
1Tsinghua University · 3Zhejiang University · 2Microsoft Research
VERDICT: Training-Free Step-Wise Verification of Multimodal Reasoning via Disagreement-Aware Consensus
Aug 11, 2026Rohit Sinha, Kunal Tilaganji, Tanuja Ganu +3Multimodal Large Language Models Multimodal CoT Reasoning
Indian Institute of Technology, Hyderabad · Microsoft Research
Learning from Failures: Retrieval-Centric CoT via Hard Negatives for Unified Multimodal Retrieval
Aug 6, 2026Zelong Sun, Jun Wang, Kaicheng Yang +3Multimodal IR Multimodal CoT Reasoning
Glint Lab
Trace, Verify, and Correct: A Training-Free Framework for Spatial Reasoning in Multimodal LLMs
Aug 5, 2026Yang Yang, Jiawei Chen, Tairan Chen +1Multimodal Grounding Visual Spatial Reasoning
Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University · Zhongguancun Academy · Stevens Institute of Technology
CURV: Enhancing Chart Understanding Through Curriculum Visual Grounded Reasoning
Aug 3, 2026Xuehang Guo, Pingyue Zhang, Ruiyi Zhang +6Data Visualization Chart QA
1William & Mary · 2Northwestern University · 3Adobe +1
AdaThinkV: Adaptive Thinking for Token-Efficient Video Reasoning
Aug 3, 2026Jingqi Tian, Haoji Zhang, Lin Chen +7Efficient VLM Inference RL for Language Model Reasoning
Tsinghua Shenzhen International Graduate School, Tsinghua University · Alibaba Group · Peking University
OPLD: On-Policy Latent Distillation for Multimodal Reasoning
Jul 30, 2026Shoutai Zhu, Tianyang Xu, Bin Sun +3Multimodal Reasoning Latent Visual Reasoning
ByteDance
Talked Out of the Truth: Sycophancy in the Reasoning Chains of Multimodal Models
Jul 30, 2026Mahir Numayeer Islam, Gakuto Okuyama, Nikolaus Siauw +3LLM Sycophancy Multimodal CoT Reasoning
Adelaide University · Akita International University · RNA Tech +2
See2Think: Do Multimodal Models Really Use Intermediate Visual States?
Jul 29, 2026Siyu Yan, Zhuoran Yan, Haiying Xu +10Visual Reasoning Multimodal Reasoning
1The Hong Kong University of Science and Technology · 3Shanghai AI Laboratory · 2Central South University +4
Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Grounding
Jul 27, 2026Tianyi Gao, Han Fang, Tianyi Ding +9Multimodal Grounding Multimodal Large Language Models
State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · Xingchen AGI Lab, China Telecom Artificial Intelligence Technology (Beijing) Co., Ltd · Beijing University of Posts and Telecommunications +2
Offline-Online Curriculum RL for Multimodal Reasoning
Jul 26, 2026Wendi Deng, Hang Du, Guoshun Nan +11Reinforcement Learning RL for Language Model Reasoning
Beijing University of Posts and Telecommunications, Beijing, 100876, China. · BUPT Shenzhen Institute, ShenZhen, 518038, China. · Carnegie Mellon University, Pittsburgh, USA. +4
EVL-MCoT: Enhanced Vision-Language Multi-CoT for Harmful Meme Detection
Jul 24, 2026Hao Yang, Jin Wang, Xuejie ZhangContent Moderation VLM Reasoning
School of Information Science and Engineering, Yunnan University, Kunming, China
Visual Saliency Steering Distillation for Multimodal Chain-of-Thought Reasoning
Jul 24, 2026Hao Yang, Jin Wang, Xuejie ZhangVLM Distillation Multimodal QA
School of Information Science and Engineering, Yunnan University, Kunming, China
Constraint-Anchored Reasoning Traces
Jul 18, 2026Zehua Cheng, Wei Dai, Jiahao SunVisual Question Answering LLM Grounding
Department of Computer Science University of Oxford United Kingdom · FLock.io United Kingdom
DeltaV: Thinking with Visual State Updates in Unified Large Multimodal Models
Jul 9, 2026Pengjie Wang, Linger Deng, Zujia Zhang +6Efficient Multimodal Inference Unified Multimodal Models
Huazhong University of Science and Technology · MiLM Plus, Xiaomi Inc.
Scene Graph Thinking: Reinforcing Structured Visual Reasoning for Multimodal Large Language Models
Jul 7, 2026Zhiwei Yang, Yuanchen Wu, Nan Zhang +3Multimodal Large Language Models Multimodal CoT Reasoning
Tencent Youtu Lab, Shanghai, China · Fudan University, Shanghai, China
EventCoT: Event-centric Video Chain-of-thought for Reasoning Temporal Localization
Jul 6, 2026Youngkil Song, Yoonjae Baek, Dongwon Kim +3Temporal Video Grounding Multimodal CoT Reasoning
1Pohang University of Science and Technology, Pohang, South Korea · 2Korea Advanced Institute of Science and Technology, Daejeon, South Korea · 3Handong Global University, Pohang, South Korea
CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts
Jun 30, 2026Lianyu Hu, Shengqian Qin, Zeqin Liao +4Efficient Multimodal Inference Efficient Language Model Reasoning
Nanyang Technological University, Singapore · Shanghai Jiao Tong University, China · NKIARI, Shenzhen Futian, China +2
Modality-Driven Search with Holistic Trace Judging for ARC-AGI-2
Jun 30, 2026Johan LandVisual Reasoning Multimodal Reasoning
Independent Researcher
OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoning
Jun 29, 2026Haocong He, Chenfei Liao, Zichen Wen +13Visual Spatial Reasoning Multimodal Large Language Models
SJTU · HKUST(GZ) · Shanghai AI Lab +6
MER-R1: Multimodal Emotion Reasoning via Slow-Fast Thinking Synergy
Jun 26, 2026Zhiyuan Han, Beier Zhu, Wenwen Tong +8RL for Language Model Reasoning Multimodal Large Language Models
University of Science and Technology of China · 2SenseTime Research · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center +1
CORTEX: A Structured Reasoning Benchmark for Trustworthy 3D Chest CT MLLMs
Jun 25, 2026Hashmat Shadab Malik, Anees Ur Rehman Hashmi, Numan Saeed +3Radiology Report Generation 3D Medical Imaging
MBZUAI, Abu Dhabi, UAE · Hasso Plattner Institute, Potsdam, Germany · Khalifa University, Abu Dhabi, UAE
Teach-to-Reason: Competition-Guided Reasoning with a Self-Improving Teacher
Jun 24, 2026Xiao Han, Hao Liu, Zhimin Bao +5Medical VQA Medical VLMs
1AIRC, Midea Group

Oct 1, 2026, cs.CVJ/K move · Enter open · S save

OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoning

Haibo Wang, Jiteng Mu, Jialu Li, Jingru Yi+4

University of California, Davis · Adobe Research

Audio-Visual Understanding RL for Language Model Reasoning Multimodal Large Language Models Multimodal CoT Reasoning Multimodal Tool Use

Open paper AskPDF arXiv

We present OmniSeek, an agentic framework that transforms an Omni Large Language Model (Omni-LLM) into an active, multi-turn reasoning agent with native tool use. Rather than passively processing an entire audio-visual sequence in a single forward pass, OmniSeek makes evidence acquisition part of the reasoning process: it dynamically decides whether to look or listen, and over which temporal window, to retrieve sparse but critical evidence across different modalities within long contexts. Through an iterative multi-turn protocol, the retrieved raw audio or visual segments are appended back into the context to support subsequent reasoning. To cold-start this capability, we build a data engine that synthesizes OmniTraj-170K, a corpus of multi-hop Chain-of-Thought trajectories with interleaved audio and visual evidence. We first supervise the model on these trajectories to instill multi-turn tool-use behavior, and then further optimize the policy via a two-stage reinforcement learning with verifiable rewards. Moreover, we introduce an Audio-Visual Necessity objective that explicitly rewards successful trajectories whose reasoning depends on both modalities, discouraging single-modality shortcuts. Extensive experiments across a wide range of benchmarks demonstrate that OmniSeek learns adaptive cross-modal evidence seeking and consistently improves audio-visual reasoning performance.

Momentum

Related topics

Latest papers 99