Multimodal CoT Reasoning

CoT: Chain-of-Thought

Overview

Multimodal chain-of-thought reasoning asks how models can combine images, video, audio, and text across intermediate steps to answer questions, solve problems, or act. Common approaches include supervised fine-tuning and distillation on reasoning traces, reinforcement learning with step-level or outcome rewards, and interleaving text with visual evidence, tool use, or compact latent states. Benchmarks test settings such as visual mathematics, spatial reasoning, video understanding, charts, documents, and medical imaging, increasingly evaluating whether each step is grounded in evidence rather than only whether the final answer is correct. A central tension is that explicit reasoning can improve complex problem solving but may also increase cost, rely on textual shortcuts, or weaken visual grounding, so adaptive and more faithful reasoning remains an open goal.

Latest papers

CardsList

148 papers4 papers in the last four weeks, down 64% on the four weeks before. 0.0% of all new papers.

  1. Interleaving anatomical inspection and diagnostic reasoning for explainable radiology report generation

    Nov 10, 2026Chentao Huang, Runlong Lin, Zhijun Wang +5Radiology Report GenerationExplainable Medical Image Analysis

  2. Lookahead Prediction-Guided Adaptive Visual Refocusing for Interleaved Multimodal Reasoning

    Nov 2, 2026Mengzhao Wang, Yanli Ji, Peng YeMultimodal CoT ReasoningTest-Time Adaptation of VLMs

  3. SelfThinker: Self-Evolving Reasoning via Reliability-Verified Intrinsic Visual Thoughts

    Oct 29, 2026Zhangquan Chen, Ruqi HuangReasoning for VLMsVision-Language Models

  4. TempoMoE: Identifying and Steering Fast-Slow Thinking Experts for Efficient Multimodal Reasoning

    Oct 19, 2026Xiyue Zhang, Keru Zhou, Ziyi Wang +2Mixture-of-Experts InferenceEfficient Multimodal Inference

  5. Visual Scaffolding: Toward Native Multimodal Reasoning

    Oct 18, 2026Run Shao, Zhaoyang Zhang, Ziyu Li +6Multimodal ReasoningVLM Reasoning

  6. ANCHOR: Audio-Visually Grounded Chain-of-Thought Reasoning Benchmark

    Oct 16, 2026Joel Julin, Souraja Kundu, Liza Dahiya +6Multimodal Model EvaluationMultimodal Grounding

  7. Detecting Chain-of-Thought Hijacking in Backdoored Multimodal Large Reasoning Models

    Oct 12, 2026Zhifang Zhang, Qi Wei, Weitong Chen +5Backdoor DetectionMultimodal Large Language Models

  8. Adaptive Look, Flexible Thought: Learning How and How Long to Think in Multimodal Reasoning

    Oct 11, 2026Quanlin Chen, Xiuwei Chen, Kun Xiang +5Multimodal Large Language ModelsMultimodal Reasoning

  9. From Stages to States: Unified Iterative Reasoning for MLLMs

    Oct 11, 2026Chuang Yu, Xuefei Ma, Yuanhao Feng +9Multimodal ReasoningMultimodal CoT Reasoning

  10. Genesis: Visual Augmentation Primitives for Multimodal Chain-of-Thought Reasoning

    Oct 11, 2026Fan Yang, Lifeng Chen, Yipu Wang +14VLM ReasoningMultimodal CoT Reasoning

  11. OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoning

    Oct 1, 2026Haibo Wang, Jiteng Mu, Jialu Li +5Audio-Visual UnderstandingRL for Language Model Reasoning

  12. MG-Thinker: Bi-Axial Self-Reflection for Multi-Image Reasoning Grounding

    Sep 29, 2026Heyu Huang, Chi Chen, Zonghao Guo +3Multimodal GroundingMultimodal CoT Reasoning

  13. InterTab: Interleaved Visual-Structure Alignment for Multi-Modal Table Reasoning

    Sep 26, 2026Hanqian Li, Sirui Huang, Chen Ling +12Table QAMultimodal CoT Reasoning

  14. DRT: Dense Reasoning Trace for Efficient and Grounded Multimodal Reasoning

    Sep 18, 2026Wan Xu, Yuanfan Guo, Kevin Han +2Multimodal ReasoningMultimodal CoT Reasoning

  15. Reasoning with Image Generation

    Sep 14, 2026Nishad Singhi, Hector Garcia Rodriguez, Aditya Arora +2Tool Use in VLMsVLM Reasoning

  16. Reason What Matters: Retrieval-Grounded Reasoning for Universal Multimodal Embeddings

    Sep 14, 2026Mingzhou Jiang, Peixi Wu, Hang Cheng +7Multimodal IREfficient Multimodal Inference

  17. Beyond Generation and Accuracy: Diagnosing and Enhancing Visual Chain-of-Thought for Geometry Problem Solving

    Sep 11, 2026Zhitong Dong, Jicai Pan, Yingguo Gao +3Mathematical ReasoningMultimodal CoT Reasoning

  18. Learning Where Outcomes Change:Credit-Addressable Reasoning for Multimodal Geometry

    Aug 31, 2026Jiani Guo, Junjie Wang, Jie Wu +5RL for Language Model ReasoningCredit Assignment in RL

  19. CoVA-SFT: A Large-Scale Dataset for Chain of Visual Abstractions

    Aug 29, 2026Tsung-Han Wu, Heekyung Lee, Anya Ji +4Multimodal DatasetVisual CoT

  20. VIG: Visual Information Gain as a Reward Signal for Multimodal Chain-of-Thought Compression

    Aug 22, 2026Wen Luo, Xiaohan Yi, Xiaotao Huang +1Multimodal CoT ReasoningMultimodal Token Compression

  21. MetaReason: Precise Interleaved Multimodal Reasoning via Editing Meta Information for Solving Geometry Problems

    Aug 15, 2026Penghao Yin, Haomin Wang, Qihong Tang +3Multimodal ReasoningMathematical Reasoning

  22. VERDICT: Training-Free Step-Wise Verification of Multimodal Reasoning via Disagreement-Aware Consensus

    Aug 11, 2026Rohit Sinha, Kunal Tilaganji, Tanuja Ganu +3Multimodal Large Language ModelsMultimodal CoT Reasoning

  23. Trace, Verify, and Correct: A Training-Free Framework for Spatial Reasoning in Multimodal LLMs

    Aug 5, 2026Yang Yang, Jiawei Chen, Tairan Chen +1Multimodal GroundingVisual Spatial Reasoning

  24. CURV: Enhancing Chart Understanding Through Curriculum Visual Grounded Reasoning

    Aug 3, 2026Xuehang Guo, Pingyue Zhang, Ruiyi Zhang +6Data VisualizationChart QA

  25. AdaThinkV: Adaptive Thinking for Token-Efficient Video Reasoning

    Aug 3, 2026Jingqi Tian, Haoji Zhang, Lin Chen +7Efficient VLM InferenceRL for Language Model Reasoning