Overview

Multimodal reasoning studies how models perceive information across modalities, connect that evidence to knowledge, and use it to answer questions, plan actions, or explain decisions. Common approaches include instruction tuning and chain-of-thought training, reinforcement learning with verifiable rewards, tool-using agents, and structured methods such as graphs or symbolic solvers. Benchmarks such as MathVista and MMMU test visual problem solving, while video, document, scientific, and medical tasks probe reasoning across time and specialized evidence. A central challenge is ensuring that correct answers actually depend on relevant multimodal evidence rather than language shortcuts; grounding, cross-modal integration, and reliable generalization remain difficult.

Latest papers

CardsList

531 papers29 papers in the last four weeks, down 44% on the four weeks before. 0.2% of all new papers.

  1. Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoning

    Sep 17, 2026Haoqiang Kang, Yizhe Zhang, Nikki Lijing Kuang +3Unified Multimodal ModelsMultimodal Reasoning

  2. Can MiniMax-H3 Reason About the Physical World? An Evaluation of Omni-Modal Generative Model

    Sep 16, 2026Haoyu Zhao, Zihao Zhao, Tianyu Deng +10Multimodal ReasoningMultimodal Model Evaluation

  3. little m: An AI Agent for Industrial Process Optimization

    Sep 15, 2026Yongchao Ye, Xinyu He, Dutliff Boshoff +2Large Language Model-Guided OptimizationMultimodal Reasoning

  4. OPD-Aha: From Linguistic Momentum to Visual Reflection in Multimodal On-Policy Distillation

    Sep 15, 2026Chenhao Qiu, Dawei Li, Yechao Zhang +2Object Hallucination in VLMsMultimodal Reasoning

  5. Concept-Grounded Reasoning with Prompt-Driven Localization for Interpretable Structured Report Generation

    Sep 14, 2026Xinyue Xu, Hongbin Lin, Juangui Xu +5Radiology Report GenerationConcept Bottleneck Models

  6. Omni-Streaming Thinking

    Sep 14, 2026Enjun Du, Siyi Liu, Ziyu Zheng +4Audio-Visual UnderstandingStreaming Video Understanding

  7. Sensory Precision Inference for Multimodal Arbitration under Uncertainty

    Sep 14, 2026Tin Mišić, Takato HoriiMultimodal RobustnessActive Inference

  8. Not All Prompts Are Equal: Exploration-Guided Prompt Scaffolding for Multimodal Reinforcement Post-Training

    Sep 14, 2026Yuanhao Yue, Qianli Ma, Chengyu Wang +3Multimodal Large Language ModelsCurriculum RL

  9. SyRHM: Symbolic-Language-Enhanced Reasoning with Associative Retrieval for Zero-shot Harmful Meme Detection

    Sep 12, 2026Hanling Wang, Chenlong Wei, Yingjuan Li +4Harmful Meme DetectionMultimodal Content Moderation

  10. QuPAINT: Physics-Aware Multimodal Reasoning for Quantum Material Characterization

    Sep 10, 2026Sankalp Pandey, Xuan-Bac Nguyen, Hoang-Quan Nguyen +4Multimodal GroundingSynthetic-to-Real Domain Adaptation

  11. Physics as the label for measuring and correcting materials reasoning in multimodal models

    Sep 10, 2026Hasan Kurban, Rasul Khanbayov, Mustafa KurbanMultimodal ReasoningMultimodal Model Evaluation

  12. Mr.LHDR: A Benchmark for Multimodal Real-World Long-Horizon Deep Research Agents

    Sep 10, 2026Minghao Guo, Meng Cao, Sui Zhao +10Deep Research AgentsLong-Horizon Agent Evaluation

  13. BodyCam-VQA: Enhanced Body-Worn Camera Video Captioning via Multimodal Reasoning and Probe Question Generation

    Sep 9, 2026Karish Gupta, Matthew Alex, Alex Li +6Video Question AnsweringMultimodal Reasoning

  14. Beyond Surface Imitation: Contrastive Modeling for Reasoning Path Alignment in Multimodal In-Context Learning

    Sep 9, 2026Mingbo Yang, Wenqiang Wang, Zhaolu Kang +4Contrastive LearningMultimodal ICL

  15. Evolution of Multimodal Question Answering: From Modality-Adaptive Extraction to Unified Language Representation

    Sep 8, 2026Abdullah Al ShafiUnified Multimodal ModelsMultimodal QA

  16. ICDAR2026 Competition on Multimodal Reasoning over Documents in Multiple Domains

    Sep 8, 2026Artemis Llabrés, Marc Serra Ortega, Tomàs Ockier +6Document UnderstandingMultimodal QA

  17. Eliciting Self-Verification in Multimodal Reasoning Agents with Reinforcement Learning

    Sep 7, 2026Vishwas Sathish, Viresh Ranjan, Xinliang Zhu +2Tool Use in VLMsMultimodal QA

  18. Reason Through the Latent! Making Latent Visual Reasoning Necessary

    Sep 6, 2026Suhyeong Park, Junha Jung, Jaewoo KangVisual ReasoningMultimodal Reasoning

  19. CUSP: Decomposable Collective Uncertainty for Multi-Agent Multimodal Reasoning

    Sep 4, 2026Chung-En Johnny Yu, David Garcia, Brian Jalaian +1Language Model EnsemblesMultimodal Reasoning

  20. WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data

    Sep 4, 2026Ji Soo Lee, Xilun Chen, Pierce Chuang +5Medical QAWearable Health Monitoring

  21. Latent-Aligned Reasoning for Multimodal Recommendation

    Sep 4, 2026Jiarui Jin, Anyang JiMultimodal RecommendationVLM Reasoning

  22. CulturalMenuBench: Probing the Knowledge-Application Gap in Multimodal Culinary Reasoning

    Sep 3, 2026Bo Zeng, Linfeng Gao, Peiqin Lin +9Multimodal ReasoningMultilingual VLM Evaluation

  23. Deeply Interleaved Text-Image Contexts for Multimodal LLMs Assessment

    Sep 2, 2026Zihao Wang, Xi Xiang, Yuwen Sun +5Vision-Language ModelsMultimodal Model Evaluation

  24. DocHop: Benchmarking Out-of-domain Multi-hop Reasoning in Information-Dense Documents

    Sep 2, 2026Zhuoran Yu, Le Thien Phuc Nguyen, Jaden Park +5Multimodal Large Language ModelsChart QA

  25. Evidence-Bounded Mental Health Reasoning from Heterogeneous Speech Protocols

    Aug 31, 2026Chengyuan Gao, Jiang Wu, Tao Lu +4Evidence-Grounded ReasoningDepression Detection

  26. MMDS-Bench: Benchmarking Multimodal Large Language Models on Dynamic Stance in Social Media Interactions

    Aug 31, 2026Yuzhe Ding, Kang He, Li Zheng +5Multimodal Large Language ModelsMultimodal Reasoning

  27. SocialReasonBench: A Video-QA Benchmark for Social Reasoning with Counterfactual Narrative Videos

    Aug 31, 2026Zheyu Huang, Zijing Shi, Haozhe Luo +4Video Question AnsweringMultimodal Reasoning