Multimodal Reasoning

Follow this topic Ask about this topic

Momentum

39 papers in the last four weeks, up 70% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 314

All topics

Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learning
Jun 30, 2026Kaitao Chen, Weiqian Zhao, Jiamin Wu +6Efficient Multimodal Inference Medical VQA
1Fudan University · 2Shanghai Artificial Intelligence Laboratory · 3Shanghai Jiao Tong University +1
Modality-Driven Search with Holistic Trace Judging for ARC-AGI-2
Jun 30, 2026Johan LandVisual Reasoning Multimodal Reasoning
Independent Researcher
Spatial Reasoning via Modality Switching Between Language and Symbolic Representations
Jun 30, 2026Shreya Rajpal, Tanawan Premsri, Parisa KordjamshidiMultimodal Grounding Multimodal Reasoning
Department of Computer Science and Engineering Michigan State University Michigan, USA
Before Thinking, Learn to Decide: Proactive Routing for Efficient Visual Reasoning
Jun 29, 2026Yinan Zhou, Haokun Lin, Yichen Wu +7Efficient Multimodal Inference Adaptive Model Routing
Xi’an Jiaotong University · ARC Lab, Tencent IEG · City University of Hong Kong +3
DAIN: Dynamic Agent-Based Interaction Network for Efficient and Collaborative Multimodal Reasoning
Jun 29, 2026Xinxin Chen, Yuchen Li, Zihan Wang +3Efficient Multimodal Inference Multi-Agent Collaboration
University of Chinese Academy of Sciences
Consistency as Inductive Bias: Learning Cross-View Invariance for Robust Multimodal Reasoning
Jun 29, 2026Xin Zou, Haolin Deng, Yibo Yan +6Multi-View Consistency Multimodal Robustness
HKUST (GZ) · HKUST · UIC +1
Can MLLMs Critique Like Humans? Evaluating Open-Ended Aesthetic Reasoning in Multimodal Large Language Models
Jun 29, 2026Sajjad Ghiasvand, Maryam Amirizaniani, Haniyeh Ehsani Oskouie +2Language Model Generation Evaluation Multimodal Reasoning
UCSB · University of Washington · UCLA
AirGroundBench: Probing Spatial Intelligence in Multimodal Large Models under Heterogeneous Multi-View Embodied Collaboration
Jun 26, 2026Haotian Li, Yida Wang, Leyuan Wang +7Multi-View Consistency Multimodal Reasoning
Beijing University of Posts and Telecommunications · University of Electronic Science and Technology of China · Tsinghua University +1
Verifiable Geometry Problem Solving: Solver-Driven Autoformalization and Theorem Proposing
Jun 26, 2026Can Li, Ting Zhang, Junbo Zhao +1Automated Theorem Proving Multimodal Reasoning
Beijing Normal University
MER-R1: Multimodal Emotion Reasoning via Slow-Fast Thinking Synergy
Jun 26, 2026Zhiyuan Han, Beier Zhu, Wenwen Tong +8RL for Language Model Reasoning Multimodal Large Language Models
University of Science and Technology of China · 2SenseTime Research · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center +1
ReasonCLIP-58M: Visually Grounded Commonsense Reasoning Supervision for CLIP
Jun 25, 2026Sicheng Zhang, Muzammal Naseer, Binzhu Xie +5Compositional Reasoning Multimodal Reasoning
Khalifa University · University of Western Australia · The Chinese University of Hong Kong +2
Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning
Jun 25, 2026Mengzhao Wang, Yanli Ji, Wangmeng Zuo +2Efficient Multimodal Inference KV Caching
Sun Yat-sen University · Shenzhen Loop Area Institute · Harbin Institute of Technology (HIT) +3
What We are Missing in Multimodal LLM Evaluation?
Jun 24, 2026Po-han Li, Shenghui Chen, Sandeep Chinchali +1Spatiotemporal Reasoning Multimodal Large Language Models
The University of Texas at Austin, USA
TriViewBench: Controlled Complexity Scaling for Multi-View Structural Reasoning in MLLMs
Jun 24, 2026Yu-Yang Chen, Lan-Zhe GuoSpatial Reasoning Benchmarks Visual Reasoning
School of Intelligence Science and Technology, Nanjing University, China · National Key Laboratory for Novel Software Technology, Nanjing University, China
Falcon: Functional Assembly and Language for Compositional Reasoning in X-ray
Jun 24, 2026Yonathan Michael, Mohamad Alansari, Natnael Takele +2Multimodal Grounding Multimodal Reasoning
Computer Science Department Khalifa University · Center of Cyber-physical Systems (C2PS) Khalifa University
Omni-Perception Policy Optimization for Multimodal Emotion Reasoning
Jun 24, 2026Zhiyuan Han, Beier Zhu, Wenwen Tong +6Multimodal Reasoning Multimodal Hallucination
University of Science and Technology of China · SenseTime · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center +1
Latent Visual States for Efficient Multimodal Reasoning
Jun 23, 2026Xiuwei Chen, Wentao Hu, Yongxin Wang +8Efficient Multimodal Inference Large Vision-Language Models
Sun Yat-sen University · The Hong Kong Polytechnic University · MBZUAI +2
Kamera: Unified Position-Invariant Multimodal KV Cache for Training-Free Reuse
Jun 22, 2026Bole Ma, Jan Eitzinger, Harald Koestler +1Efficient Multimodal Inference KV Caching
VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instruct
Jun 22, 2026Haoling Li, Kai Zheng, Jie Wu +4Multimodal Reasoning Mathematical Reasoning
1Tsinghua University · 2Tencent Hunyuan
CFPO: Counterfactual Policy Optimization for Multimodal Reasoning
Jun 22, 2026Zhangyuan Yu, Wanran Sun, Guangjing Yang +2Multimodal Reasoning VLM Hallucination Mitigation
Beijing University of Posts and Telecommunications, Beijing, China.
PIVOTSBench: Evaluating Fine-Grained Interpersonal Relationship Reasoning in Multimodal Large Language Models
Jun 22, 2026Shuxiang Zhang, Yiting Yin, Wenxuan Song +2Multimodal Large Language Models Multimodal Reasoning
Sun Yat-sen University · University of Michigan · Tsinghua University
Look Light, Think Heavy: What Multimodal Chain-of-Thought Reasoning Can and Cannot Do
Jun 21, 2026Zhuoran Jin, Kejian Zhu, Hongbang Yuan +5Multimodal Reasoning VLM Reasoning
The Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
CulMind: Benchmarking Multimodal Understanding and Reasoning in Chinese Cultural Heritage
Jun 19, 2026Zhangwei Cao, Shuhan Fan, Yuting Wei +5Benchmark Construction Reasoning Evaluation
University of International Relations · 2Kedge Business School · 3Peking University +3
MedRLM: Recursive Multimodal Health Intelligence for Long-Context Clinical Reasoning, Sensor-Guided Screening, Evidence-Grounded Decision Support, and Community-to-Tertiary Referral Optimization
Jun 18, 2026Aueaphum AueawatthanaphisutClinical Decision Support Multimodal Reasoning
School of Information, Computer, and Communication Technology Sirindhorn International Institute of Technology, Thammasat University Pathum Thani, Thailand
ROSE: Benchmarking the Perception-to-Action Gap in Multimodal Models
Jun 18, 2026Yihao Wang, Zijian He, Jie Ren +1Multimodal Grounding Multimodal Reasoning
Sun Yat-sen University · Shaanxi Normal University
Visual-OPSD: Cross-Modal On-Policy Self-Distillation for Efficient Unified Multimodal Reasoning
Jun 17, 2026Pengyu Li, Zhitao Gao, Lingling Zhang +5Cross-Modal Knowledge Distillation Efficient Multimodal Inference
Xi’an Jiaotong University · Shaanxi Province Key Laboratory of Big Data Knowledge Engineering · MOE KLINNS Lab, Xi’an Jiaotong University +1
MathVis-Fine: Aligning Visual Supervision with Necessity via Progressive Dependency-Guided Training for Multimodal Mathematical Reasoning
Jun 16, 2026Wanshi Xu, Haokun Zhao, Haidong Yuan +2Multimodal Reasoning Multimodal Reward Modeling
School of ECE, Peking University · College of Computer Science and Artificial Intelligence, Fudan University · School of Software and Microelectronics, Peking University +1
FinAcumen: Financial Multimodal Reasoning via Self-Evolving Experience Memory Harness
Jun 16, 2026Pianran Guo, Pengcheng Zhou, Yucheng Jian +3Multimodal Reasoning LLM Agents
Beijing University of Posts and Telecommunications · Wuhan Eonray Technology Co., Ltd. · Queen Mary University of London
LADBench: A Benchmark for Logical Fault Detection in Images
Jun 16, 2026Sahasra Kondapalli, Lara Radovanovic, Aadi Palnitkar +2VLM Evaluation Multimodal Reasoning
Embodied Robotics and Automation Lab, University of South Florida, Tampa, FL 33610, USA.
Not Truly Multilingual: Script Consistency as a Missing Dimension in VLM Evaluation
Jun 15, 2026Prabhjot Singh, Bhushan Pawar, Madhu Reddiboina +1VLM Evaluation Multilingual Language Models
RediMinds Inc., USA · The University of Texas at Austin, USA · Indian AI Research Organization (IAIRO), India

Jun 30, 2026, cs.CVJ/K move · Enter open · S save

Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learning

Kaitao Chen, Weiqian Zhao, Jiamin Wu, Qihao Zheng+5

1Fudan University · 2Shanghai Artificial Intelligence Laboratory · 3Shanghai Jiao Tong University+1

Efficient Multimodal Inference Medical VQA Multimodal Reasoning Medical VLMs Visual Token Pruning RL for VLMs+1

Open paper AskPDF arXiv

Vision-language models (VLMs) combining reinforcement learning (RL) ignite remarkable progress in multimodal reasoning, yet still struggle with medical images, which typically exhibit extremely sparse visual evidence to inform clinical decision-making. We recognize that pruning visual tokens outside the grounding region greatly enhances medical reasoning. However, a united RL framework for active visual token pruning (VTP) and medical multimodal reasoning remains unestablished. Here, we propose a dual-stream RL framework, ViToS, to fulfill token pruning and question answering. ViToS trains one policy model with two task branches, where one focuses on grounding while the other conducts token-sparse reasoning after VTP. Furthermore, we solve the coupled policy learning problem by introducing the cross-feedback sequential optimization, avoiding gradient conflict and facilitating convergence of the shared policy model. Evaluated on seven medical benchmarks, our method reduces visual tokens to 77% of the original sequence length while achieving a 108.27% relative performance on Lingshu-7B and 104.16% relative performance on HuatuoGPT-Vision-7B. Overall, ViToS delivers superior performance and inference speedup, establishing an efficient paradigm for medical multimodal reasoning.

Momentum

Related topics

Latest papers 314