Multimodal Reasoning

Follow this topic Ask about this topic

Momentum

39 papers in the last four weeks, up 70% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 314

All topics

SeePhys Pro: Diagnosing Modality Transfer and Blind-Training Effects in Multimodal RLVR for Physics Reasoning
May 10, 2026Kun Xiang, Terry Jingchen Zhang, Zirong Liu +15Cross-Modal Learning Multimodal Grounding
Sun Yat-sen University · ETH Zurich · Huawei Technologies Ltd. +1
Earth Science Foundation Models: From Perception to Reasoning and Discovery
May 9, 2026Xiangyu Zhao, Bo Liu, Yuehan Zhang +9AI for Science Geospatial Foundation Models
Shanghai Artificial Intelligence Laboratory, Shanghai, China
UniShield: Unified Face Attack Detection via KG-Informed Multimodal Reasoning
May 9, 2026Hongrui Li, Yichen Shi, Hongyang Wang +4Multimodal Reasoning Face Presentation Attack Detection
Shijiazhuang Tiedao University · Shanghai Jiao Tong University · Ningbo Institute of Digital Twin +1
Structured Role-Aware Policy Optimization for Multimodal Reasoning
May 8, 2026Bingqing Jiang, Difan ZouToken-Level Credit Assignment Multimodal Reasoning
School of Computing & Data Science, The University of Hong Kong · School of Computing & Data Science and Institute of Data Science, The University of Hong Kong
OmicsLM: A Multimodal Large Language Model for Multi-Sample Omics Reasoning
May 7, 2026Maciej Sypetkowski, Joanna Krawczyk, Łukasz Smoliński +4Multimodal Large Language Models Question Answering
Ingenix.AI, Warsaw, Poland
TableVista: Benchmarking Multimodal Table Reasoning under Visual and Structural Complexity
May 7, 2026Zheyuan Yang, Liqiang Shang, Junjie Chen +6Multimodal Robustness Multimodal Reasoning
Tongji University · University of Bristol · Tianjin University +1
Causal Probing for Internal Visual Representations in Multimodal Large Language Models
May 7, 2026Zehao Deng, Tianjie Ju, Zheng Wu +5Multimodal Large Language Models VLM Interpretability
School of Computer Science, Shanghai Jiao Tong University · Ant Group
AstroAlertBench: Evaluating the Accuracy, Reasoning, and Honesty of Multimodal LLMs in Astronomical Classification
May 7, 2026Claire Chen, Jiabao Sean Xiao, Shuze Daniel Liu +7Multimodal Reasoning Multimodal Model Evaluation
1California Institute of Technology · 2Massachusetts Institute of Technology · 3Purdue University
SPARK: Self-Play with Asymmetric Reward from Knowledge Graphs
May 7, 2026Hyobin Park, Taeseop Kim, Dong-Geol ChoiAI for Science Self-Play RL
ANTLAB, South Korea · Hanbat National University, South Korea
UnAC: Adaptive Visual Prompting with Abstraction and Stepwise Checking for Complex Multimodal Reasoning
May 5, 2026Yifan Wang, Yun FuMultimodal Large Language Models Multimodal Reasoning
Northeastern University
ReasonAudio: A Benchmark for Evaluating Reasoning Beyond Matching in Text-Audio Retrieval
May 5, 2026Honglei Zhang, Yuting Chen, Chenpeng Hu +2Audio Reasoning Audio Understanding
School of Software, Nanjing University Nanjing, China · School of Software, Northwestern Polytechnical University Xi’an, China · College of Computing and Data Science, Nanyang Technological University Singapore, Singapore
DiagramNet: An End-to-End Recognition Framework and Dataset for Non-Standard System-Level Diagrams
May 2, 2026Jincheng Lou, Ruohan Xu, Jiapeng Li +6Multi-Agent LLM Systems Electronic Design Automation
School of IC, Peking University, Beijing, China · College of Artificial Intelligence, Xi’an Jiaotong University, Xi’an, China · Department of Precision Instruments, Tsinghua University, Beijing, China +4
Segment-Aligned Policy Optimization for Multi-Modal Reasoning
May 2, 2026Lei Gao, Zhuoming Li, Mengxi Jia +4RL for Language Model Reasoning Policy Optimization
Fudan University · China Telecom Artificial Intelligence Technology (Beijing) Co., Ltd. · Southeast University +1
Valley3: Scaling Omni Foundation Models for E-commerce
May 2, 2026Zeyu Chen, Guanghao Zhou, Min Yang +6Unified Multimodal Models Multimodal Pretraining
Valley Team, ByteDance Group
WildTableBench: Benchmarking Multimodal Foundation Models on Table Understanding In the Wild
May 1, 2026Junzhe Huang, Xiaoxiao Sun, Yan Yang +6Visual Question Answering Table QA
The University of Queensland · Stanford University · The Australian National University +3
MedMosaic: A Challenging Large Scale Benchmark of Diverse Medical Audio
May 1, 2026Harshit Rajgarhia, Shuubham Ojha, Asif Shaik +4Audio QA Healthcare
Centific Global Solutions Inc. · University of Maryland, College Park, MD, USA.
LIMSSR: LLM-Driven Sequence-to-Score Reasoning under Training-Time Incomplete Multimodal Observations
May 1, 2026Huangbiao Xu, Huanqi Wu, Xiao Ke +1Missing-Modality Learning Multimodal Reasoning
Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, College of Computer and Data Science, Fuzhou University, Fuzhou 350108, China · Engineering Research Center of Big Data Intelligence, Ministry of Education, Fuzhou 350108, China · Wangxuan Institute of Computer Technology, Peking University, Beijing 100871, China
Beyond SFT-to-RL: Pre-alignment via Black-Box On-Policy Distillation for Multimodal RL
Apr 30, 2026Sudong Wang, Weiquan Huang, Xiaomin Yu +9Multimodal Large Language Models Multimodal Reasoning
Hong Kong University of Science and Technology (Guangzhou) · Nanyang Technological University · Tsinghua University +3
Echo-α: Large Agentic Multimodal Reasoning Model for Ultrasound Interpretation
Apr 30, 2026Jing Zhang, Wentao Jiang, Tao Huang +8Medical Image Analysis Multimodal Reasoning
School of Computer Science, Wuhan University, China · The Central Hospital of Wuhan, China · Taizhou Hospital of Zhejiang Province, China +1
MM-StanceDet: Retrieval-Augmented Multi-modal Multi-agent Stance Detection
Apr 30, 2026Weihai Lu, Zhejun Zhao, Yanshu Li +1Multimodal Reasoning Multimodal Classification
Peking University · Baidu Inc · Brown University +1
GLM-5V-Turbo: Toward a Native Foundation Model for Multimodal Agents
Apr 29, 2026GLM-V Team, :, Wenyi Hong +95Multimodal Large Language Models Multimodal Reasoning
Omni-o3: Deep Nested Omnimodal Deduction for Deliberative Audio-Visual Reasoning
Apr 27, 2026Zhicheng Zhang, Wentao Gu, Weicheng Wang +5Audio-Visual Understanding Tree Search
Nankai University · Kuaishou Technology · Pengcheng Laboratory +1
DeepTaxon: An Interpretable Retrieval-Augmented Multimodal Framework for Unified Species Identification and Discovery
Apr 27, 2026Jiawei Wang, Ming Lei, Yaning Yang +8Retrieval-Augmented Classification AI-Assisted Scientific Research
National University of Singapore · Hunan University · Xiangtan University +4
ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstruction
Apr 26, 2026Zichun Guo, Yuling Shi, Wenhao Zeng +6Image Reconstruction Multimodal Large Language Models
Xidian University · Shanghai Jiao Tong University · Alibaba Qwen +1
Multimodal QUD: Inquisitive Questions from Scientific Figures
Apr 26, 2026Yating Wu, William Rudman, Venkata S Govindarajan +2Multimodal Grounding Scientific QA
The University of Texas at Austin · Ithaca College · UC Berkeley, BespokeLabs.ai
StoryTR: Narrative-Centric Video Temporal Retrieval with Theory of Mind Reasoning
Apr 25, 2026Xuanyue Zhong, Yuqiang Xie, Guanqun Bi +2Temporal Video Grounding Video Understanding
Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong · SkyReels, Skywork AI · Independent Researcher
Context Unrolling in Omni Models
Apr 23, 2026Ceyuan Yang, Zhijie Lin, Yang Zhao +16Cross-Modal Learning Unified Multimodal Models
S1-VL: Scientific Multimodal Reasoning Model with Thinking-with-Images
Apr 23, 2026Qingxiao Li, Lifeng Xu, QingLi Wang +4Tool Use in VLMs Multimodal Reasoning
ScienceOne AI
Unlocking Multi-Spectral Data for Multi-Modal Models with Guided Inputs and Chain-of-Thought Reasoning
Apr 22, 2026Dahun Kim, Ganesh Satish Mallya, Anelia AngelovaRemote Sensing Image Understanding Multimodal Large Language Models
Google DeepMind
OMIBench: Benchmarking Olympiad-Level Multi-Image Reasoning in Large Vision-Language Model
Apr 22, 2026Qiguang Chen, Chengyu Luan, Jiajun Wu +7VLM Evaluation Visual Reasoning
Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology · Central South University · Fudan University +3

May 10, 2026, cs.AIJ/K move · Enter open · S save

SeePhys Pro: Diagnosing Modality Transfer and Blind-Training Effects in Multimodal RLVR for Physics Reasoning

Kun Xiang, Terry Jingchen Zhang, Zirong Liu, Bokai Zhou+14

Sun Yat-sen University · ETH Zurich · Huawei Technologies Ltd.+1

Cross-Modal Learning Multimodal Grounding Physical Reasoning Multimodal Reasoning Transfer Learning Multimodal Model Evaluation+2

Open paper AskPDF arXiv

We introduce SeePhys Pro, a fine-grained modality transfer benchmark that studies whether models preserve the same reasoning capability when critical information is progressively transferred from text to image. Unlike standard vision-essential benchmarks that evaluate a single input form, SeePhys Pro features four semantically aligned variants for each problem with progressively increasing visual elements. Our evaluation shows that current frontier models are far from representation-invariant reasoners: performance degrades on average as information moves from language to diagrams, with visual variable grounding as the most critical bottleneck. Motivated by this inference-time fragility, we further develop large training corpora for multimodal RLVR and use blind training as a diagnostic control, finding that RL with all training images masked can still improve performance on unmasked validation sets. To analyze this effect, text-deletion, image-mask-rate, and format-saturation controls suggest that such gains can arise from residual textual and distributional cues rather than valid visual evidence. Our results highlight the need to evaluate multimodal reasoning not only by final-answer accuracy, but also by robustness under modality transfer and by diagnostics that test whether improvements rely on task-critical visual evidence.

Momentum

Related topics

Latest papers 314