Multimodal Reasoning

Follow this topic Ask about this topic

Momentum

39 papers in the last four weeks, up 70% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 314

All topics

Mind the Gap: Diagnosing Constraint Discovery Failures in Text-in-Image Editing
Jun 14, 2026Rui GuiText-Guided Image Editing Multimodal Large Language Models
Central South University
OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computing
Jun 14, 2026Zebang Cheng, Shuimu Chen, Boxue Yang +7On-Policy Self-Distillation Multimodal Large Language Models
Shenzhen University · Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ) · Tsinghua University +6
SciOrch: Learning to Orchestrate Expert LLMs for Solving Frontier Multimodal Scientific Reasoning Tasks
Jun 14, 2026Jingru Guo, Xiangyuan Xue, Lian Zhang +6LLM Agent Orchestration Multimodal Reasoning
1Imperial College London · 2The Chinese University of Hong Kong · University of Illinois Urbana-Champaign +4
OmniTraffic: A Controllable Generation Pipeline and Benchmark for Spatio-Temporal Traffic Reasoning
Jun 14, 2026Maonan Wang, Zhengyan Huang, Kemou Jiang +13Autonomous Driving Datasets Spatiotemporal Reasoning
The Chinese University of Hong Kong, Shenzhen · Shanghai AI Lab · Beihang University +3
DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
Jun 13, 2026David Huang, Lianlei ShanEfficient Multimodal Inference Multimodal Reasoning
University of Toronto · Tsinghua University
VeriGeo: Controllable Geometry Question Generation with Numerical and Analytical Verification
Jun 12, 2026Xiaoxian Duan, Zequn Liu, Yingce XiaSynthetic Data Generation Multimodal Reasoning
Institute of Automation, Chinese Academy of Sciences, Beijing, China · Zhongguancun Academy, Beijing, China
Reasoning for Mobile User Experience with Multimodal LLMs: Task, Benchmark, and Approach
Jun 11, 2026Ruichao Mao, Zhou Fang, Teng Guo +9Multimodal Reasoning Multimodal Model Evaluation
Ant Group
Efficient Reinforcement for Visual-Textual Thinking with Discrete Diffusion Model
Jun 11, 2026Yoonjeon Kim, Yuhta Takida, Chieh-Hsin Lai +2Multimodal Reasoning RL for Diffusion Models
KAIST · Sony AI · KAIST & AITRICS +1
Multi-Modal Agents for Power Distribution Defect Detection: An Evaluation of Foundation Models
Jun 11, 2026Quan QuanIndustrial Anomaly Detection Multimodal Reasoning
Bridging Modal Isolation in Interleaved Thinking: Supervising Modality Transitions via Stepwise Reinforcement
Jun 11, 2026Tingyu Li, Le Zhou, Siyuan Li +5Cross-Modal Alignment Multimodal Reasoning
Shanghai Artificial Intelligence Laboratory · Shanghai Jiaotong University · Zhejiang University +1
InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning
Jun 10, 2026Ziang Yan, Sheng Xia, Jiashuo Yu +10Efficient Multimodal Inference Multimodal Reasoning
Shanghai AI Laboratory · Shanghai Innovation Institute · Nanjing University
Decoding Multimodal Cues: Unveiling the Implicit Meaning Behind Hateful Videos
Jun 10, 2026Junyu Lu, Deyi Ji, Liqun Liu +9Multimodal Reasoning Hate Speech Detection
Dalian University of Technology Dalian, China · Tencent Beijing, China · Singapore University of Technology and Design Singapore, Singapore
DeceptionX: Explainable Deception Detection with Multimodal Large Language Models
Jun 9, 2026Jiayu Zhang, Shuo Ye, Jiajian Huang +7Multimodal Large Language Models Multimodal Reasoning
Great Bay University Dongguan, Guangdong, China · Hong Kong Polytechnic University HongKong, China
Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks
Jun 9, 2026Miaoxin Cai, Guanqun Wang, Wei Zhang +6Remote Sensing Image Understanding Multimodal Grounding
National Key Laboratory of Science and Technology on Space-Born Intelligent Information Processing (SBIIP), Beijing Institute of Technology, Beijing 100081, China · Advanced Research Institute of Multidisciplinary Sciences, Beijing Institute of Technology, Beijing 100081, China · School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China +5
Optical Reasoning: Rethinking Images as an Expressive Reasoning Medium Beyond Text
Jun 8, 2026Yutong Bian, Dongjie Cheng, Heming Xia +2Visual Reasoning Multimodal Reasoning
The Hong Kong Polytechnic University
Counterfactual Reasoning for Fine-Grained Evidence Disentanglement in VideoQA
Jun 8, 2026Zhou Du, Hamid Krim, Xiao Wu +3Causal Representation Learning Video QA
Graduate School of Informatics, Nagoya University, Nagoya 464-8601, Japan · Department of Electrical and Computer Engineering, North Carolina State University, Raleigh, NC 27695, USA · School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu 611730, China +1
Stabilizing On-Policy Distillation for MLLM Reasoning with Global Normalization
Jun 8, 2026Dongze Hao, Zhiwei Jin, Chen Chen +1Multimodal Reasoning On-Policy Distillation
OPPO AI Center
TVI-CoT: Text-Visual Interleaved Chain-of-Thought Reasoning for Multimodal Understanding
Jun 7, 2026Lianyu Hu, Xiaoyu Ma, Zeqin Liao +1Multimodal Large Language Models Multimodal Reasoning
College of Computing and Data Science of Nanyang Technological University, Singapore.
Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoning
Jun 6, 2026Cong Wan, Ying He, Zhongzhan Huang +1Test-Time Scaling Multimodal Reasoning
Sun Yat-sen University
ChronoPhyBench: Do MLLMs Truly Understand the World or Merely Exploit Language Priors?
Jun 6, 2026Bin Zhu, Yanhao Jia, Kexin Zhao +12Physical Reasoning Multimodal QA
Peking University, Shenzhen Graduate School · 2Peng Cheng Laboratory · Rabbitpre Intelligence +3
VisualFLIP: Do Predictions Depend on Task-Critical Visual Evidence in Multimodal Reasoning?
Jun 5, 2026Didi Zhu, Changrui Chen, Stefanos Zafeiriou +1VLM Evaluation Multimodal Grounding
Imperial College London
Improving Multimodal Reasoning via Worst Dimension Optimization
Jun 5, 2026Haocheng Lv, Huaping Zhang, Qiuchi Li +2Process Reward Models Multimodal Reasoning
Beijing Institute of Technology
Dreaming when Necessary: Advancing World Action Models with Adaptive Multi-Modal Reasoning
Jun 5, 2026Yinzhou Tang, Jingbo Xu, Yu Shang +4Efficient Multimodal Inference World Models for Robotics
Tsinghua University · Manifold AI
Teaching the Way, Not the Answer: Privileged Tutoring Distillation for Multimodal Policy Optimization
Jun 5, 2026Shizhe Xiang, Ke An, Wenlong Yu +4Large Vision-Language Models Multimodal Reasoning
1Tianjin University · 2Beijing Institute of Technology · 3Singapore Management University +2
Struct-Searcher: Agentic Structural Thinking Advances Multimodal Deep Information Seeking
Jun 5, 2026Fan Zhang, Vireo Zhang, Shengju Qian +7Multimodal IR Belief Revision
1CUHK · 2LIGHTSPEED · 3PKU +3
Visual Commonsense Driven Knowledge Refinements for Scene Graph Generation
Jun 4, 2026Maëlic Neau, Salim Baloch, Jakob Suchan +2Scene Graph Generation Multimodal Reasoning
Computing Science Department, Umeå University, Umeå, Sweden · School of Computer Science & Engineering, Constructor University, Bremen, Germany · CoDesign Lab EU., Örebro, Sweden +1
DisasterBench: A Multimodal Benchmark for UAV-Based Disaster Response in Complex Environments
Jun 4, 2026Tan Zhang, Quanyou Li, Lu Zhang +3Efficient Multimodal Inference Multimodal Reasoning
School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China · School of Information and Communication Engineering, Dalian University of Technology, Dalian, 116024, China · School of Computing and Communications, Lancaster University, Lancaster, LA1 4YW, England +1
ViCuR: Visual Cues as Recoverable Privilege for Multimodal On-Policy Distillation
Jun 4, 2026Kanghui Tian, Siyuan Liu, Ziang Yan +3VLM Distillation Multimodal Reasoning
1Shanghai AI Laboratory · 3Nanjing University · 2Fudan University
WorldBench: A Challenging and Visually Diverse Multimodal Reasoning Benchmark
Jun 4, 2026Yida Yin, Harish Krishnakumar, Chung Peng Lee +9Multimodal Large Language Models Multimodal Reasoning
Princeton University · NYU · University of Waterloo +1
BreastGPT: A Multimodal Large Language Model for the Full Spectrum of Breast Cancer Clinical Routine
Jun 3, 2026Yang Liu, Jiajin Zhang, Danyang Tu +8Breast Cancer Medical Imaging
DAMO Academy, Alibaba Group · Zhejiang University · West China Hospital +1

Jun 14, 2026, cs.CVJ/K move · Enter open · S save

Mind the Gap: Diagnosing Constraint Discovery Failures in Text-in-Image Editing

Rui Gui

Central South University

Text-Guided Image Editing Multimodal Large Language Models Multimodal Reasoning Multimodal Model Evaluation Multimodal Understanding

Open paper AskPDF arXiv

A key challenge in multimodal reasoning is determining which visual dependencies become relevant under a specific task, rather than merely recognizing visible content. We study this through edit-induced constraint discovery in text-in-image editing, a controlled diagnostic setting where a local text change can activate secondary consistency constraints: given a valid editing instruction and an image, can a model identify the secondary regions that must also change? Across 461 diagnostic cases, four MLLMs, and 19 constraint subtypes, models recover only 46% case-level macro recall under unguided prompting versus 94% when constraints are explicitly provided, suggesting that a substantial portion of the failure arises when models must decide which unstated dependencies to surface. Oracle-field decomposition shows that case-specific causal explanations are the most effective partial guidance (0.782 recall), above region names (0.610) or type labels (0.646), suggesting that edit-specific causal cues account for much of the oracle gain. A downstream experiment further shows that higher self-discovery recall does not necessarily improve task performance: unverified self-discovery introduces false positives that offset recall gains, motivating precision-aware constraint elicitation.

Momentum

Related topics

Latest papers 314