VLM Reasoning

VLM: Vision-Language Model

Follow this topic Ask about this topic

Momentum

70 papers in the last four weeks, up 250% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28

Latest papers 541

All topics

Symbolic and Abstractive Reasoning with Complex Visual Queries
Jun 8, 2026Yichi Zhang, Jingdian Lu, Zhuo Chen +4Visual Reasoning Synthetic Data Generation
Zhejiang University · Nanjing University · Ant Group
Stage-1 Controls the Entropy Regime, Not the Outcome
Jun 8, 2026Jianxiong ShenSupervised Fine-Tuning VLM Reasoning
ChinaHeritaQA: A Culturally-Grounded Visual Question Answering Dataset for World Heritage Sites in China
Jun 8, 2026Yi Zhang, Bolei Ma, Yong Cao +3VLM Evaluation Visual Question Answering
1LMU Munich · 2FAU Erlangen-Nuremberg · 3Munich Center for Machine Learning +4
AlloSpatial: Agentic Harness Framework for Spatial Reasoning in Foundation Models
Jun 8, 2026Shouwei Ruan, Bin Wang, Zhenyu Wu +5VLM Reasoning Multimodal Foundation Models
Institute of Artificial Intelligence, Beihang University · Huawei Noah’s Ark Lab · University of Science and Technology Beijing
Are Reasoning Vision-Language Models Robust to Semantic Visual Distractions?
Jun 8, 2026Yizheng Sun, Mochuan Zhan, Yanan Ma +10VLM Evaluation VLM Robustness
University of Manchester · Marex · Imperial College London
Thinking Without Images: Internalizing Visual Manipulation with On-Policy Self-Distillation
Jun 7, 2026Yishuo Cai, Jiahui Liu, Yuanxin Liu +9Tool Use in VLMs Efficient VLM Inference
1State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University · 2Central South University · University of Science and Technology of China +2
PRPO: Perception-Reinforced Policy Optimization via Token-Level Dynamic Advantage Reshaping
Jun 7, 2026Qiming Li, Tianlun Li, Xiaolong Cheng +5Token-Level Credit Assignment VLM Reasoning
Amap CV Lab, Alibaba Group · Peking University
When Video Misreads: Closed-Loop Distillation of Reading Heuristics for Exploratory Manipulation Trace QA
Jun 7, 2026Haizhou Ge, Yufei Jia, Yue Li +5Robotic Manipulation Video Reasoning
Tsinghua University · DISCOVER Robotics
TVI-CoT: Text-Visual Interleaved Chain-of-Thought Reasoning for Multimodal Understanding
Jun 7, 2026Lianyu Hu, Xiaoyu Ma, Zeqin Liao +1Multimodal Large Language Models Multimodal Reasoning
College of Computing and Data Science of Nanyang Technological University, Singapore.
DyCo-RL: Dynamic Cross-Modal Coordination for Visual Reasoning
Jun 6, 2026Hangui Lin, Yan Shu, Zhengyang Liang +8Cross-Modal Alignment VLM Reasoning
BAAI · University of Trento · Singapore Management University +1
The Last Visible Pixel: Probing Fine-Scale Perception in Vision-Language Models
Jun 5, 2026Lujun Li, Lama Sleem, Niccolo Gentile +4VLM Evaluation Large Vision-Language Models
University of Luxembourg · Foyer S.A. · Université Paris-Saclay
MemDreamer: Decoupling Perception and Reasoning for Long Video Understanding via Hierarchical Graph Memory and Agentic Retrieval Mechanism
Jun 5, 2026Cong Chen, Guo Gan, Kaixiang Ji +7Agentic Retrieval Long-Video Understanding
Ant Group · Zhejiang University · Central South University +2
VeriDrive: Verifiable Counterfactual Supervision for Cost-Efficient Vision-Language Planning
Jun 5, 2026Zikai Zhang, Hubert P. H. Shum, Toby P. BreckonAutonomous Driving Datasets VLMs for Autonomous Driving
Department of Computer Science Durham University Stockton Road, Durham, DH1 3LE, UK
Textual Supervision Enhances Geospatial Representations in Vision-Language Models
Jun 5, 2026Marcelo Sartori Locatelli, Fernando Tonucci, Jea Kwon +5Vision-Language Models Geospatial Representation Learning
Max Planck Institute for Security and Privacy (MPI-SP), Bochum, Germany · Universidade Federal de Minas Gerais, Belo Horizonte, Brazil · Changwon National University, Changwon, South Korea +1
Think Like a Pilot: Fine-Grained Long-Horizon UAV Navigation
Jun 5, 2026Xiangyi Zheng, Xiangyu Wang, Qinan Liao +6UAV Navigation Vision-Language Navigation
Colab, Beihang University · National University of Singapore · Meituan
Thinking with Imagination: Agentic Visual Spatial Reasoning with World Simulators
Jun 4, 2026Chenming Zhu, Jingli Lin, Yilin Long +4Visual Spatial Reasoning World Model Learning
1The University of Hong Kong · 2Shanghai AI Laboratory · 3Shanghai Jiao Tong University +2
HyperVis: Continuous Latent Visual Relational Graphs on the Lorentz Hyperboloid for Compositional Reasoning
Jun 4, 2026Moshiur Farazi, Sameera Ramasinghe, Mahbub Ahmed Turza +1Visual Reasoning VLM Reasoning
Data Science and AI, University of Doha for Science and Technology, Qatar · Pluralis Research, Australia · Department of Electrical and Computer Engineering, North South University, Bangladesh
Global-Local Monte Carlo Tree Search in Vision-Language Models for Text-to-3D Indoor Scene Generation
Jun 4, 2026Mengshi Qi, Wei Deng, Xianlin Zhang +1Monte Carlo Tree Search VLM Reasoning
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, China
Causal Scaffolding for Physical Reasoning: A Benchmark for Causally-Informed Physical World Understanding in VLMs
Jun 4, 2026Tianyi Tang, Zhuoyi Lin, Zeyu Feng +4VLM Evaluation VLM Reasoning
CFAR, IHPC, Agency for Science, Technology and Research (A*STAR) Singapore · I2R, Agency for Science, Technology and Research (A*STAR) Singapore · Nanyang Technological University Singapore
Cosine Misleads: Auxiliary Losses Reshape Vision Language Models, Not Their Latents
Jun 4, 2026XiuYu Zhang, Junfeng Fang, Zhenkai LiangVLM Evaluation Latent Visual Reasoning
National University of Singapore
VTI-CoT: Visual-Textual Interleaved Chain of Thought for Video Reasoning
Jun 4, 2026Shufan Zhang, Ziyue Lin, Bairun Wang +4Video Reasoning VLM Reasoning
Beijing University of Posts and Telecommunications · University of Hong Kong · Beijing Shanwei Zhixing Technology Co., Ltd. +2
Seeing Time: Benchmarking Chronological Reasoning and Shortcut Biases in Vision-Language Models
Jun 4, 2026Haoyu Zhou, Qing Qing, Caichong Li +6VLM Evaluation Vision-Language Models
College of Computer Science and Technology, Jilin University, Changchun 130012, China · College of Computing and Data Science, Nanyang Technological University, 639798, Singapore · School of Computer Science, Wuhan University, China +1
Almieyar-Oryx-BloomBench: A Bilingual Multimodal Benchmark for Cognitively Informed Evaluation of Vision-Language Models
Jun 4, 2026Mohammad Mahdi Abootorabi, Omid Ghahroodi, Anas Madkoor +4VLM Evaluation Multilingual VLM Evaluation
Qatar Computing Research Institute (QCRI), Hamad Bin Khalifa University
LEVANTE-bench: Multi-Scale Comparison of VLMs to Children Using Cognitive Tasks (or, "Is Your VLM Smarter Than a 5th Grader?")
Jun 3, 2026Alvin Wei Ming Tan, David Cardinal, Tania Lorido-Botran +3VLM Evaluation AI Alignment
Stanford University
Food-R1: A Unified Multi-Task Food Vision-Language Model with Reinforcement Learning
Jun 3, 2026Yu Zhu, Yongkang Li, Wenjie Zhu +5Vision-Language Models VLM Reasoning
Huazhong University of Science and Technology, Wuhan, China
Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models
Jun 2, 2026Mahtab Bigverdi, Linjie Li, Weikai Huang +8Visual Spatial Reasoning Visual Reasoning
University of Washington · 2Allen Institute for AI · 3Microsoft +1
Entropy Is Not Enough: Unlocking Effective Reinforcement Learning for Visual Reasoning via Vision-Anchored Token Selection
Jun 2, 2026Senjie Jin, Peixin Wang, Boyang Liu +8Token-Level Credit Assignment Visual Reasoning
College of Computer Science and Artificial Intelligence, Fudan University
TurtleAI: Benchmarking Multimodal Models for Visual Programming in Turtle Graphics
Jun 2, 2026Chao Wen, Jacqueline Staub, Adish SinglaVLM Evaluation LLM-Based Program Synthesis
MPI-SWS · University of Trier
Beyond the Literal: Decomposing Pragmatic Intent in Multimodal Meme Understanding
Jun 2, 2026Zhengyi Zhao, Shubo Zhang, Zezhong Wang +6Multimodal Disentangled Representation Learning Representation Disentanglement
The Chinese University of Hong Kong · Huawei · Central China Normal University +3
World Models Meet Language Models: On the Complementarity of Concrete and Abstract Reasoning
Jun 2, 2026Yucheng Zhou, Wei Tao, Yiwen Guo +1On-Policy Self-Distillation World Models
University of Macau · LIGHTSPEED · Independent Researcher

Jun 8, 2026, cs.CLJ/K move · Enter open · S save

Symbolic and Abstractive Reasoning with Complex Visual Queries

Yichi Zhang, Jingdian Lu, Zhuo Chen, Lingbing Guo+3

Zhejiang University · Nanjing University · Ant Group

Visual Reasoning Synthetic Data Generation Multimodal Large Language Models VLM Reasoning

Open paper AskPDF arXiv

Understanding and reasoning over abstract visual content remains a challenge for current multi-modal large language models (MLLMs). In this paper, we explore a novel abstract data type termed complex visual query (CVQ), designed to probe symbolic and abstractive reasoning, which is a critical yet underexplored dimension of human-like neuro-symbolic reasoning for MLLMs. We present a comprehensive investigation from three perspectives: \textbf{Data

\times

Paradigm

\times

Exploration}. Specifically, we propose a scalable pipeline for synthesizing CVQs grounded in large-scale multi-modal knowledge graphs, generating a diverse dataset encompassing 14 distinct query types via systematic combinations of first-order logic operators. We further introduce a two-stage training framework that progressively equips MLLMs with robust visual reasoning capabilities. We conduct extensive experiments to rigorously evaluate MLLMs across multiple dimensions, including reasoning performance on CVQs, as well as cross-task and cross-scenario generalization. We believe our work opens new perspectives and avenues for advancing the reasoning frontiers of MLLMs.

Momentum

Related topics

Latest papers 541