Vision-Language Models

Also known as VLM

Follow this topic Ask about this topic

Momentum

55 papers in the last four weeks, up 120% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 491

All topics

OmniSpace: Efficient Geometry Awareness for Autonomous Vehicles MLLMs
Jun 21, 2026Hao Vo, Phu Loc Nguyen, Khoa Vo +7Multi-View Geometry Vision-Language Models
University of Arkansas, USA · Google Research, Google · University of Liverpool, UK +1
Gold Points Sniper: Self-guided Visual Reasoning in VLM for Fine-grained Action Understanding
Jun 21, 2026Haodi Liu, Xinhang Yang, Kunda Yan +3Vision-Language Models Human Activity Recognition
Beijing National Research Center for Information Science and Technology (BNRist), Department of Automation, Tsinghua University, Beijing, P.R.China · State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI).
When Does a Video-Language Model Stop Watching? Reward Strength Controls the Formation and Reversal of Visual Shortcuts in Multimodal RLVR
Jun 20, 2026Zekun XuVision-Language Models Video-Language Models
School of Computer Science, The University of Sydney, Sydney, Australia
The Unreasonable Effectiveness of VLMs for Zero-shot Procedural Mistake Detection
Jun 19, 2026Serdar Ozsoy, Lars Doorenbos, Federico Spurio +2Temporal Action Segmentation Vision-Language Models
University of Bonn · Lamarr Institute for Machine Learning and Artificial Intelligence · Toyota Motor Europe
BIT-Nav: Brain-Inspired Trajectory Memory for Embodied Navigation
Jun 19, 2026Rithvik Jonna, Aakash Gurram, Man Namgung +2Vision-Language Models Embodied Navigation
Department of Electrical and Computer Engineering Johns Hopkins University · Laboratory for Computational Sensing and Robotics Johns Hopkins University · DEVCOM Army Research Laboratory
FleetAgent: Teleoperation Assistant for Autonomous Fleets via Vectorized V2N Messages
Jun 19, 2026Juntong Peng, Qi Chen, Deyuan Qu +3Vision-Language Models VLMs for Autonomous Driving
College of Engineering, Purdue University, West Lafayette, IN, USA · Toyota InfoTech Labs, Mountain View, CA, USA
Extraction and Analysis of Multimodal Concepts in Vision Language Models through Sparse Autoencoders
Jun 19, 2026Sergio Lanza, Jae Hee Lee, Stefan WermterVision-Language Models VLM Interpretability
Knowledge Technology, Department of Informatics, University of Hamburg, Hamburg, Germany
Beyond 'One Language, One Script': Quantifying Orthographic Bias in Multilingual VLMs with PuMVR
Jun 18, 2026Prabhjot Singh, Bhushan Pawar, Madhu ReddiboinaVLM Evaluation Vision-Language Models
RediMinds Inc., USA
The Hidden Evolution of Disguised Visual Context inside the VLM
Jun 18, 2026Wish Suharitdamrong, Tony Alex, Muhammad Awais +1Vision-Language Models Large Vision-Language Models
Surrey Institute for People-Centred AI, University of Surrey, Guildford, GU2 7XH, UK · Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey, UK
LaViSA: A Language and Vision Structural Ambiguity Benchmark
Jun 17, 2026Lee Sangmyeong, Shun Inadumi, Koichiro YoshinoVLM Evaluation Vision-Language Models
1Nara Institute of Science and Technology · 2Guardian Robot Project RIKEN · 3The University of Osaka
Seeing Before Reasoning: Decoupling Perception and Reasoning for Shortcut-Resilient Multimodal On-Policy Self-Distillation
Jun 17, 2026Sihan Wang, Xiyao Liu, Lianqing Liu +1Vision-Language Models On-Policy Self-Distillation
State Key Laboratory of Robotics and Intelligent Systems, Shenyang Institute of Automation, Chinese Academy of Sciences
AMALIA-VL: A Native European Portuguese Open-Source Vision and Language Model
Jun 17, 2026Diogo Glória-Silva, João Cardeira, Manuel Letras da Luz +8Vision-Language Models Large Vision-Language Models
1NOVA School of Science and Technology · 2NOVA LINCS
ReSiReg: Towards Spatially Consistent Semantics in Language-Conditioned Robotic Tasks
Jun 17, 2026Simon Schwaiger, David Seyser, Alessandro Scherl +2Vision-Language Models Vision-Language Grounding
Graz University of Technology, Institute of Software Engineering and Artificial Intelligence · University of Applied Sciences Technikum Wien, Department of Industrial Engineering · 1Graz University of Technology, Institute of Software Engineering and Artificial Intelligence +2
Benchmarking Large Vision-Language Models on Fine-Grained Image Tasks: From Evaluation to Diagnosis
Jun 17, 2026Hong-Tao Yu, Chen-Wei Xie, Yuxin Peng +2VLM Evaluation VLM Robustness
School of Computer Science and Engineering, Southeast University, China · Alibaba Group · Wangxuan Institute of Computer Technology, National Key Laboratory for Multimedia Information Processing, Peking University, China +2
Hallucination Detection and Correction in Medical VLMs via Counter-Evidence Verification
Jun 17, 2026Nan Zhou, Ke Zou, Meng Liu +5Hallucination Detection in VLMs Vision-Language Models
the College of Computer Science, Sichuan University. · Yong Loo Lin School of Medicine, National University of Singapore. · National Key Laboratory of Autonomous Intelligent Unmanned Systems, Beijing2026 Institute of Technology. +2
EventDrive: Event Cameras for Vision-Language Driving Intelligence
Jun 16, 2026Dongyue Lu, Rong Li, Ao Liang +6Autonomous Driving Datasets Event-Based Vision
NUS · IPAL, CNRS IRL 2955, Singapore · HKUST(GZ) +4
MLLMs Get It Right, Then Get It Wrong: Tracing and Correcting Late-Layer Textual Bias
Jun 16, 2026Xingming Li, Ao Cheng, Qiyao Sun +4VLM Robustness Vision-Language Models
National University of Defense Technology, changsha, China · 2Chinese University of Hong Kong, Shenzhen, China · 3Intelligent Game and Decision Lab, Beijing, China
Attention Alignment Between Humans and Vision-Language Models
Jun 16, 2026Isaac R. Christian, Udith Haputhanthrige, Hanna Hornfeld +4VLM Evaluation Visual Attention
Princeton Neuroscience Institute, Princeton University · Department of Psychology, Princeton University · Department of Computer Science, Princeton University +2
Visuals Lie, Consistency Speaks: Disentangling Spatial Attention from Reliability in Vision-Language Models
Jun 16, 2026Logan Mann, Yi Xia, Ajit Saravanan +6VLM Evaluation VLM Robustness
Algoverse AI Research · University of California, Santa Barbara · University of California, Berkeley +1
Uncertainty Is Not a Safety Net for Clinical VQA, but Can It Anticipate Model Failure?
Jun 15, 2026Arnisa Fazla, Alberto Testoni, Ameen Abu-Hanna +2VLM Evaluation VLM Robustness
Department of Medical Informatics, Amsterdam University Medical Center, University of Amsterdam, Amsterdam, The Netherlands. · Amsterdam Public Health, Methodology, Amsterdam, The Netherlands. · MaiNLP, Center for Information and Language Processing, LMU Munich, Germany. +1
OneFocus: Enabling Real-World X-ray Security Screening with a Unified Vision-Language Model
Jun 14, 2026Jiali Wen, Hongxia Gao, Litao Li +4Visual Question Answering Vision-Language Models
2South China University of Technology · 1Xi’an Jiaotong University · 3Shenzhen Loop Area Institute +1
S $^2$ COPE: Self-Supervised Concept Discovery via Preference Learning
Jun 12, 2026Shilong Xiang, Zirui Zhang, Chengzhi MaoVision-Language Models Self-Supervised Learning
Rutgers University
Mirage Probes: How Vision Models Fake Visual Understanding
Jun 11, 2026Daniel Ben-Levi, Judah Goldfeder, Weiliang Zhao +5Vision-Language Models VLM Interpretability
Columbia University · Intuit · Technion +2
Cross-Modal Masked Compositional Concept Modeling for Enhancing Visio-Linguistic Compositionality
Jun 11, 2026Wei Li, Zhen Huang, Xinmei TianCross-Modal Learning Vision-Language Models
MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition, University of Science and Technology of China · Independent Researcher
The Vision Encoder as a Privacy Boundary: Visual-Token Side Channels in Encoder-Free Vision-Language Models
Jun 10, 2026Chenyu Zhou, Qiliang Jiang, Shuning Wu +1Vision-Language Models Adversarial Attacks
School of Engineering, Institute of Science Tokyo Tokyo, Japan · College of Control Science and Engineering, Zhejiang University Hangzhou, China · Department of Electrical and Computer Engineering, National University of Singapore Singapore, Singapore
Vector Map as Language: Toward Unified Remote Sensing Vector Mapping
Jun 9, 2026Yinglong Yan, Yunkai Yang, Haoyi Wang +7Remote Sensing Image Understanding Vision-Language Models
school of Artificial Intelligence and Robotics, Hunan University, Changsha 410082, China · Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong · Department of Geomatics Engineering, Changsha University of Science and Technology, Changsha 410114, China +1
Do Vision-Language Models See or Guess? Measuring and Reducing Textual-Prior Reliance with a Phrasing-Controlled Benchmark
Jun 9, 2026Pratham Singla, Shivank Garg, Vihan Singh +1VLM Evaluation Vision-Language Models
Lossfunk · Indian Institute of Technology Roorkee · Raeth AI
Density Ridge Selective Prediction for LLM and VLM Hallucination Detection under Calibration Label Scarcity
Jun 8, 2026Nina I. ShamsiHallucination Detection in VLMs Vision-Language Models
Northeastern University Boston, United States
Zero-Shot Semantic Re-Identification for Autonomous Driving: A VLM Baseline Study
Jun 8, 2026Eduardo Borges, Manuel Abreu, Luís Garrote +1VLM Evaluation Vision-Language Models
Institute of Systems and Robotics, University of Coimbra, Coimbra, Portugal
An Effective Router for Vision-Language Model Selection
Jun 8, 2026Can Wang, Shengwei Wang, Bolin Zhang +2Vision-Language Models
Harbin Institute of Technology Harbin, China · Harbin Institute of Technology Shandong Key Laboratory of Digital Service Computing Technology and Systems Harbin, China

Jun 21, 2026, cs.CVJ/K move · Enter open · S save

OmniSpace: Efficient Geometry Awareness for Autonomous Vehicles MLLMs

Hao Vo, Phu Loc Nguyen, Khoa Vo, Sieu Tran+6

University of Arkansas, USA · Google Research, Google · University of Liverpool, UK+1

Multi-View Geometry Vision-Language Models Visual Spatial Reasoning VLMs for Autonomous Driving Autonomous Driving Planning

Open paper AskPDF arXiv

Multimodal Large Language Models (MLLMs) have achieved remarkable performance on 2D visual tasks, yet enhancing their spatial intelligence for real-world applications such as Autonomous Vehicles (AV) remains an open challenge. Existing geometry-aware MLLMs typically rely on auxiliary 3D models at inference time, introducing pipeline complexity and the risk of cascading failures. In this paper, we present OmniSpace, a simple yet effective plug-and-play paradigm for geometry-aware spatial reasoning from purely 2D observations. Motivated by our finding that current MLLMs are bottlenecked by weak cross-view correspondence and depth estimation, OmniSpace introduces a Camera Pose Injector, a Multi-view Epipolar Attention module, and a 3D Geometric Distillation objective that jointly address these two limitations by transferring geometric knowledge into the model. Extensive experiments show that OmniSpace surpasses existing methods on planning benchmarks (nuScenes, Bench2Drive), risk detection (nuInstruct), language (Omnidrive), and generalization (DriveBench).

Momentum

Related topics

Latest papers 491