Large Vision Language Models

Follow this topic Ask about this topic

Recent momentum

-44%

58 papers in the last 28 days · 0.9% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

19 new papers

A weekly snapshot of new work published in Large Vision Language Models.

Period ending 2026-09-14

8 new papers

A weekly snapshot of new work published in Large Vision Language Models.

Period ending 2026-09-07

6 new papers

A weekly snapshot of new work published in Large Vision Language Models.

862 papers

Latest in Large Vision Language Models

Browse all topics →

MM-Conv: A Multimodal Dataset and Benchmark for Context-Aware Grounding in 3D Dialogue
May 20, 2026Anna Deichler, Jim O'Regan, Fethiye Irmak Dogan +4Large Vision Language Models Multimodal Dataset
SceneGraphGrounder: Zero-Shot 3D Visual Grounding via Structured Scene Graph Matching
May 20, 2026Xuefei Sun, Xujia Zhang, Brendan Crowe +23D Visual Grounding Large Vision Language Models
Flat-Pack Bench: Evaluating Spatio-Temporal Understanding in Large Vision-Language Models through Furniture Assembly
May 20, 2026Aditya Chetan, Eric Cai, Peeyush Kushwaha +5Fine-Grained Spatio-Temporal Information Large Vision Language Models
WikiVQABench: A Knowledge-Grounded Visual Question Answering Benchmark from Wikipedia and Wikidata
May 20, 2026Basel Shbita, Pengyuan Li, Anna Lisa GentileKnowledge-Based Visual Question Answering Benchmarks Large Vision Language Models
Reducing Object Hallucination in LVLMs via Emphasizing Image-negative Tokens
May 20, 2026Meng Shen, Minghao Wu, Deepu RajanLarge Vision Language Models Hallucinations
Mitigating Hallucinations in Large Vision-Language Models via Causal Route Gating
May 20, 2026Zhe Cheng, Wenyu Chen, Fode Zhang +1Large Vision Language Models Large Language Model Hallucination
SurgOnAir: Hierarchy-Aware Real-Time Surgical Video Commentary
May 20, 2026Jingyi He, Yue Zhou, Long Bai +3Surgical Videos Real-Time Systems
Finding the Correct Visual Evidence Without Forgetting: Mitigating Hallucination in LVLMs via Inter-Layer Visual Attention Discrepancy
May 20, 2026Yutong Xie, Zhenglin Hua, Ran Wang +3Large Language Model Hallucination Large Vision Language Models
Bridging Structure and Language: Graph-Based Visual Reasoning for Autonomous Road Understanding
May 20, 2026Lena Wild, Katie Z Luo, Marco PavoneLane Geometry Large Vision Language Models
RISE: Reliable Improvement in Self-Evolving Vision-Language Models
May 20, 2026Chaoran Xu, Yingmao Miao, Pengfei Zhang +3Large Vision Language Models Multimodal Reasoning
Machine Intelligence that Understands Visual and Linguistic Information and Interacts with Humans and Environments
May 20, 2026Van Quang NguyenLarge Vision Language Models Intelligence
MedExpMem: Adapting Experience Memory for Differential Diagnosis
May 20, 2026Qianhan Feng, Zhongzhen Huang, Yakun Zhu +4Clinical Reasoning Diagnostic Benchmark
Beyond Text and Tables: Vision-Language Model Integration in ComProScanner for Extracting Materials Data from Scientific Figures with High Accuracy
May 19, 2026Aritra Roy, Enrico Grisan, Chiara Gattinoni +1Image-Text Pairs Vast Chemical Space
A Human-in-the-Loop Framework for Efficient Prompt Selection in Microscopy Vision-Language Models
May 19, 2026Abhiram Kandiyana, Ankur Mali, Lawrence O. Hall +2Large Vision Language Models Microscopy
FullFlow: Upgrading Text-to-Image Flow Matching Models for Bidirectional Vision--Language Generation
May 19, 2026Eric Tillmann Bill, Enis Simsar, Alessio Tonioni +1Text-To-Image Diffusion Models Large Vision Language Models
From Seeing to Thinking: Decoupling Perception and Reasoning Improves Post-Training of Vision-Language Models
May 19, 2026Juncheng Wu, Hardy Chen, Haoqin Tu +6Large Vision Language Models Visual Reasoning
Rethinking Visual Attribution for Chest X-ray Reasoning in Large Vision Language Models
May 19, 2026Guangzhi Xiong, Qiao Jin, Sanchit Sinha +2Medical Vision-Language Models Chest X-Ray
SetCon: Towards Open-Ended Referring Segmentation via Set-Level Concept Prediction
May 19, 2026Zhixiong Zhang, Yizhuo Li, Shuangrui Ding +6Video Object Segmentation Large Vision Language Models
Passive Construction Site Safety Monitoring via Persona-Scaffolded Adversarial Chain-of-Thought VLM Verification
May 19, 2026Ananth Sriram, Neel Mokaria, Rajveer SinghVideo Surveillance Structural Health Monitoring
FineBench: Benchmarking and Enhancing Vision-Language Models for Fine-grained Human Activity Understanding
May 19, 2026Gueter Josmy Faure, Min-Hung Chen, Jia-Fong Yeh +2Fine-Grained Video Understanding Video Question Answering
Pseudocode-Guided Structured Reasoning for Automating Reliable Inference in Vision-Language Models
May 19, 2026Weicong Ni, Tianbao Jiang, Linlin WangLarge Vision Language Models Hallucination Rate
RE-VLM: Event-Augmented Vision-Language Model for Scene Understanding
May 19, 2026Hanqing Liu, Mingjie Liu, Luoping Cui +3Large Vision Language Models Vision-Language
EgoBabyVLM: Benchmarking Cross-Modal Learning from Naturalistic Egocentric Video Data
May 18, 2026Dongyan Lin, Phillip Rust, Angel Villar Corrales +19Large Vision Language Models Egocentric Video
Aurora: Unified Video Editing with a Tool-Using Agent
May 18, 2026Yongsheng Yu, Ziyun Zeng, Zhiyuan Xiao +4Video Editing Text-To-Video Models
Starve to Perceive: Taming Lazy Perception in VLMs with Constrained Visual Bandwidth
May 18, 2026Yuhuan Wu, Cong Wei, Fangzhen Lin +2Large Vision Language Models Perceptual Understanding
VISAFF: Speaker-Centered Visual Affective Feature Learning for Emotion Recognition in Conversation
May 18, 2026Linan ZHU, Zihao Zhai, Xiao Han +4Emotion Recognition Speaker Verification Performance
What's Holding Back Latent Visual Reasoning?
May 18, 2026André G. Viveiros, Nuno Gonçalves, André F. T. Martins +1Latent Visual Reasoning Latent Reasoning Tokens
Wasserstein Equilibrium Decoding for Reliable Medical Visual Question Answering
May 18, 2026Luca Hagen, Johanna P. Müller, Weitong Zhang +2Medical Visual Question Answering Large Vision Language Models
Self-Evolving Spatial Reasoning in Vision Language Models via Geometric Logic Consistency
May 18, 2026Junming Liu, Yuqi Li, Yifei Sun +4Large Vision Language Models Spatial Reasoning
What Matters for Grocery Product Retrieval with Open Source Vision Language Models
May 18, 2026Emmanuel G. Maminta, Rowel O. AtienzaLarge Vision Language Models Multimodal Retrieval
SkyNative: A Native Multimodal Framework for Remote Sensing Visual Evidence Reasoning
May 18, 2026Xiao Yang, Ronghao Fu, Zhiwen Lin +10Remote Sensing Large Vision Language Models
Why We Look Where We Look: Emergent Human-like Fixations of a Foveated Visual Language Model Maximizing Scene Understanding
May 18, 2026Shravan Murlidaran, Ziqi Wen, Sana Shehabi +1Perceptual Understanding Large Vision Language Models
TAME: Test-Time Adversarial Prompt Tuning via Mixture-of-Experts for Vision-Language Models
May 17, 2026Xin Wang, Yixu Wang, Jiaming Zhang +6Vision-Language Model Adaptation Large Vision Language Models
Employing Vision-Language Models for Face Image Quality Assessment
May 17, 2026Erdi Sarıtaş, Eren Onaran, Vitomir Štruc +1Image Quality Assessment Multimodal Evaluation
SEDualVLN: A Spatially-Enhanced Dual-System for Vision-Language Navigation
May 17, 2026Jingzhi Huang, Junkai Huang, Wenxuan Song +4Vision-Language Navigation Large Vision Language Models
Multilingual and Multimodal LLMs in the Wild: Building for Low-Resource Languages
May 16, 2026Firoj Alam, Shammur Absar Chowdhury, Enamul Hoque PrinceLow-Resource Languages Multi-Modal Large Language Models
Contrastive Conceptor Activation Steering (COAST): Unlocking Vision-Language-Action Models through Hidden States
May 16, 2026Miranda Muqing Miao, Subin Kim, Brandon Yang +1Large Vision Language Models Activation Steering
UCSF-PDGM-VQA: Visual Question Answering dataset for brain tumor MRI interpretation
May 16, 2026Shiv Ghosh, Junayd Lateef, Chih-Hua Liu +3Brain Tumor Classification Textvqa
HEED: Density-Weighted Residual Alignment for Hybrid Vision-Language Model Distillation
May 16, 2026Yihao Liang, Niraj K. JhaChain-Of-Thought Distillation Large Vision Language Models
EPIC-Bench: A Perception-Centric Benchmark for Fine-Grained Embodied Visual Grounding in Vision-Language Models
May 16, 2026Haozhe Shan, Xiancong Ren, Han Dong +9Explicit Visual Grounding Large Vision Language Models
SHED: Style-Homogenized Embedding Alignment for Domain Generalization
May 16, 2026Kai Gan, Tong WeiDomain Generalization Large Vision Language Models
OmniVL-Guard Pro: A Tool-Augmented Agent for Omnibus Vision-Language Forensics
May 16, 2026Jinjie Shen, Zheng Huang, Yuchen Zhang +7Face Forgery Detection Digital Forensics
Thinking with Patterns: Breaking the Perceptual Bottleneck in Visual Planning via Pattern Induction
May 16, 2026Yichang Jian, Boyuan Xiao, Zhenyuan Huang +2Large Vision Language Models Perceptual Understanding
"I'm Not Mad, Just Focused'': Understanding Human Emotions in Human-Robot Collaboration
May 16, 2026Seung Chan Hong, Dana Kulić, Leimin TianHuman-Robot Collaboration Robotic Datasets
TRACE: Evidence Grounding-Guided Multi-Video Event Understanding and Claim Generation
May 16, 2026Pengyu Yan, Akhil Gorugantu, Mahesh Bhosale +3Video Temporal Grounding Large Vision Language Models
A Cross-Modal Prompt Injection Attack against Large Vision-Language Models with Image-Only Perturbation
May 15, 2026Hao Yang, Zhuo Ma, Yang Liu +3Large Vision Language Models Cross-Modal Attention
VideoSeeker: Incentivizing Instance-level Video Understanding via Native Agentic Tool Invocation
May 15, 2026Yiming Zhao, Yu Zeng, Wenxuan Huang +11Fine-Grained Video Understanding Video Understanding
Sparse Autoencoders enable Robust and Interpretable Fine-tuning of CLIP models
May 15, 2026Fabian Morelli, Arnas Uselis, Ankit Sonthalia +1Supervised Fine-Tuning Large Vision Language Models
From Failure to Feedback: Group Revision Unlocks Hard Cases in Object-Level Grounding
May 15, 2026Yuyuan Liu, Yiping Ji, Anjie Le +6Vision-Language Model Grounding Sample-Wise 2D Refinement
EntropyScan: Towards Model-level Backdoor Detection in LVLMs via Visual Attention Entropy
May 15, 2026Xuanyu Ge, Zhongqi Wang, Jie Zhang +2Backdoor Attacks Large Vision Language Models
LRCP: Low-Rank Compressibility Guided Visual Token Pruning for Efficient LVLMs
May 15, 2026Hongyu Lu, Feng Zhang, Wenwei Jin +5Visual Tokens Large Vision Language Models
MI-CXR: A Benchmark for Longitudinal Reasoning over Multi-Interval Chest X-rays
May 15, 2026Sunghwan Steve Cho, Yunseok Han, Jaeyoung DoChest X-Ray Chest Radiography
DeltaPrompts: Escaping the Zero-Delta Trap in Multimodal Distillation
May 15, 2026Jaehun Jung, Hyunwoo Kim, Brandon Cui +4Chain-Of-Thought Distillation On-Policy Distillation
ATLAS: Agentic or Latent Visual Reasoning? One Word is Enough for Both
May 14, 2026Ziyu Guo, Rain Liu, Xinyan Chen +1Latent Visual Reasoning Visual Reasoning
On the Cultural Anachronism and Temporal Reasoning in Vision Language Models
May 14, 2026Mukul Ranjan, Prince Jha, Khushboo Kumari +1Large Vision Language Models
MHSA: A Lightweight Framework for Mitigating Hallucinations via Steered Attention in LVLMs
May 14, 2026Wei Ding, Yilin Li, Yudong Zhang +4Hallucination Mitigation Hallucinations
Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Model
May 14, 2026Tao Lin, Yuxin Du, Jiting Liu +14Efficient Vision-Language-Action Models Vision-Language-Action Models
Chain-of-Procedure: Hierarchical Visual-Language Reasoning for Procedural QA
May 14, 2026Guanhua Chen, Yutong Yao, Shenghe Sun +5Knowledge-Based Visual Question Answering Large Vision Language Models
SteerSeg: Attention Steering for Reasoning Video Segmentation
May 14, 2026Ali Cheraghian, Hamidreza Dastmalchi, Abdelwahed Khamis +3Video Object Segmentation Vision-Language Model Grounding
MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models
May 14, 2026Xiyu Ren, Zhaowei Wang, Yiming Du +11Multimodal Memory Large Vision Language Models

May 20, 2026 · cs.CVJ/K move · Enter open · S save

MM-Conv: A Multimodal Dataset and Benchmark for Context-Aware Grounding in 3D Dialogue

Anna Deichler, Jim O'Regan, Fethiye Irmak Dogan, Lubos Marcinek+3

KTH Royal Institute of Technology, Stockholm, Sweden

Grounding language in the physical world requires AI systems to interpret references that emerge dynamically during conversation. While current vision-language models (VLMs) excel at static image tasks, they struggle to resolve ambiguous expressions in spontaneous, multi-turn dialogue. We address this gap by introducing (1) a benchmark for referential communication in dynamic 3D environments, built from 6.7 hours of egocentric VR interaction with synchronized speech, motion, gaze, and 3D scene geometry, and (2) a two-stage grounding pipeline that explicitly resolves conversational ambiguity before visual localization. The benchmark includes over 4,200 manually verified referring expressions spanning full, partitive, and pronominal types. Our contextual rewriting approach improves grounding performance by 11-22 percentage points on average, with a pure detector (GroundingDINO) reaching 56.7% on pronominals after rewriting, nearly double the best end-to-end baseline. Results demonstrate that decoupling linguistic reasoning from visual perception is more effective than end-to-end approaches for conversational grounding.

Large Vision Language Models Multimodal Dataset Virtual Reality

Open paper Ask about it PDF

Recent momentum

Neighbouring directions

Recent digests

19 new papers

8 new papers

6 new papers

Latest in Large Vision Language Models