Vision-Language Models

Also known as VLM

Follow this topic Ask about this topic

Momentum

55 papers in the last four weeks, up 120% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 491

All topics

VIP: Visual-guided Prompt Evolution for Efficient Dense Vision-Language Inference
May 12, 2026Hao Zhu, Shuo Jin, Wenbin Liao +4Image Segmentation Vision-Language Models
Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, China · XJTLU +1
Beyond Text Prompts: Visual-to-Visual Generation as A Unified Paradigm
May 12, 2026Yaofang Liu, Kangning Cui, Meng Chu +7Vision-Language Models Conditional Image Generation
City University of Hong Kong · City University of Hong Kong (Dongguan) · The Hong Kong University of Science and Technology +4
UHR-Micro: Diagnosing and Mitigating the Resolution Illusion in Earth Observation VLMs
May 12, 2026Shuo Ni, Tong Wang, Jing Zhang +5VLM Evaluation Remote Sensing Image Understanding
National Key Laboratory of Science and Technology on Space-Born Intelligent Information Processing, Beijing Institute of Technology, Beijing, China · Zhongguancun Academy, Beijing, China · School of Computer Science, Wuhan University, Wuhan, China +2
DistractMIA: Black-Box Membership Inference on Vision-Language Models via Semantic Distraction
May 12, 2026Hongyi Tang, Zhihao Zhu, Yi YangVision-Language Models Membership Inference Attacks
The Hong Kong University of Science and Technology
Urban Risk-Aware Navigation via VQA-Based Event Maps for People with Low Vision
May 12, 2026Antoni Valls, Jordi Sanchez-RieraVisual Question Answering Vision-Language Models
Institut de Rob`otica i Inform`atica Industrial, CSIC-UPC, Llorens i Artigas 4-6, 08028 Barcelona, Spain
Revisiting Shadow Detection from a Vision-Language Perspective
May 12, 2026Yonghui Wang, Shaokai Liu, Wengang Zhou +2Vision-Language Models
Department of Electronic Engineering and Information Science, University of Science and Technology of China · School of Management, Hefei University of Technology · School of Artificial Intelligence and Data Science, University of Science and Technology of China
Don't Look at the Numbers: Visual Anchoring Bias and Layer-wise Representation in VLMs
May 11, 2026M. ShalankinVLM Evaluation Vision-Language Models
Birds of a Feather Flock Together: Background-Invariant Representations via Linear Structure in VLMs
May 11, 2026Youssef Zaazou, Mark ThomasVLM Robustness Vision-Language Models
Independent Researcher
Personal Visual Context Learning in Large Multimodal Models
May 11, 2026Zihui Xue, Ami Baid, Sangho Kim +2Vision-Language Models Multimodal Large Language Models
The University of Texas at Austin
Grounded or Guessing? LVLM Confidence Estimation via Blind-Image Contrastive Ranking
May 11, 2026Reza Khanmohammadi, Erfan Miahi, Simerjot Kaur +4VLM Evaluation Vision-Language Models
Michigan State University · Independent AI Researcher · JPMorgan AI Research +1
Verification Mirage: Mapping the Reliability Boundary of Self-Verification in Medical VQA
May 11, 2026Ruinan Jin, Beidi Zhao, Myeongkyun Kang +2VLM Evaluation Vision-Language Models
1The University of British Columbia · 2Vector Institute · 3Redmin University of China
LLaVA-CKD: Bottom-Up Cascaded Knowledge Distillation for Vision-Language Models
May 11, 2026Nikolaos Gkalelis, Vasileios MezarisVision-Language Models Efficient VLM Inference
CERTH-ITI, Thessaloniki, Greece, 57001
MFVLR: Multi-domain Fine-grained Vision-Language Reconstruction for Generalizable Diffusion Face Forgery Detection and Localization
May 11, 2026Yaning Zhang, Tianyi Wang, Zan Gao +3Vision-Language Models Image Forgery Detection
Faculty of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan, 250353, China · School of Computing, National University of Singapore, 21 Lower Kent Ridge Rd, 11907750, Singapore · Shandong Artificial Intelligence Institute, Qilu University of Technology (Shandong Academy of Sciences), Jinan, 250014, China +2
The Cartesian Shortcut: Re-evaluate Vision Reasoning in Polar Coordinate Space
May 11, 2026Xia Hu, Zhenrui Yue, Brian Potetz +4VLM Evaluation Spatial Reasoning Benchmarks
Google DeepMind · Stanford University · Google Research
Reflection Anchors for Propagation-Aware Visual Retention in Long-Chain Multimodal Reasoning
May 10, 2026Xuan Gong, Hanbo Huang, Hao Zheng +4Vision-Language Models Vision-Language Grounding
Shanghai Jiao Tong University · Lanzhou University
KEPIL: Knowledge-Enhanced Prompt-Image Learning for Prompt-Robust Disease Detection
May 9, 2026Haozhe Luo, Shelley Zixin Shu, Ziyu Zhou +2VLM Robustness Radiology VLMs
ARTORG Center for Biomedical Engineering Research, University of Bern · Kaiko.AI, Zurich, Switzerland · Shanghai Jiao Tong University +1
Gate-and-Merge: Zero-shot Compositional Personalization of Vision Language Models
May 9, 2026Guodong Ding, Angela YaoVision-Language Models VLM Adaptation
National University of Singapore
ZAYA1-VL-8B Technical Report
May 8, 2026Hassan Shapourian, Kasra Hejazi, Olabode M. Sule +1Vision-Language Models Mixture-of-Experts Language Models
Zyphra Technologies Inc, San Francisco, CA
PolarVLM: Bridging the Semantic-Physical Gap in Vision-Language Models
May 8, 2026Yuliang Li, Chu Zhou, Heng Guo +3Visual Question Answering Vision-Language Models
Beijing University of Posts and Telecommunications, China · National Institute of Informatics, Japan · Peking University, China +1
Tracing the Arrow of Time: Diagnosing Temporal Information Flow in Video-LLMs
May 8, 2026Peitao Han, Fei Cheng, Lis K. Pereira +2Vision-Language Models Temporal Reasoning in Language Models
The University of Osaka · Center for Information and Neural Networks · National Institute of Information and Communications Technology +2
From Pixels to Prompts: Vision-Language Models
May 8, 2026Khang Hoang Nhat VoVision-Language Models Large Vision-Language Models
Hierarchical Dual-Subspace Decoupling for Continual Learning in Vision-Language Models
May 8, 2026Mengxin Qin, Xiang Zhang, Kun Wei +2Class-Incremental Learning Vision-Language Models
School of Electronic Engineering, Xidian University Xi’an 710071, China
DIMoE-Adapters: Dynamic Expert Evolution for Continual Learning in Vision-Language Models
May 8, 2026Mengxin Qin, Xiang Zhang, Xi Wang +3Vision-Language Models Fine-Tuning
School of Electronic Engineering, Xidian University Xi’an 710071, China
ForgeVLA: Federated Vision-Language-Action Learning without Language Annotations
May 8, 2026Yuhao Zhou, Yunpeng Zhu, Yang Zhou +7Vision-Language Models Efficient VLA Models
Sichuan University · Engineering Research Center of Machine Learning and Industry Intelligence, Ministry of Education · Zhejiang University +2
GPO-V: Jailbreak Diffusion Vision Language Model by Global Probability Optimization
May 8, 2026Yu Pan, Andi Zhang, Yi Wang +2Diffusion Model Alignment Adversarial Attacks on VLMs
ShanghaiTech University · University of Warwick · SUN YAT-SEN UNIVERSITY
GeoStack: A Framework for Quasi-Abelian Knowledge Composition in VLMs
May 7, 2026Pranav Mantini, Shishir K. ShahVision-Language Models VLM Adaptation
Department of Computer Science University of Houston · The University of Oklahoma School of Computer Science
PlotPick: AI-powered batch extraction of numerical data from scientific figures
May 7, 2026Tommy CarstensenData Visualization Vision-Language Models
Copenhagen Research Centre for Biological and Precision Psychiatry, Mental Health Centre Copenhagen, Copenhagen University Hospital, Copenhagen, Denmark
When Language Overwrites Vision: Over-Alignment and Geometric Debiasing in Vision-Language Models
May 7, 2026Harshvardhan Saini, Samyak Jha, Yiming Tang +1Vision-Language Models Object Hallucination in VLMs
Indian Institute of Technology Dhanbad · National University of Singapore
VisMMOE: Exploiting Visual-Expert Affinity for Efficient Visual-Language MoE Offloading
May 7, 2026Cheng Xu, Xiaofeng Hou, Jiacheng Liu +1Expert Offloading Vision-Language Models
Shanghai Jiao Tong University Minhang Qu, Shanghai, China
Large Vision-Language Models Get Lost in Attention
May 7, 2026Gongli Xi, Ye Tian, Mengyu Yang +5Transformer FFNs Vision-Language Models
School of Cyberspace Security, Beijing University of Posts and Telecommunications, Beijing, China · State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China · School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing, China +3

May 12, 2026, cs.CVJ/K move · Enter open · S save

VIP: Visual-guided Prompt Evolution for Efficient Dense Vision-Language Inference

Hao Zhu, Shuo Jin, Wenbin Liao, Jiayu Xiao+3

Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, China · XJTLU+1

Image Segmentation Vision-Language Models Efficient VLM Inference Prompt Optimization Open-Vocabulary Semantic Segmentation Vision-Language Alignment

Open paper AskPDF arXiv

Pursuing training-free open-vocabulary semantic segmentation in an efficient and generalizable manner remains challenging due to the deep-seated spatial bias in CLIP. To overcome the limitations of existing solutions, this work moves beyond the CLIP-based paradigm and harnesses the recent spatially-aware dino

.

txt framework to facilitate more efficient and high-quality dense prediction. While dino

.

txt exhibits robust spatial awareness, we find that the semantic ambiguity of text queries gives rise to severe mismatch within its dense cross-modal interactions. To address this, we introduce Visual-guided Prompt evolution (VIP) to rectify the semantic expressiveness of text queries in dino

.

txt, unleashing its potential for fine-grained object perception. Towards this end, VIP integrates alias expansion with a visual-guided distillation mechanism to mine valuable semantic cues, which are robustly aggregated in a saliency-aware manner to yield a high-fidelity prediction. Extensive evaluations demonstrate that VIP: 1. surpasses the top-leading methods by 1.4%-8.4% average mIoU, 2. generalizes well to diverse challenging domains, and 3. requires marginal inference time and memory overhead.

Momentum

Related topics

Latest papers 491