Vision-Language Models

Also known as VLM

Follow this topic Ask about this topic

Momentum

55 papers in the last four weeks, up 120% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 491

All topics

Failure-Aware Refinement of Vision-Language Model for Lithography Defect Detection
Jun 8, 2026Pangyun Jeong, Jiyeong Kong, Yuehua Hu +2Vision-Language Models VLM Adaptation
1HYU-KITECH Joint Department, Hanyang University, Ansan, 15588, Korea · 4Korea Institute of Industrial Technology, Ansan, 15588, Korea · 2Micro/Nano System Department, Korea University, Seoul 02841, Korea +1
One Stone, Three Birds: Self-adaptive Optimal Transport for Multi-VLM Selection, Adaptation, and Ensembling
Jun 6, 2026Qiyu Xu, Zhanxuan Hu, Yu Duan +4Vision-Language Models Unsupervised Domain Adaptation
School of Computer Science and Technology and the Ministry of Education Key Lab for Intelligent Networks and Network Security, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, China · School of Information Science and Technology, Yunnan Normal University, Chenggong, Kunming, Yunnan 650500, China · School of Telecommunications Engineering, Xidian University, Xi’an 710071, China +1
Vision-Language Asymmetry in Bistable Image Captioning
Jun 6, 2026Arohan AgateImage Captioning Vision-Language Models
University of Washington.
Textual Supervision Enhances Geospatial Representations in Vision-Language Models
Jun 5, 2026Marcelo Sartori Locatelli, Fernando Tonucci, Jea Kwon +5Vision-Language Models Geospatial Representation Learning
Max Planck Institute for Security and Privacy (MPI-SP), Bochum, Germany · Universidade Federal de Minas Gerais, Belo Horizonte, Brazil · Changwon National University, Changwon, South Korea +1
NAVI-Orbital: First In-Orbit Demonstration of a Zero-Shot Vision-Language Model for Autonomous Earth Observation
Jun 5, 2026Juan Manuel Delfa Victoria, Taran Cyriac John, Andrew W. HersonRemote Sensing Image Understanding Vision-Language Models
Jet Propulsion Laboratory California Institute of Technology Pasadena, CA, USA · School of Engineering and Computer Science Victoria University of Wellington Wellington 6140, New Zealand · Loft Orbital 321 11th St, San Francisco, CA 94103
Anchored, Not Graded: Vision-Language Models Fail at Slant-from-Texture Perception
Jun 4, 2026Qian Zhang, Michal Golovanevsky, Fulvio Domini +1VLM Evaluation Vision-Language Models
Brown University Computer Science · Harvard University · Brown University Cognitive Science
DRIFT: A Residual Flow Adapter for Decoding Continuous Outputs in Vision-Language Models
Jun 4, 2026Zhuoming Liu, Jinhong Lin, Kwan Man Cheng +3Vision-Language Models VLM Adaptation
University of Wisconsin–Madison · 2West Lafayette Jr./Sr. High School
Seeing Time: Benchmarking Chronological Reasoning and Shortcut Biases in Vision-Language Models
Jun 4, 2026Haoyu Zhou, Qing Qing, Caichong Li +6VLM Evaluation Vision-Language Models
College of Computer Science and Technology, Jilin University, Changchun 130012, China · College of Computing and Data Science, Nanyang Technological University, 639798, Singapore · School of Computer Science, Wuhan University, China +1
Would you still call this Dax? Novel Visual References in VLMs and Humans
Jun 3, 2026Ada Defne Tür, Gaurav Kamath, Joyce Chai +2VLM Evaluation Vision-Language Models
McGill University · Mila Quebec AI Institute · University of Michigan - Ann Arbor +1
Food-R1: A Unified Multi-Task Food Vision-Language Model with Reinforcement Learning
Jun 3, 2026Yu Zhu, Yongkang Li, Wenjie Zhu +5Vision-Language Models VLM Reasoning
Huazhong University of Science and Technology, Wuhan, China
Stateful Visual Encoders for Vision-Language Models
Jun 3, 2026Zirui Wang, Junwei Yu, Adam Yala +3Vision-Language Models Visual Representation Learning
1Voio, Inc. · 2UC Berkeley · 3UCSF
A Dataset for Dynamic Human Preferences for Vision Language Models
Jun 2, 2026Hannah Gao, Dylan Hadfield-Menell, Rachel MaVLM Evaluation Human Preference Evaluation
Massachusetts Institute of Technology · MIT Cambridge, MA
HorusEye: Language as Dynamic Attention for Emergency Visual Analysis
Jun 2, 2026Armel YaraVLM Robustness Vision-Language Models
MAOAM: Unified Object and Material Selection with Vision-Language Models
Jun 2, 2026Jaden Park, Valentin Deschaintre, Jason Kuen +5Vision-Language Models Text-Guided Image Segmentation
University of Wisconsin-Madison, USA · Adobe Research, United Kingdom · Adobe Research, USA
Beyond Encoder Accumulation: Measuring Encoder Roles in Multi-Encoder VLMs
Jun 2, 2026Wei Ding, Yudong Zhang, Ruobing Xie +3VLM Evaluation Vision-Language Models
Tsinghua University Beijing, China · Tsinghua University, Tencent Beijing, China · University of Science and Technology Beijing Beijing, China
When Attention Collapses: Stage-Aware Visual Token Pruning from Structure to Semantics
Jun 2, 2026Jiahui Wang, Kai Zhang, Mai Han +1Vision-Language Models Efficient VLM Inference
1Shandong University · 2National University of Singapore (Suzhou) Research Institute
SD-GRPO: Verifiable Segment Decomposition for Long-Form Vision-Language Generation
Jun 2, 2026Hyunwoong Kim, Seongeun Lee, Hannah Yun +2Vision-Language Models Group Relative Policy Optimization
DEEPNOID Inc., Seoul, South Korea
Disentangling Visual and Factual Correctness in LVLMs' Visualization Literacy
Jun 2, 2026Soohyun Lee, Jaeyoung Kim, Seokhyeon Park +5VLM Evaluation Data Visualization
Seoul National University · MADI Co., Ltd. · Hankuk University of Foreign Studies +1
TGV-KV: Text-Grounded KV Eviction for Vision-Language Models
Jun 2, 2026Jizhihui Liu, Ruizi Han, Miao Zhang +4Vision-Language Models Efficient VLM Inference
Harbin Institute of Technology, Shenzhen · Peng Cheng Laboratory
FineGen: A VLM-based Multi-Agent Framework for Fine-Grained Image-Text Dataset Construction
Jun 2, 2026Chang Kong, Yuebing Li, Peng Mo +2Synthetic Data Augmentation Vision-Language Models
Shenzhen Polytechnic University, Shenzhen, China · Institute of Applied Artificial Intelligence of the Guangdong-Hong Kong Macao2026 Greater Bay Area, Shenzhen, China · Shenzhen University, China
FUSE: Quantifying Uncertainty in Vision-Language Models by Bayesian Fusing Epistemic and Aleatoric Uncertainty
Jun 1, 2026Harry Zhang, Luca CarloneUncertainty Estimation for VLA Models Vision-Language Models
Massachusetts Institute of Technology
Do VLMs See What Sensors Feel? A Scalable Expert-Guided Design for Wheelchair Accessibility Assessment from Street View
Jun 1, 2026Dongdong Wang, Alina Hagen, Isabelle Gatmaitan +5VLM Evaluation Vision-Language Models
University of Florida · University of South Florida · University of Illinois Urbana-Champaign
STaR-KV: Spatio-Temporal Adaptive Re-weighting for KV Cache Compression in GUI Vision-Language Models
Jun 1, 2026Yuhang Han, Wenzheng Yang, Yujie Chen +4Vision-Language Models KV Caching
1EPIC Lab, SJTU · 2HKUST (GZ) · 3The University of Sydney +3
Density-Aware Translation of Spurious Correlations in Zero-Shot VLMs
Jun 1, 2026Afsaneh Hasanebrahimi, Hanxun Huang, Christopher Leckie +1VLM Robustness Vision-Language Models
School of Computing and Information Systems, The University of Melbourne, Victoria, Australia.
On the Limits of Token Reduction for Efficient Unified Vision Language Training
May 31, 2026Siyi Chen, Weiming Zhuang, Jingtao Li +1Vision-Language Models Unified Multimodal Models
University of Michigan · Sony AI
Beyond Captions: Context-Grounded Reconstruction for Biomedical Multimodal Continued Pretraining
May 31, 2026Guanghao Zhu, Zeyu Liu, Zhitian Hou +10Vision-Language Models Multimodal Pretraining
The Hong Kong Polytechnic University · Sun Yat-sen University · PolyU-Daya Bay Technology and Innovation Research Institute
Benchmarks for Vision-Language Models in Urban Perception Should Be Reliability-Aware and Negotiated
May 30, 2026Rashid MushkaniVLM Evaluation Inter-Rater Reliability
Université de Montréal, Montréal, Québec, Canada · Mila – Québec AI Institute, Montréal, Québec, Canada
T-CLIP: Enabling Thermal Perception for Contrastive Language-Image Pretraining
May 30, 2026Tayeba Qazi, Ayush Maheshwari, Prerana Mukherjee +1Thermal Imaging Image Captioning
Indian Institute of Technology Delhi, India · NVIDIA AI Technology Center, India · Jawaharlal Nehru University, India
LASER: Loss-Aware Singular-value Decomposition and Rank Allocation for Efficient Low-Precision Vision-Language Models
May 30, 2026Haiyu Wang, Yutong Wang, Leshu Li +2Vision-Language Models Efficient VLM Inference
Tandon School of Engineering, New York University · Courant Institute of Mathematical Sciences, New York University · Brookhaven National Laboratory
Detect Before You Leap: Mirage Detection in Vision-Language Models
May 29, 2026Md. Shaown Miah, S. M. Taiabul Haque, Syed Ishtiaque Ahmed +1Hallucination Detection in VLMs Vision-Language Models
Indiana University Indianapolis · University of Toronto

Jun 8, 2026, cs.CVJ/K move · Enter open · S save

Failure-Aware Refinement of Vision-Language Model for Lithography Defect Detection

Pangyun Jeong, Jiyeong Kong, Yuehua Hu, Dohee Jeong+1

1HYU-KITECH Joint Department, Hanyang University, Ansan, 15588, Korea · 4Korea Institute of Industrial Technology, Ansan, 15588, Korea · 2Micro/Nano System Department, Korea University, Seoul 02841, Korea+1

Vision-Language Models VLM Adaptation Semiconductor Manufacturing Industrial Inspection

Open paper AskPDF arXiv

Semiconductor lithography inspection requires reliable detection of small pattern defects such as bridge, burr, pinch, and contamination. In this study, we propose a two-stage vision-language framework that combines initial defect detection with prediction refinement. In the first stage, Qwen3-VL is fine-tuned with LoRA as a vision-language adapter to predict defect counts, defect categories, and normalized bounding boxes from lithography images. However, direct fine-tuning may still produce common test-time errors, including false positives, missed defects, and incorrect defect types. To address this limitation, the second stage trains a refinement module using first-stage prediction failures and their corrected labels, allowing the model to review and revise initial outputs. By learning from cases where the initial adapter fails, the refinement process improves defect inference beyond single-stage fine-tuning.

Momentum

Related topics

Latest papers 491