VLM Adaptation

VLM: Vision-Language Model

Follow this topic Ask about this topic

Momentum

34 papers in the last four weeks, up 209% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 395

All topics

Direct Product Flow Matching: Decoupling Radial and Angular Dynamics for Few-Shot Adaptation
May 6, 2026Hongxu Chen, Yanghao Wang, Bowei Zhu +6Cross-Modal Learning Flow Matching
HKUST · USTC · Huawei Research
DiCLIP: Diffusion Model Enhances CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentation
May 6, 2026Zhiwei Yang, Pengfei Song, Yucong Meng +3Vision-Language Models Weakly Supervised Image Segmentation
Academy for Engineering and Technology, Fudan University, Shanghai 200433, China · Shandong Computer Science Center, China · Digital Medical Research Center, School of Basic Medical Science, Fudan University, and also with Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention, Shanghai 200032, China +1
Reward-Guided Semantic Evolution for Test-time Adaptive Object Detection
May 6, 2026Lihua Zhou, Mao Ye, Xiatian Zhu +7Open-Vocabulary Object Detection Test-Time Adaptation
Centre for Artificial Intelligence and Robotics, Hong Kong Institute of Science and Innovation, Chinese Academy of Sciences, Hong Kong, China · School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China · Surrey Institute for People-Centred Artificial Intelligence, CVSSP, University of Surrey, Guildford, UK +3
From Priors to Perception: Grounding Video-LLMs in Physical Reality
May 6, 2026Zicheng Zhao, Chaofan Gan, Shijie Li +1VLM Adaptation VLM Reasoning
Shanghai Jiao Tong University
SpecPL: Disentangling Spectral Granularity for Prompt Learning
May 6, 2026Jingtao Zhou, Xirui Kang, Feiyang Huang +1VLM Adaptation Frequency-Domain Feature Learning
Department of Electrical Engineering, City University of Hong Kong, Hong Kong SAR.
Joint Semantic Token Selection and Prompt Optimization for Interpretable Prompt Learning
May 6, 2026Yating Wang, Yaqi Zhao, Yongshun Gong +2Prompt Learning VLM Adaptation
School of Software, Shandong University, Jinan, 250101, China
StateVLM: A State-Aware Vision-Language Model for Robotic Affordance Reasoning
May 5, 2026Xiaowen Sun, Matthias Kerzel, Mengdi Li +3Physical Reasoning VLM Adaptation
Department of Informatics, University of Hamburg, Germany · King Abdullah University of Science and Technology, Saudi Arabia
Memory-Efficient Continual Learning with CLIP Models
May 5, 2026Ryan King, Gang Li, Bobak Mortazavi +1Class-Incremental Learning Contrastive Learning
Department of Computer Science Texas A&M University College Station, TX 77843 · Texas A&M University College Station, TX 77843
The Detector Teaches Itself: Lightweight Self-Supervised Adaptation for Open-Vocabulary Object Detection
May 5, 2026Yazhe Wan, Changjae OhOpen-Vocabulary Object Detection VLM Adaptation
Queen Mary University of London · Queen Mary University of London, London, UK
Text-Guided Multi-Scale Frequency Representation Adaptation
May 5, 2026Weicai Yan, Xinhua Ma, Wang Lin +1Domain Adaptation VLM Adaptation
Zhejiang University · 2Nanyang Technological University
MHPR: Multidimensional Human Perception and Reasoning Benchmark for Large Vision-Languate Models
May 5, 2026Kangkang Wang, Qinting Jiang, Wanping Zhang +2VLM Evaluation Vision-Language Models
AI Compute Group, Baidu · Tsinghua University
GRPO-TTA: Test-Time Visual Tuning for Vision-Language Models via GRPO-Driven Reinforcement Learning
May 5, 2026Yujun Li, Hongyuan Zhang, Yuan YuanVLM Adaptation Test-Time Adaptation of VLMs
School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University, Xi’an 710072, P.R. China · The University of Hong Kong
CropVLM: A Domain-Adapted Vision-Language Model for Open-Set Crop Analysis
May 5, 2026Abderrahmene Boudiaf, Sajd JavedOpen-Vocabulary Object Detection Agricultural Image Analysis
Department of Electrical Engineering and Computer Science, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
VideoNet: A Large-Scale Dataset for Domain-Specific Action Recognition
May 4, 2026Tanush Yadav, Mohammadreza Salehi, Jae Sung Park +6VLM Evaluation VLM Adaptation
University of Washington · Stanford University · Allen Institute for AI
Rethinking the Need for Source Models: Source-Free Domain Adaptation from Scratch Guided by a Vision-Language Model
May 4, 2026Zhou Bingtao, Xiang Mian, Ning QianSource-Free Domain Adaptation VLM Adaptation
Sichuan University, No.24 South Section 1, Yihuan Road, Chengdu, 610065, Sichuan, China · Hubei Minzu University, 39 Xueyuan Road, Enshi, 445000, Hubei, China
Intrinsic Gradient Suppression for Label-Noise Prompt Tuning in Vision-Language Models
May 1, 2026Jiayu Li, Jiaxin Qi, Sheng Zhou +2VLM Robustness VLM Adaptation
Improving Calibration in Test-Time Prompt Tuning for Vision-Language Models via Data-Free Flatness-Aware Prompt Pretraining
Apr 30, 2026Hyeonseo Jang, Jaebyeong Jeon, Joong-Won Hwang +1Deep Learning Optimization Vision-Language Models
1Yonsei University · 2ETRI
SpaAct: Spatially-Activated Transition Learning with Curriculum Adaptation for Vision-Language Navigation
Apr 30, 2026Pengna Li, Kangyi Wu, Shaoqing Xu +7VLM Adaptation Vision-Language Navigation
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · The State Key Laboratory of Internet of Things for Smart City, Centre for Artificial Intelligence and Robotics, University of Macau · Xiaomi EV +2
World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoning
Apr 29, 2026Wanyue Zhang, Wenxiang Wu, Wang Xu +6Visual Spatial Reasoning VLM Adaptation
Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · Harbin Institute of Technology +2
Generalized Category Discovery under Domain Shifts: From Vision to Vision-Language Models
Apr 29, 2026Hongjun Wang, Po Hu, Kai HanVLM Adaptation Vision Foundation Model Adaptation
School of Computing and Data Science, The University of Hong Kong
Personalized Cross-Modal Emotional Correlation Learning for Speech-Preserving Facial Expression Manipulation
Apr 28, 2026Tianshui Chen, Yujie Zhu, Jianman Lin +4Prompt Learning VLM Adaptation
Guangdong University of Technology · South China University of Technology · Peking University +1
Probing CLIP's Comprehension of 360-Degree Textual and Visual Semantics
Apr 27, 2026Hai Wang, Xiaochen Yang, Mingzhi Dong +1VLM Evaluation VLM Adaptation
Department of Statistical Science, University College London, UK · School of Mathematics and Statistics, University of Glasgow, UK · Department of Computer Science, University of Bath, UK.
Majorization-Guided Test-Time Adaptation for Vision-Language Models under Modality-Specific Shift
Apr 27, 2026Lixian Chen, Yanhui Chen, Junyi LinVLM Robustness Test-Time Adaptation
Guangdong University of Technology · Guangzhou, China
$M^2$ -VLA: Boosting Vision-Language Models for Generalizable Manipulation via Layer Mixture and Meta-Skills
Apr 27, 2026Siyao Xiao, Yuhong Zhang, Zhifang Liu +9Language-Conditioned Robot Manipulation VLM Adaptation
Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, China. · PengCheng Laboratory, Shenzhen, China. · College of Intelligent Robotics and Advanced Manufacturing, Fudan University, Shanghai, China. +1
Multi-View Synergistic Learning with Vision-Language Adaption for Low-Resource Biomedical Image Classification
Apr 27, 2026Xiaoliu Luo, Minxue Xiao, Ting Xie +5VLM Adaptation Multi-View Learning
Chongqing University of Technology · Hebei University of Technology · Nanyang Technological University +3
HAC: Parameter-Efficient Hyperbolic Adaptation of CLIP for Zero-Shot VQA
Apr 26, 2026Francesco Dibitonto, Cigdem Beyan, Vittorio MurinoVisual Question Answering Zero-Shot Learning
Department of Computer Science, University of Verona, Verona, Italy · EVS - Embedded Vision Systems Srl, Verona, Italy · AI for Good (AIGO), Istituto Italiano di Tecnologia, Genova, Italy
Exploring Hierarchical Consistency and Unbiased Objectness for Open-Vocabulary Object Detection
Apr 25, 2026Sanghoon Lee, Geon Lee, Hyekang Park +1Open-Vocabulary Object Detection Probability Calibration
Yonsei University · Korea Institute of Science and Technology (KIST)
DARC-CLIP: Dynamic Adaptive Refinement with Cross-Attention for Meme Understanding
Apr 25, 2026Qiyuan JinVLM Adaptation Hate Speech Detection
The Hong Kong University of Science and Technology
EV-CLIP: Efficient Visual Prompt Adaptation for CLIP in Few-shot Action Recognition under Visual Challenges
Apr 24, 2026Hyo Jin Jon, Longbin Jin, Eun Yi KimVLM Adaptation Domain Generalization
Computer Vision Lab., Konkuk University, Seoul, South Korea
Cross-Stage Coherence in Hierarchical Driving VQA: Explicit Baselines and Learned Gated Context Projectors
Apr 24, 2026Gautam Kumar Jain, Carsten Markgraf, Julian StählerVisual Question Answering VLMs for Autonomous Driving
Technische Hochschule Augsburg TTZ Landsberg, Landsberg am Lech, Germany

May 6, 2026, cs.CVJ/K move · Enter open · S save

Direct Product Flow Matching: Decoupling Radial and Angular Dynamics for Few-Shot Adaptation

Hongxu Chen, Yanghao Wang, Bowei Zhu, Hongxiang Li+5

HKUST · USTC · Huawei Research

Cross-Modal Learning Flow Matching VLM Adaptation Cross-Modal Alignment

Open paper AskPDF arXiv

Recent flow matching (FM) methods improve the few-shot adaptation of vision-language models, by modeling cross-modal alignment as a continuous multi-step flow. In this paper, we argue that existing FM methods are inherently constrained by incompatible geometric priors on pre-trained cross-modal features, resulting in suboptimal adaptation performance. We first analyze these methods from a polar decomposition perspective (i.e., radial and angular sub-manifolds). Under this new geometric view, we identify three overlooked limitations in them: 1) Angular dynamics distortion: The radial-angular coupling induces non-uniform speed on the angular sub-manifold, leading to regression training difficulty and extra truncation errors. 2) Radial dynamics neglect: Feature normalization discards modality confidence, failing to distinguish out-of-distribution and in-distribution data, and abandoning crucial radial dynamics. 3) Context-agnostic unconditional flow: Dataset-specific information loss during pre-trained cross-modal feature extraction remains unrecovered. To resolve these issues, we propose warped product flow matching (WP-FM), a unified Riemannian framework that reformulates alignment on a warped product manifold. Within this framework, we derive direct product flow matching (DP-FM) by introducing a constant-warping metric, which yields a decoupled cylindrical manifold (i.e., direct product manifold). DP-FM enables independent radial evolution and constant-speed angular geodesic transport, effectively eliminating angular dynamics distortion while preserving radial consistency. Meanwhile, we incorporate classifier-free guidance by conditioning the flow on the pre-trained VLMs' hidden states to inject missing dataset-specific information. Extensive results across 11 benchmarks have demonstrated that DP-FM achieves a new state-of-the-art for multi-step few-shot adaptation.

Momentum

Related topics

Latest papers 395