VLM Adaptation

VLM: Vision-Language Model

Follow this topic Ask about this topic

Momentum

34 papers in the last four weeks, up 209% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 395

All topics

EgoAdapt: A Multi-Scene Egocentric Adaptation Method for CVPR 2026 HD-EPIC VQA Challenge
May 23, 2026Zhiwei Chen, Yupeng Hu, Zixu Li +4Test-Time Adaptation VLM Adaptation
Shandong University · Harbin Institute of Technology (Shenzhen)
Turning Adaptation into Assets: Cross-Domain Bridging for Online Vision-Language Navigation
May 22, 2026Zixuan Hu, Xuantuo Huang, Yancheng Li +3VLM Adaptation Continual Test-Time Adaptation
School of Computer Science, Peking University, Beijing, China · School of Electronics, Peking University, Beijing, China · Peng Cheng Laboratory, Shenzhen, China
Agentic-VLA: Efficient Online Adaptation for Vision-Language-Action Models
May 21, 2026Ruofan Jin, Zaixi ZhangAgentic RL VLM Adaptation
Scinetics.
Supervised Classification Heads as Semantic Prototypes: Unlocking Vision-Language Alignment via Weight Recycling
May 21, 2026David Méndez, Roberto Confalonieri, Natalia Díaz RodríguezCross-Modal Learning VLM Adaptation
Department of Computer Science and Artificial Intelligence, DaSCI Institute, University of Granada, Granada, Spain · Department of Mathematics “Tullio Levi-Civita”, University of Padova, Padova, Italy.
HyLoVQA: Dynamic Hypernetwork-Generated Low-Rank Adaptation for Continual Visual Question Answering
May 21, 2026Yiran Wang, Chenyi Xiong, Ziyue Qin +3Visual Question Answering Vision-Language Models
School of Computer Science, Hubei University, Wuhan 430062, China · Hubei Key Laboratory of Big Data Intelligent Analysis and Application (Hubei University), Wuhan 430062, China · Key Laboratory of Intelligent Sensing System and Security (Hubei University), Ministry of Education, Wuhan 430062, China
MAVEN: A Multi-stage Agentic Annotation Pipeline for Video Reasoning Tasks
May 21, 2026Han Zhang, Wanting Jiang, Tomasz Kornuta +2VLM Adaptation Video Reasoning
NVIDIA
Thermo-VL: Extending Vision-Language Models to Thermal Infrared Perception
May 21, 2026Rusiru Thushara, Yasiru Ranasinghe, Jay Paranjape +1Thermal Imaging Visual Question Answering
Department of Electrical & Computer Engineering, Johns Hopkins University, Baltimore, MD 21218 USA
RISE: Reliable Improvement in Self-Evolving Vision-Language Models
May 20, 2026Chaoran Xu, Yingmao Miao, Pengfei Zhang +3Vision-Language Models VLM Adaptation
AMAP, Alibaba Group
MedExpMem: Adapting Experience Memory for Differential Diagnosis
May 20, 2026Qianhan Feng, Zhongzhen Huang, Yakun Zhu +4Radiology VLMs Healthcare
The Chinese University of Hong Kong · Shanghai Jiao Tong University · Shanghai Innovation Institue
FullFlow: Upgrading Text-to-Image Flow Matching Models for Bidirectional Vision--Language Generation
May 19, 2026Eric Tillmann Bill, Enis Simsar, Alessio Tonioni +1Flow Matching Image Captioning
ETH Zurich · Google
LaCoVL-FER: Landmark-Guided Contrastive Learning Network with Vision-Language Enhancement for Facial Expression Recognition
May 19, 2026Jiaxin Wang, Muwei Jian, Hui Yu +2VLM Adaptation Facial Expression Recognition
School of Airspace Science and Engineering, Shandong University, Weihai, China · School of Computer Science and Technology, Shandong University of Finance and Economics, Jinan, China · School of Psychology and Neuroscience, University of Glasgow, Glasgow, U.K. +1
PrAda: Few-Shot Visual Adaptation for Text-Prompted Segmentation
May 19, 2026Gabriele Rosi, Fabio Cermelli, Carlo Masone +1VLM Adaptation Text-Guided Image Segmentation
Politecnico di Torino · Focoos AI
Investigating Cross-Modal Skill Injection: Scenarios, Methods, and Hyperparameters
May 19, 2026Zhiyu Xu, Lean Wang, Yuanxin Liu +5VLM Adaptation Model Merging
State Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University · The University of Hong Kong · WeChat AI, Tencent Inc., China
iGSP:Implicit Gradient Subspace Projection for Efficient Continual Learning of Vision-Language Models
May 19, 2026Xuezhi Cui, Dongbo Zhou, Wang Guo +8Vision-Language Models VLM Adaptation
School of Geosciences and Info-Physics, Central South University, Changsha 410083, China · Faculty of Artifi cial Intelligence in Education in Central China Normal University, Wuhan 430079, China · School of Earth Sciences and Spatial Information Engineering, Hunan University of Science and Technology, Xiangtan 411201, China
Starve to Perceive: Taming Lazy Perception in VLMs with Constrained Visual Bandwidth
May 18, 2026Yuhuan Wu, Cong Wei, Fangzhen Lin +2Vision-Language Models VLM Adaptation
Hong Kong University of Science and Technology · University of Waterloo
VISAFF: Speaker-Centered Visual Affective Feature Learning for Emotion Recognition in Conversation
May 18, 2026Linan ZHU, Zihao Zhai, Xiao Han +4VLM Adaptation Emotion Recognition in Conversations
1Zhejiang University of Technology · 2ETH Zurich, Switzerland
PERL: Parameter Efficient Reasoning in CLIP Latent Space
May 18, 2026Simone Carnemolla, Salvatore Calcagno, Daniela Giordano +2VLM Adaptation Few-Shot Learning
University of Catania
Self-Evolving Spatial Reasoning in Vision Language Models via Geometric Logic Consistency
May 18, 2026Junming Liu, Yuqi Li, Yifei Sun +6VLM Robustness Vision-Language Models
Shanghai Artificial Intelligence Laboratory · The City University of New York · The Chinese University of Hong Kong +3
See What I Mean: Aligning Vision and Language Representations for Video Fine-grained Object Understanding
May 18, 2026Boyuan Sun, Bowen Yin, Yuanming Li +2Cross-Modal Learning Video Object Segmentation
VCIP, CS, Nankai University · Tongyi Lab, Alibaba Group · NKIARI, Shenzhen Futian
TAME: Test-Time Adversarial Prompt Tuning via Mixture-of-Experts for Vision-Language Models
May 17, 2026Xin Wang, Yixu Wang, Jiaming Zhang +6Adversarial Attacks on VLMs Test-Time Adaptation
Contrastive Conceptor Activation Steering (COAST): Unlocking Vision-Language-Action Models through Hidden States
May 16, 2026Miranda Muqing Miao, Subin Kim, Brandon Yang +1VLM Adaptation Vision-Language-Action Models
University of Pennsylvania
SHED: Style-Homogenized Embedding Alignment for Domain Generalization
May 16, 2026Kai Gan, Tong WeiVLM Robustness VLM Adaptation
School of Computer Science and Engineering, Southeast University, Nanjing 210096, China · Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, China
VLAMotor: Test-Guided Enhancement of Vision-Language-Action Models via Agent-BasedData Synthesis
May 16, 2026Zeqin Liao, Peifan Ren, Zixu Gao +6VLM Adaptation Synthetic Data Generation for Robotics
School of computing and data science, Nanyang Technological University · School of Software Engineering, Sun Yat-sen University, China and GuangDong Engineering Technology Research Center of Blockchain, China · Northwest A&F University
GeoWorld-VLM: Geometry from World Models for Vision-Language Models
May 15, 2026Renjie Gu, Kaichen Zhou, Yan Luo +1Visual Spatial Reasoning VLM Adaptation
Harvard AI and Robotics Lab · Kempner Institute for the Study of Natural and Artificial Intelligence · Harvard University
Res $^2$ CLIP: Few-Shot Generalist Anomaly Detection with Residual-to-Residual Alignment
May 15, 2026Xinyue Liu, Jianyuan Wang, Biao Leng +1Few-Shot Anomaly Detection VLM Adaptation
Beihang University · University of Science and Technology Beijing · Beijing Jiaotong University
Sparse Autoencoders enable Robust and Interpretable Fine-tuning of CLIP models
May 15, 2026Fabian Morelli, Arnas Uselis, Ankit Sonthalia +1Distribution Shift Robustness VLM Robustness
University of Tübingen ∗ · University of Tübingen
BiomedAP: A Vision-Informed Dual-Anchor Framework with Gated Cross-Modal Fusion for Robust Medical Vision-Language Adaptation
May 15, 2026Huanyang Tong, Kai Liu, Fangjun Kuang +1VLM Robustness Prompt Learning
Wenzhou University · Wenzhou Business College
Neutral-Reference Prompting for Vision-Language Models
May 15, 2026Senmao Tian, Xiang Wei, Shunli ZhangVision-Language Models VLM Adaptation
Beijing Jiaotong University, Beijing, China.
COPRA: Conditional Parameter Adaptation with Reinforcement Learning for Video Anomaly Detection
May 14, 2026Darryl Cherian Jacob, Xinyu Liu, Kai Wang +1VLM Adaptation Video Anomaly Detection
Auburn University · Tencent Hunyuan
PhysBrain 1.0 Technical Report
May 14, 2026Shijie Lian, Bin Yu, Xiaopeng Lin +10VLM Adaptation Vision-Language-Action Models

May 23, 2026, cs.CVJ/K move · Enter open · S save

EgoAdapt: A Multi-Scene Egocentric Adaptation Method for CVPR 2026 HD-EPIC VQA Challenge

Zhiwei Chen, Yupeng Hu, Zixu Li, Zhiheng Fu+3

Shandong University · Harbin Institute of Technology (Shenzhen)

Test-Time Adaptation VLM Adaptation Test-Time Adaptation of VLMs Egocentric Video QA Video QA Egocentric Video Understanding+1

Open paper AskPDF arXiv

This technical report presents our solution, EgoAdapt (Egocentric Adaptation via Category, Calibration, and Consistency), to the CVPR 2026 HD-EPIC VQA challenge. HD-EPIC evaluates whether a vision-language model can reason over realistic first-person kitchen videos, where the evidence for an answer may be a short hand-object interaction, a long recipe trajectory, a spatial relation to a fixture, or a subtle gaze cue. The benchmark contains 26K multiple-choice questions across seven macro-categories: recipe, ingredient, nutrition, fine-grained action, 3D perception, object motion, and gaze. We observe that the main difficulty is not only model capacity, but also the mismatch between a single generic inference recipe and the heterogeneous temporal, spatial, and semantic structure of the benchmark. Our method, EgoAdapt, introduces three inference-time components: (1) category-conditioned routing with per-category prompts, frame budgets, and sampling rates; (2) calibrated option scoring that evaluates all candidate answers with letter-token likelihoods and generation agreement instead of relying only on direct generation; and (3) test-time consistency adaptation that aggregates predictions across option permutations and verification-style prompts for ambiguous cases. This design substantially improves over the available HD-EPIC baselines.

Momentum

Related topics

Latest papers 395