Vision-Language Model Adaptation

Follow this topic Ask about this topic

Recent momentum

-40%

9 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Vision-Language Model Adaptation.

Period ending 2026-09-07

5 new papers

A weekly snapshot of new work published in Vision-Language Model Adaptation.

86 papers

Latest in Vision-Language Model Adaptation

Open your feed →

Dense to MoE Adaptation for Compact Vision Language Action Policies
Sep 15, 2026Muchun Niu, Shuang Chen, Yuzhou Wu +1Vision-Language Model Adaptation
VPRef: A Cross-Domain Benchmark for Referring Remote Sensing Image Segmentation
Sep 15, 2026Quanwei Liu, Tao Huang, Jiaqi Yang +1Remote Sensing Image Segmentation Vision-Language Model Adaptation
Learning to Adapt and Calibrate: Score Distribution Alignment for Few-Shot Uncertainty Prediction in Medical VLMs
Sep 9, 2026Xuan Cuong Ngo, Ngan LeFew-Shot Learning Vision-Language Model Adaptation
On-Policy Distillation for Vision-Language Model Adaptation, an Effective Paradigm on Low-Quality Multimodal Data
Sep 9, 2026Hongyuan Zhang, Xianda Guo, Yanlun Peng +6Vision-Language Model Adaptation On-Policy Distillation
To Adapt or Not to Adapt? Selective Adaptation for Vision-Language Models
Sep 8, 2026Siru Jiang, Yuwei Liang, Jian Liang +2Vision-Language Model Adaptation Test-Time Adaptation
Test-Time Logit Prompting for Source-Free Missing Modality Adaptation
Sep 2, 2026Taixi Chen, Nancy GuoVision-Language Model Adaptation Logit Lens
DESA-TTA: Dynamic EMA and Source Anchoring for Test-Time Adaptation
Sep 1, 2026Atif Belal, Lilian Hollard, Marco Pedersoli +1Test-Time Adaptation Vision-Language Model Adaptation
Vision-Language-Guided Pseudo-Labels for Unsupervised Domain Adaptation in Semantic Segmentation for Waste Sorting
Sep 1, 2026Udo Schlegel, Shubhangi, Gabriel Dax +3Pseudo-Labeling Unsupervised Domain Adaptation
Text Capability Loss in Vision-Language Adaptation: An Attention-Sink Diagnosis
Sep 1, 2026Minsik Choi, Geewook Kim, Young Geun KimVision-Language Model Adaptation Vision-Language Reasoning
Seeing the Unseen: Visual Similarity for Pixel Language Model Adaptation
Aug 31, 2026Ran Zhang, Miryam de Lhoneux, Wessel PoelmanCross-Lingual Transfer Vision-Language Model Adaptation
Towards Continual Test-Time Adaptation of Vision-Language Models in Open-Vocabulary Semantic Segmentation
Aug 30, 2026Chandler Timm C. Doloriel, Yunbei Zhang, Sarthak Kumar Maharana +5Vision-Language Model Adaptation Vision-Language Alignment
TD-VAD: Breaking Visual Dependence in Video Anomaly Detection with Text-Driven Learning
Aug 12, 2026Shuangqing Zhang, Lei-Lei Ma, Zhao Wang +5Video Anomaly Detection Vision-Language Model Adaptation
VANE: Reliable Test-Time Training for Vision-Language-Action Models via Future Visual Representation Prediction
Aug 10, 2026Hongjin Ji, Guoyang Xia, Luoyang Sun +2Vision-Language-Action Vision-Language Model Adaptation
Triple Expert Learning from Noisy Labels for Semi-Supervised Vision Foundation Model Adaptation
Aug 10, 2026Xuanyu Liu, Zheng Fang, Hongyang He +2Vision-Language Model Adaptation Noisy Labels
MuST-VAD: Mutual Structured Learning for Video Anomaly Detection
Aug 7, 2026Satoshi Hashimoto, Hitoshi Nishimura, Mori KurokawaVideo Anomaly Detection Vision-Language Model Adaptation
When Semantics Saturate or Emerge: Adaptation-Conditional Semantic Utility in Source-Free Cross-Domain Few-Shot Learning
Aug 7, 2026Wei Liu, Xing Deng, Haijian ShaoFew-Shot Learning Vision-Language Model Adaptation
DARAD: Dual Adapters and Ranking-Aware Distillation for Continual Remote Sensing Image-Text Retrieval
Aug 6, 2026Xi Chen, Xu Chen, Xiangyang Jia +3Remote Sensing Cross-Modal Knowledge Distillation
Adapting Vision Foundation Models with Cascaded Semantics
Aug 5, 2026Xi Xiao, Xingjian Li, Cheng Han +8Vision-Language Model Adaptation Self-Supervised Vision Transformers
On the Effectiveness of Adaptation Strategies for VLM-Based Federated Learning in Remote Sensing
Aug 5, 2026Simon Lösche, Barış Büyüktaş, Mathis Adler +3Federated Fine-Tuning Vision-Language Model Adaptation
COSMO: Consensus-Driven Shift Modulation for Source-Free Domain Adaptation
Aug 5, 2026Bo Li, Junjie Peng, Xiaohua Xie +1Unsupervised Domain Adaptation Vision-Language Model Adaptation
MuRA: Multi-Rank Adaptation for Efficient and Effective Test-Time Vision-Language Generalization
Aug 4, 2026Gengyuan Liu, Nanzhou Wang, Chang Liu +5Vision-Language Model Adaptation Adaptive-Rank Low-Rank Adaptation Baselines
Local Margin Restoration for Test-Time Adaptation of Vision-Language Models
Aug 3, 2026Yan Huang, Guowei Wang, Xu Wang +2Vision-Language Model Adaptation Test-Time Adaptation
Visual Distribution Anchoring for Efficient Prompt Tuning
Jul 31, 2026Pouya Parsa, Raoof Zare Moayedi, Seongjin ChoiVision-Language Model Adaptation Soft Prompt Tuning
Test-Time Adaptation via Dual Distillation for Videos Under Severe Distribution Shifts
Jul 27, 2026André Sacilotti, Samuel Felipe dos Santos, Jurandy AlmeidaTest-Time Adaptation Vision-Language Model Adaptation
Continual Video-MLLM Adaptation over Evolving Domains
Jul 21, 2026Rui Cheng, Meixing Shi, Yuxiang Cai +3Vision-Language Model Adaptation Domain Adaptation
PRiSM: Prototype Regularization for Few-Shot VLMs
Jul 20, 2026Ghassen Baklouti, Omprakash Chakraborty, Jose Dolz +1Few-Shot Learning Vision-Language Model Adaptation
Can Experts Adapt Without Training? On Test-Time Modality Generalization in MVLMs
Jul 18, 2026Raza Imam, Darakshan Rashid, Yutong Xie +3Vision-Language Model Adaptation Medical Vision-Language Models
An Empirical Analysis of Continual Learning for Heterogeneous Medical Visual Question Answering
Jul 13, 2026Mai A. Shaaban, Tausifa Jan Saleem, Alaa Mohamed +3Medical Visual Question Answering Efficient Continual Learning
TCLA: Training-Free Class-wise Logit Adaptation for Medical Vision-Language Models
Jul 10, 2026Tianyou Jiang, Ziyu ZhouVision-Language Model Adaptation Medical Vision-Language Models
Robustifying Vision-Language Models via Test-Time Prompt Adaptation
Jul 10, 2026Xingyu Zhu, Huanshen Wu, Shuo Wang +4Vision-Language Model Adaptation Adversarial Transferability
Parameter-Efficient Vision-Language Adaptation with Continuous Metadata Conditioning for Animal Re-Identification
Jul 10, 2026Anil Osman Tur, Tonje Knutsen Sordalen, Kim Tallaksen Halvorsen +1Animal Re-Identification Vision-Language Model Adaptation
R^3: Advertisement Compliance Rectification via Group-Relative Experience Extractor and Curriculum Reinforcement
Jul 8, 2026Yuan Chen, Zhenyu Hu, Mengge Xue +5Rectification Content Moderation
Comparative Study of Domain-adapted VLMs for General Document Visual Question Answering
Jul 8, 2026Miguel Lopez-Duran, Elena Marrero, Julian Fierrez +8Knowledge-Based Visual Question Answering Vision-Language Model Adaptation
LoCA: Spatially-Aware Low-Rank Convolutional Adaptation of Vision Foundation Models
Jul 8, 2026Sojung An, Junha Lee, Sujeong You +2Parameter-Efficient Fine-Tuning Methods Vision-Language Model Adaptation
MonoIR-RS: Infrared Remote Sensing Vision-Language Learning with CLIP and VLM Adaptation
Jul 7, 2026Jiaju Han, Ma Yaqi, Yahui Chai +8Infrared Remote Sensing
PolicyShiftGuard: Benchmarking and Improving Policy-Adaptive Image Guardrails
Jul 7, 2026Mingyang Song, Luxin Xu, Haoyu Sun +3Streaming Guardrails Guardrail
Cross-Contextual Vision-Language Adaptation with LoRA for Personalized Severe Adverse Event Detection in Clinical Wound Monitoring
Jul 6, 2026Aditi Naiknaware, Jian Sun, Aminreza Khandan +4Multimodal Wound Analysis Medical Vision-Language Models
CL-Anomaly: Layer-Adaptive Mixture-of-Experts with Multimodal Large Language Model for Continual Learning in Anomaly Detection
Jul 3, 2026Wen Dong, Zhao Wang, Shuangqing Zhang +5Efficient Continual Learning Anomaly Detection
AnyGroundBench: A Specialized-Domain Benchmark for Video Grounding in Vision-Language Models
Jul 2, 2026Rintaro Otsubo, Ryo Fujii, Reina Ishikawa +6Video Temporal Grounding Vision-Language Model Adaptation
Domain Arithmetic: One-Shot VLA Adaptation under Environmental Shifts
Jul 1, 2026Taewook Kang, Taeheon Kim, Donghyun Shin +1Vision-Language Model Adaptation Diffusion-Based Vision-Language-Actions
DroneFINE: Domain-Aware Parameter-Efficient Fine-Tuning of Vision-Language Detectors for Drone Images
Jul 1, 2026Ke Wu, Yanan Zhang, Yingjie Gao +5Vision-Language Model Adaptation Drone
ComMem: Complementary Memory Systems for Test-Time Adaptation of Vision-Language Models
Jun 27, 2026Guanglong Sun, Shuang Cui, Bo Lei +6Vision-Language Model Adaptation Test-Time Adaptation
ROAD-VLA: Robust Online Adaptation via Self-Distillation for Vision-Language-Action Models
Jun 24, 2026Kejing Wang, Toan Nguyen, Minh Hoang Nguyen +2Diffusion-Based Vision-Language-Actions Vision-Language-Action
TACO: Towards Task-Consistent Open-Vocabulary Adaptation in Video Recognition
Jun 24, 2026Minghao Zhu, Xiao Lin, Mengxian Hu +5Vision-Language Model Adaptation Taco
Towards Fast and Effective Long Video Understanding of Multimodal Large Language Models via Adaptive Quasi-Gaussian Sampling
Jun 23, 2026Kun Zhang, Chenxin Fang, Tao Chen +4Video Understanding Keyframe
CADRE: Stable, Parameter Efficient Adaptation of Medical Vision Language Models with Bounded Forgetting and Prior Drift
Jun 22, 2026Amrita Singh, Rishabh JhaVision-Language Model Adaptation Medical Vision-Language Models
T-VSS: Test-Time Visual Subspace Steering for Adversarial Robustness of Vision-Language Models
Jun 22, 2026Jaehyuk Jang, Minseok Seo. Seungju Cho, Kangwook Ko +1Vision-Language Model Adaptation Test-Time Adaptation
Concept Alignment Contrast and Long-Short Prompt Memory for Test-Time Adaptation of SAM3 in Medical Image Segmentation
Jun 22, 2026Yubo Zhou, Jianghao Wu, Ping Ye +2Medical Image Segmentation Medical Vision-Language Models
What Drives Test-Time Adaptation for CLIP? A Controlled Empirical Study from an Update Perspective
Jun 12, 2026Jiazhen Huang, Xiao Chen, Zhiming Liu +3Test-Time Adaptation Vision-Language Model Adaptation
One Stone, Three Birds: Self-adaptive Optimal Transport for Multi-VLM Selection, Adaptation, and Ensembling
Jun 6, 2026Qiyu Xu, Zhanxuan Hu, Yu Duan +4Vision-Language Model Adaptation Recent Vision-Language Models
SS-TPT: Stability and Suitability-Guided Test-Time Prompt Tuning for Adversarially Robust Vision-Language Models
Jun 5, 2026Sunoh Kim, Daeho UmVision-Language Model Adaptation Test-Time Adaptation
Who Needs Labels? Adapting Vision Foundation Models With the Metadata You Already Have
Jun 3, 2026Elouan Gardès, Seung Eun Yi, Kartik Ahuja +6Vision-Language Model Adaptation Recent Vision Foundation Models
ProtoAda: Prototype-Guided Adaptive Adapter Expansion and Geometric Consolidation for Multimodal Continual Instruction Tuning
Jun 1, 2026Yu-Cheng Shi, Zhen-Hao Xie, Jun-Tao Tang +1Multimodal Instruction Tuning Vision-Language Model Adaptation
Beyond Classification: Dynamic Adapter Routing for Continual Multimodal Retrieval
May 29, 2026Alicja Dobrzeniecka, Filip Szatkowski, Sebastian Cygert +2Multimodal Retrieval Vision-Language Model Adaptation
Improving CLIP Adaptation by Breaking Tail Alignment for Source-Free Cross-Domain Few-Shot Learning
May 28, 2026Shuai Yi, Yixiong Zou, Yuhua Li +1Vision-Language Model Adaptation Few-Shot Learning
EVIDENT: Routing MLLM Adaptation through Entity-Grounded Visual Evidence for Cross-Domain Video Temporal Grounding
May 25, 2026Geo Ahn, Jiwook Han, Youngrae Kim +2Video Temporal Grounding Temporal Grounding
Addressing Exacerbated Attention Sink for Source-Free Cross-Domain Few-Shot Learning
May 25, 2026Shuai Yi, Yixiong Zou, Yuhua Li +1Vision-Language Model Adaptation Few-Shot Learning
Turning Adaptation into Assets: Cross-Domain Bridging for Online Vision-Language Navigation
May 22, 2026Zixuan Hu, Xuantuo Huang, Yancheng Li +3Vision-Language Model Adaptation Vision-And-Language Navigation
HyLoVQA: Dynamic Hypernetwork-Generated Low-Rank Adaptation for Continual Visual Question Answering
May 21, 2026Yiran Wang, Chenyi Xiong, Ziyue Qin +3Vision-Language Model Adaptation Knowledge-Based Visual Question Answering
Towards Fine-Grained Robustness: Attention-Guided Test-Time Prompt Tuning for Vision-Language Models
May 19, 2026Jia-Wei Hai, Yijun Wang, Xiu-Shen WeiVision-Language Model Adaptation Test-Time Adaptation

Sep 15, 2026 · cs.ROJ/K move · Enter open · S save

Dense to MoE Adaptation for Compact Vision Language Action Policies

Muchun Niu, Shuang Chen, Yuzhou Wu, Linfeng Zhang

Vision language action (VLA) policies continue to grow in parameter count, making deployment on resource-constrained robot platforms difficult. The central goal is to reduce the number of LLM-side parameters retained in the deployed policy while preserving downstream task performance. Our approach, AdaDE, adapts selected dense feed forward blocks into mixture of experts (MoE) layers and derives expert retention masks from router statistics during fine tuning. The Dense2MoE conversion preserves the original dense FFN function at initialization, so expert deactivation can start without a separate recovery stage. Instead of using a fixed shutdown rule, expert masks are updated dynamically from router usage statistics, with staged training and expert protection to avoid early collapse. With 40% of the LLM parameters deactivated, AdaDE retains 95.1% average success in LIBERO and 42.0% average success across all 50 RobotWin2.0 tasks. These results suggest that dense to MoE adaptation with dynamic expert deactivation is a practical direction for reducing active VLA model size without severe performance loss.

Vision-Language Model Adaptation

Open paper Ask about it PDF