VLM Adaptation

VLM: Vision-Language Model

Ask about this topic

Momentum

34 papers in the last four weeks, up 209% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 395

All topics
CardsList

  1. DARAD: Dual Adapters and Ranking-Aware Distillation for Continual Remote Sensing Image-Text Retrieval

    Aug 6, 2026Xi Chen, Xu Chen, Xiangyang Jia +3VLM AdaptationImage-Text Retrieval

    School of Computer Science, Wuhan University, Wuhan 430072, China · Beijing Institute for General Artificial Intelligence (BIGAI)

  2. Respect Your Zero-Shot Uncertainty: Conservative Calibration for Test-Time-Adapted Vision-Language Models

    Aug 6, 2026Jingyan Jiang, Yaru Sun, Xiao Chen +5VLM AdaptationTest-Time Adaptation of VLMs

    1Shenzhen Technology University · 3Shenzhen University · 2Tsinghua University +1

  3. SciQNet: Two-Stage Multimodal Adaptation for Scientific Image Quality Assessment

    Aug 6, 2026Yin-Loon Khor, Yi-Jie Wong, Jing Jie Tan +1VLM AdaptationMultimodal Pretraining

    Universiti Malaya · Universiti Tunku Abdul Rahman · National University of Singapore

  4. On the Effectiveness of Adaptation Strategies for VLM-Based Federated Learning in Remote Sensing

    Aug 5, 2026Simon Lösche, Barış Büyüktaş, Mathis Adler +3Remote Sensing Image UnderstandingPrompt Learning

    BIFOLD - Berlin Institute for the Foundations of Learning and Data, 10587 Berlin, Germany · Technische Universität Berlin, 10623 Berlin, Germany · Orion Lab, School of Rural, Surveying and Geoinformatics Engineering, National Technical University of Athens, 15772 Athens, Greece +2

  5. COSMO: Consensus-Driven Shift Modulation for Source-Free Domain Adaptation

    Aug 5, 2026Bo Li, Junjie Peng, Xiaohua Xie +1Source-Free Domain AdaptationVLM Adaptation

    School of Computer Science and Engineering, Sun Yat-sen University

  6. GeoReward: Mitigating Contextual Variable Overestimation in Vision-Language Models for Cross-Market Preference Prediction

    Aug 5, 2026Shuo Liu, Huixiang Cai, Weiru Zhang +1Vision-Language ModelsVLM Adaptation

    Alibaba International Digital Commerce Group

  7. MuRA: Multi-Rank Adaptation for Efficient and Effective Test-Time Vision-Language Generalization

    Aug 4, 2026Gengyuan Liu, Nanzhou Wang, Chang Liu +5Vision-Language ModelsVLM Adaptation

    Tsinghua University Shenzhen, China · Tsinghua University Beijing, China · Huazhong University of Science and Technology Wuhan, China +1

  8. Enhancing VLM Reward Models Through Structure-Aware Fine-Tuning

    Aug 4, 2026Pyrros Koussios, Chenhao Li, Xin Chen +1Self-Supervised LearningVLM Adaptation

    ETH Zürich

  9. SeCo-SBIR: Semantically Consistent Prompt Learning for Zero-Shot Sketch-Based Image Retrieval

    Aug 4, 2026Long Hoang Dang, Tuan Nguyen Huu, Nguyen Minh Hieu +1VLM AdaptationCross-Modal Retrieval

    Posts and Telecommunications Institute of Technology Ha Noi, Vietnam

  10. In-Context Collapse in Vision-Language Models and How to Mitigate it?

    Aug 3, 2026Mohammad RostamiVLM RobustnessVision-Language Models

    Amazon Generative AI Innovation Center∗, USA.

  11. Local Margin Restoration for Test-Time Adaptation of Vision-Language Models

    Aug 3, 2026Yan Huang, Guowei Wang, Xu Wang +2VLM RobustnessTest-Time Adaptation

    Guangzhou University Guangzhou, China · The Second Affiliated Hospital of Guangzhou University of Chinese Medicine Guangzhou, China · Jinan University Zhuhai, China +1

  12. HAFI-VLM: A Frequency Perspective for Diagnosing and Enhancing Visual Perception in Vision-Language Models

    Aug 3, 2026Jin Cui, Chuanchang Su, Jiayi Lu +3Visual Question AnsweringVLM Robustness

    1State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · School of Computer Science and Technology, Xi’an Jiaotong University · School of Software Engineering, Xi’an Jiaotong University

  13. Same Semantics, Different Paths: Self-Improving Alignment for Vision-Text Compression

    Aug 3, 2026Tianyu Liang, Xiangxi Zheng, Yilin Wang +1VLM AdaptationMultimodal Token Compression

    Southeast University Nanjing, China · Nanjing University Nanjing, China · Zhejiang University Hangzhou, China +1

  14. Mechanistic Interpretability-Guided Selective Fine-Tuning of Vision-Language Models for Centimeter-Level Flood Depth Estimation

    Aug 2, 2026Nafis Fuad, Xiaodong Qian, Dongxiao ZhuVLM AdaptationDepth Estimation

    Department of Civil & Environmental Engineering Wayne State University Detroit, MI, USA · Department of Civil & Environmental Engineering Institute for AI and Data Science (AIDaS) Wayne State University Detroit, MI, USA · Department of Computer Science, Institute for AI and Data Science (AIDaS) Wayne State University Detroit, MI, USA

  15. PixVL: Self-Supervised Training of Pixel-Level MLLMs via a Unified Mask--Text Consistency Cycle

    Aug 2, 2026Yicheng Xiao, Haoxuan Ma, Caorui Li +7Self-Supervised LearningVLM Adaptation

    Institute of Automation, Chinese Academy of Sciences · Nanjing University · Southeast University +3

  16. VFAD: Variational Semantic Prompting Meets Frequency-Adaptive Representation Learning for Zero-Shot Anomaly Detection

    Jul 31, 2026Peng Chen, Kaige Li, Wei Wang +5VLM AdaptationFrequency-Domain Feature Learning

    School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University, Shenzhen, China

  17. Visual Distribution Anchoring for Efficient Prompt Tuning

    Jul 31, 2026Pouya Parsa, Raoof Zare Moayedi, Seongjin ChoiSource-Free Domain AdaptationDomain Adaptation

    University of Minnesota USA

  18. Anatomy Contextualized Adaption of CT Foundation Models

    Jul 29, 2026Roshan Kenia, Stephanie L McNamara, William LotterMedical Imaging Foundation ModelsVLM Adaptation

    Department of Biomedical Informatics, Harvard Medical School, Boston, MA · Department of Data Science, Dana-Farber Cancer Institute, Boston, MA · Department of Radiology, Massachusetts General Hospital, Boston, MA +2

  19. Decoupled Visual Processing: Efficient Multimodal Adaptation via Modality-Specific Transformer Substitution

    Jul 29, 2026Mingkuan Feng, Zhengqi Wen, Jianhua TaoVLM AdaptationLarge Vision-Language Models

    Tsinghua University · Beijing National Research Center for Information Science and Technology

  20. The Visual Bottleneck: Sparse-Frame Adaptation of MLLMs for Joint Spatial-Temporal Video Grounding

    Jul 27, 2026Jiameng Zhang, Srikanth MadikeriTemporal Video GroundingVLM Adaptation

    University of Zurich

  21. Rethinking Expert Training for Model Merging with Prompt Learning

    Jul 27, 2026Christos Georgakilas, Aniello Panariello, Samir El Karrat Moreno +3VLM AdaptationMulti-Task Learning

    Computer Vision Center, Barcelona, Spain · Universitat Aut`onoma de Barcelona, Barcelona, Spain · AImageLab, University of Modena and Reggio Emilia, Italy

  22. IJCB-AFMFR 2026: Competition on Adapting Foundation Models for Face Recognition Using Synthetic Training Data

    Jul 27, 2026Tahar Chettaoui, Guray Ozgur, Eduarda Caldeira +13VLM AdaptationVision Foundation Model Adaptation

    Fraunhofer Institute for Computer Graphics Research IGD, Germany · Technical University of Darmstadt, Germany · Vilnius University, Lithuania +5

  23. Are Prompt Optimizers Blind? Cross-Modal Visual Feedback for Automatic Prompt Optimization

    Jul 27, 2026Haoyue Liu, Xiaoyu Ma, Ye Chen +2Visual Question AnsweringVLM Adaptation

    The Chinese University of Hong Kong, Shenzhen, China · Xi’an Jiaotong University, China · Peking University, China +1

  24. The Gate Always Closes: On Injecting Auxiliary Signals into Frozen Vision-Language Models

    Jul 25, 2026Moshiur Farazi, Sameera Ramasinghe, Bekir Sait Ciftler +2VLM AdaptationVisual Reasoning

    University of Doha for Science and Technology, Doha, Qatar · Pluralis Research, Australia · North South University, Dhaka, Bangladesh

  25. What CLIP Knows but Cannot Say: Recovering Negation from Frozen Intermediate Features

    Jul 25, 2026Chen-Yi Lu, Yueh-Shao Chen, Somali ChaterjiVision-Language ModelsVLM Adaptation

    Purdue University, West Lafayette, IN 47907, USA

  26. Self-Boosting Vision-Language Models with Noisy Student On-Policy Self-Distillation

    Jul 25, 2026Shuai Wang, Daoan Zhang, Zhe Tang +2VLM AdaptationOn-Policy Self-Distillation

    The Hong Kong University of Science and Technology (Guangzhou) · University of Rochester · Zhejiang University of Technology +1

  27. Filling Before Advancing: Capability-Gap-Driven Post-Training for Scenario-Specialized Remote Sensing MLLMs

    Jul 24, 2026Yuheng Zong, Minghua Wang, Xin Zhao +3Remote Sensing Image UnderstandingFine-Tuning

    The Institute of Robotics and Automatic Information System (IRAIS), the Tianjin Key Laboratory of Intelligent Robotics (tjKLIR), Nankai University, Tianjin 300071, China · The College of Artificial Intelligence, Nankai University, Tianjin 300071, China · Hyperspectral Computing Laboratory, Department of Technology of Computers and Communications, Escuela Politécnica, University of Extremadura, Cáceres, Spain +1

  28. Towards Privacy-Preserving Federated Prompt Tuning under Data Heterogeneity: A Subspace-Decomposed Expert Approach

    Jul 23, 2026Yuhua Wang, Xiaodong Li, Yihao Guo +6VLM AdaptationDifferentially Private Federated Learning

    School of Artificial Intelligence, Beihang University Beijing, China · Center for the Applied Statistics, School of Statistics, Renmin University of China Beijing, China · School of Computer Science & Technology, Beijing Jiaotong University Beijing, China +2

  29. DINOde: Continuous Vision-Text Alignment for Open-Vocabulary Semantic Segmentation

    Jul 23, 2026Sung-Hoon Yoon, Hoyong Kwon, Changgyoon Oh +1VLM AdaptationOpen-Vocabulary Semantic Segmentation

    Multimodal Intelligence and Perception Lab., DGIST, Republic of Korea · Visual Intelligence Lab., KAIST, Republic of Korea

  30. Test-Time Training for Modality Order Consistency in Vision-Language Models

    Jul 22, 2026Aditi Gupta, Yossi GandelsmanVLM RobustnessVLM Adaptation

    University of Chicago · Reve