Vision Foundation Model Adaptation

Ask about this topic

Overview

This field studies how to reuse pretrained vision models when target tasks, data, or sensors differ from their original training conditions. Common approaches include full or partial fine-tuning, parameter-efficient methods such as LoRA and prompt or adapter tuning, feature alignment, and distillation into smaller models. Applications range from medical and remote-sensing segmentation to video understanding, robotics, and 3D geometry, often with limited labels or shifted test data. A central tension is that adaptation can improve target-task accuracy while weakening robustness or transfer to unfamiliar settings, so efficiency and out-of-domain performance remain important evaluation criteria.

Latest papers

CardsList

328 papers33 papers in the last four weeks, up 22% on the four weeks before. 0.2% of all new papers.

  1. CUE: Concept-Aware Multi-Label Expansion to Mitigate Concept Confusion in Long-Tailed Learning

    May 2, 2026Ruichi Zhang, Chikai Shang, Jiacheng Yang +4Long-Tailed ClassificationLogit Adjustment

    Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, China · College of Computer Science and Software Engineering, Shenzhen University, China · Institute of High Performance Computing, A*STAR, Singapore

  2. REALM: An RGB- and Event-Aligned Latent Manifold for Cross-Modal Perception

    Apr 30, 2026Vincenzo Polizzi, David B. Lindell, Jonathan KellyMultimodal Foundation ModelsEvent-Based Vision

    University of Toronto, Robotics Institute · University of Toronto, Department of Computer Science

  3. Parameter-Efficient Adaptation of Pre-Trained Vision Foundation Models for Active and Passive Seismic Data Denoising

    Apr 30, 2026Jiahua Zhao, Umair bin Waheed, Jing Sun +3Test-Time AdaptationVision Foundation Model Adaptation

    Computation-based Science and Technology Research Center, The Cyprus Institute, Nicosia, Cyprus · Department of Geosciences, College of Petroleum Engineering and Geosciences, King Fahd University of Petroleum & Minerals, Dhahran, Saudi Arabia · Department of Intelligent Systems, Faculty of Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, Delft, Netherlands +2

  4. TAP into the Patch Tokens: Leveraging Vision Foundation Model Features for AI-Generated Image Detection

    Apr 29, 2026Ahmed Abdullah, Nikolas Ebert, Oliver WasenmüllerVision Foundation ModelsVision Foundation Model Adaptation

    Mannheim University of Applied Sciences, Germany

  5. Generalized Category Discovery under Domain Shifts: From Vision to Vision-Language Models

    Apr 29, 2026Hongjun Wang, Po Hu, Kai HanVLM AdaptationVision Foundation Model Adaptation

    School of Computing and Data Science, The University of Hong Kong

  6. Towards Robust Deep Learning-based Rumex Obtusifolius Detection from Drone Images

    Apr 28, 2026Fabian Dionys Schrag, Mehmet Ozgur Turkoglu, Konrad Schindler +1Unsupervised Domain AdaptationAgricultural Remote Sensing

    Agroscope NBA, Tänikon 1, Ettenhausen, 8356, TG, Switzerland · Agroscope Earth Observation of Agroecosystems Team, Reckenholz 191, Zurich, 8046, ZH, Switzerland · ETH Zurich, Stefano-Franscini-Platz 5, Zurich, 8093, ZH, Switzerland

  7. Dino-NestedUNet: Unlocking Foundation Vision Encoders for Pathology Tumor Bulk Segmentation via Dense Decoding

    Apr 27, 2026Tianyang Wang, Ziyu Su, Abdul Rehman Akbar +7Histopathology Image SegmentationU-Net

    Department of Pathology, College of Medicine, The Ohio State University Wexner Medical Center, Columbus, OH, USA · Department of Biomedical Engineering, The Ohio State University, Columbus, OH, USA

  8. Are Natural-Domain Foundation Models Effective for Accelerated Cardiac MRI Reconstruction?

    Apr 24, 2026Anam Hashmi, Mayug Maniparambil, Julia Dietlmeier +2Domain GeneralizationVision Foundation Model Adaptation

    1Dublin City University, Ireland · University College Dublin, Ireland

  9. Unlocking Optical Prior: Spectrum-Guided Knowledge Transfer for SAR Generalized Category Discovery

    Apr 24, 2026Jingyuan Xia, Ruikang Hu, Ye Li +3Domain AdaptationFrequency-Domain Feature Learning

    College of Electronic Science and Technology, National University of Defense Technology, Changsha, 410073, China · State Key Laboratory of Complex System Simulation and Modeling Technology, Beijing, 100091, China

  10. Amodal SAM: A Unified Amodal Segmentation Framework with Generalization

    Apr 22, 2026Bo Zhang, Zhuotao Tian, Xin Tao +3Vision Foundation Model AdaptationAmodal Segmentation

    Department of Computer Science, Harbin Institute of Technology at Shenzhen, Shenzhen 518057, China · Kuaishou Technology, Shenzhen, Guangdong, China

  11. Semantic-Fast-SAM: Efficient Semantic Segmenter

    Apr 22, 2026Byunghyun KimImage SegmentationVision Foundation Model Adaptation

    Kyungpook National University, Korea

  12. DINO Eats CLIP: Adapting Beyond Knowns for Open-set 3D Object Retrieval

    Apr 21, 2026Xinwei He, Yansong Zheng, Qianru Han +7Multi-View LearningVision Foundation Model Adaptation

    Huazhong Agricultural University · Huazhong University of Science and Technology · Shenzhen University

  13. Attend what matters: Leveraging vision foundational models for breast cancer classification using mammograms

    Apr 21, 2026Samyak Sanghvi, Piyush Miglani, Sarvesh Shashikumar +3Medical ImagingVision Foundation Model Adaptation

    Department of Computer Science and Engineering, IIT Delhi, New Delhi, India · Yardi School of AI, IIT Delhi, New Delhi, India · Department of Radiodiagnosis, PGIMER Chandigarh, Chandigarh, India

  14. Multi-Domain Learning with Global Expert Mapping

    Apr 20, 2026Pourya Shamsolmoali, Masoumeh Zareapoor, Huiyu Zhou +3Vision Foundation Model AdaptationExpert Routing

    Department of Computer Science, University of York, UK · School of Computing and Mathematical Sciences, University of Leicester, UK · Centre for Vision Speech and Signal Processing, University of Surrey, UK +2

  15. Feasibility of Indoor Frame-Wise Lidar Semantic Segmentation via Distillation from Visual Foundation Model

    Apr 20, 2026Haiyang Wu, Juan J. Gonzales Torres, George Vosselman +1Cross-Modal Knowledge DistillationVision Foundation Model Adaptation

    Department of Earth Observation Science, Faculty of Geo-Information Science and Earth Observation (ITC), University of Twente, 7522 NB Enschede, The Netherlands

  16. Spike-NVPT: Learning Robust Visual Prompts via Bio-Inspired Temporal Filtering and Discretization

    Apr 20, 2026Qiugang Zhan, Anning Jiang, Ran Tao +4Vision Foundation Model AdaptationVisual Prompt Learning

    Complex Laboratory of New Finance and Economics, Southwestern University of Finance and Economics · Engineering Research Center of Intelligent Finance, Ministry of Education · School of Computer Science and Engineering, 4Laboratory of Intelligent Collaborative Computing, University of Electronic Science and Technology of China +3

  17. Sharpening Lightweight Models for Generalized Polyp Segmentation: A Boundary Guided Distillation from Foundation Models

    Apr 20, 2026Shivanshu Agnihotri, Snehashis Majhi, Deepak Ranjan NayakImage SegmentationVision Foundation Model Adaptation

    Dept. of Computer Science and Engineering Malaviya National Institute of Technology Jaipur, India

  18. R-FLoRA: Residual-Statistic-Gated Low-Rank Adaptation for Single-Image Face Morphing Attack Detection

    Apr 19, 2026Raghavendra RamachandraImage Forgery DetectionVision Foundation Model Adaptation

    SAFE Center, Department of Information Security and Communication Technology, Norwegian University of Science and Technology (NTNU), Norway

  19. Adaptive Forensic Feature Refinement via Intrinsic Importance Perception

    Apr 18, 2026Jiazhen Yang, Junjun Zheng, Kejia Chen +5Image Forgery DetectionVision Foundation Model Adaptation

    Zhejiang University Hangzhou, China · Alibaba Inc Hangzhou, China · Zhejiang University of Technology Hangzhou, China

  20. Frozen Vision Transformers for Dense Prediction on Small Datasets: A Case Study in Arrow Localization

    Apr 18, 2026Maxwell ShepherdVision Foundation Model Adaptation

  21. A Benchmark Study of Segmentation Models and Adaptation Strategies for Landslide Detection from Satellite Imagery

    Apr 17, 2026Md Kowsher, Weiwei Zhan, Chen ChenRemote Sensing Image SegmentationVision Foundation Model Adaptation

    University of Central Florida

  22. DINOv3 Beats Specialized Detectors: A Simple Foundation Model Baseline for Image Forensics

    Apr 17, 2026Jieming Yu, Qiuxiao Feng, Zhuohan Wang +1Image Forgery DetectionDigital Image Forensics

    The Hong Kong University of Science and Technology · Harvard University

  23. AdaVFM: Adaptive Vision Foundation Models for Edge Intelligence via LLM-Guided Execution

    Apr 17, 2026Yiwei Zhao, Yi Zheng, Huapeng Su +9Vision Foundation ModelsVision Foundation Model Adaptation

    Carnegie Mellon University · Meta

  24. Robustness of Vision Foundation Models to Common Perturbations

    Apr 16, 2026Hongbin Liu, Zhengyuan Jiang, Cheng Hong +1Image Corruption RobustnessVision Foundation Models

    Duke University · Ant Group

  25. WILD-SAM: Phase-Aware Expert Adaptation of SAM for Landslide Detection in Wrapped InSAR Interferograms

    Apr 16, 2026Yucheng Pan, Heping Li, Zhangle Liu +2Remote Sensing Image SegmentationVision Foundation Model Adaptation

    School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China · Hubei Luojia Laboratory, Wuhan 430079, China

  26. Parameter Efficient Fine-tuning for Domain-specific Gastrointestinal Disease Recognition

    Apr 12, 2026Sanjaya Poudel, Nikita Kunwor, Raj Simkhada +3Vision Foundation Model AdaptationMedical Diagnosis

    Auburn University · Tribhuvan University · The University of Texas at Austin +2

  27. FishRoPE: Projective Rotary Position Embeddings for Omnidirectional Visual Perception

    Apr 12, 2026Rahul Ahuja, Mudit Jain, Bala Murali Manoghar Sai Sudhakar +4Rotary Positional EmbeddingsVision Foundation Model Adaptation

    Automated Driving, Qualcomm Technologies, Inc · Automated Driving, Qualcomm India Private Limited

  28. Off-the-shelf Vision Models Benefit Image Manipulation Localization

    Apr 10, 2026Zhengxuan Zhang, Keji Song, Junmin Hu +2Image Forgery LocalizationVision Foundation Model Adaptation

    School of Computer Science and Technology, Ocean University of China · Southwest Jiaotong University

  29. PanoSAM2: Lightweight Distortion- and Memory-aware Adaptions of SAM2 for 360 Video Object Segmentation

    Apr 9, 2026Dingwen Xiao, Weiming Zhang, Shiqi Wen +1Video Object SegmentationVision Foundation Model Adaptation

    The Hong Kong University of Science and Technology (Guangzhou) · Nanyang Technological University

  30. DINO-QPM: Adapting Visual Foundation Models for Globally Interpretable Image Classification

    Apr 8, 2026Robert Zimmermann, Thomas Norrenbrock, Bodo RosenhahnExplainable Image ClassificationVision Foundation Model Adaptation

    Institute for Information Processing, L3S - Leibniz University Hannover