Vision Foundation Model Adaptation

Overview

This field studies how to reuse pretrained vision models when target tasks, data, or sensors differ from their original training conditions. Common approaches include full or partial fine-tuning, parameter-efficient methods such as LoRA and prompt or adapter tuning, feature alignment, and distillation into smaller models. Applications range from medical and remote-sensing segmentation to video understanding, robotics, and 3D geometry, often with limited labels or shifted test data. A central tension is that adaptation can improve target-task accuracy while weakening robustness or transfer to unfamiliar settings, so efficiency and out-of-domain performance remain important evaluation criteria.

Latest papers

CardsList

328 papers33 papers in the last four weeks, up 22% on the four weeks before. 0.2% of all new papers.

  1. Visual prompting reimagined: The power of the Activation Prompts

    Apr 7, 2026Yihua Zhang, Hongkang Li, Yuguang Yao +5Visual Prompt LearningVision Foundation Model Adaptation

  2. Continual Visual Anomaly Detection on the Edge: Benchmark and Efficient Solutions

    Apr 7, 2026Manuel Barusco, Francesco Borsatti, David Petrovic +2Anomaly DetectionEdge Inference

  3. Leveraging Image Editing Foundation Models for Data-Efficient CT Metal Artifact Reduction

    Apr 7, 2026Ahmet Rasim Emirdagi, Süleyman Aslan, Mısra Yavuz +5Computed TomographyImage Reconstruction

  4. TAPE: A two-stage parameter-efficient adaptation framework for foundation models in OCT-OCTA analysis

    Apr 6, 2026Xiaofei Su, Zengshuo Wang, Minghe Sun +2Vision Foundation Model AdaptationMedical Image Segmentation

  5. Parameter-Efficient Semantic Augmentation for Enhancing Open-Vocabulary Object Detection

    Apr 6, 2026Weihao Cao, Runqi Wang, Xiaoyue Duan +3Open-Vocabulary Object DetectionVision Foundation Model Adaptation

  6. Automated Segmentation and Tracking of Group Housed Pigs Using Foundation Models

    Apr 3, 2026Ye Bi, Bimala Acharya, David Rosero +1Precision Livestock FarmingMulti-Object Tracking

  7. SD-FSMIS: Adapting Stable Diffusion for Few-Shot Medical Image Segmentation

    Apr 3, 2026Meihua Li, Yang Zhang, Weizhao He +2Diffusion Models for Medical Image SegmentationFew-Shot Medical Image Segmentation

  8. Smart Transfer: Leveraging Vision Foundation Model for Rapid Building Damage Mapping with Post-Earthquake VHR Imagery

    Apr 3, 2026Hao Li, Liwei Zou, Wenping Yin +4Disaster Damage AssessmentBuilding Damage Assessment

  9. Test-Time Adaptation for Height Completion via Self-Supervised ViT Features and Monocular Foundation Models

    Apr 2, 2026Osher Rafaeli, Tal Svoray, Ariel Nahlieli3D ReconstructionRemote Sensing

  10. Mine-JEPA: In-Domain Self-Supervised Learning for Mine-Like Object Classification in Side-Scan Sonar

    Apr 1, 2026Taeyoun Kwon, Youngwon Choi, Hyeonyu Kim +3ClassificationSelf-Supervised Learning

  11. StereoVGGT: A Training-Free Visual Geometry Transformer for Stereo Vision

    Mar 31, 2026Ziyang Chen, Yansong Qu, You Shen +2Stereo VisionStereo Matching

  12. DinoDental: Benchmarking DINOv3 as a Unified Vision Encoder for Dental Image Analysis

    Mar 30, 2026Kun Tang, Xinquan Yang, Mianjie Zheng +6Medical Image AnalysisVision Foundation Model Adaptation

  13. Adapting SAM to Nuclei Instance Segmentation and Classification via Cooperative Fine-Grained Refinement

    Mar 30, 2026Jingze Su, Tianle Zhu, Jiaxin Cai +6Instance SegmentationHistopathology Image Segmentation

  14. VAN-AD: Visual Masked Autoencoder with Normalizing Flow For Time Series Anomaly Detection

    Mar 27, 2026PengYu Chen, Shang Wan, Xiaohou Shi +3Masked AutoencodersVision Foundation Model Adaptation

  15. MuRF: Unlocking the Multi-Scale Potential of Vision Foundation Models

    Mar 26, 2026Bocheng Zou, Mu Cai, Mark Stanley +2Multi-Scale Feature FusionVision Foundation Models

  16. PMT: Plain Mask Transformer for Image and Video Segmentation with Frozen Vision Encoders

    Mar 26, 2026Niccolò Cavagnero, Narges Norouzi, Gijs Dubbelman +1Image SegmentationVideo Object Segmentation

  17. GenMask: Adapting DiT for Segmentation via Direct Mask Generation

    Mar 25, 2026Yuhuan Yang, Xianwei Zhuang, Yuxuan Cai +6Image SegmentationVision Foundation Model Adaptation

  18. Generative Event Pretraining with Foundation Model Alignment

    Mar 24, 2026Jianwen Cao, Jiaxu Xing, Nico Messikommer +1Event-Based VisionVision Foundation Model Adaptation

  19. Pruned Adaptation Modules: A Simple yet Strong Baseline for Continual Foundation Models

    Mar 22, 2026Elif Ceren Gok Yildirim, Murat Onur Yildirim, Joaquin VanschorenStorage-Efficient Continual LearningClass-Incremental Learning

  20. SIMPLER: Efficient Foundation Model Adaptation via Similarity-Guided Layer Pruning for Earth Observation

    Mar 20, 2026Víctor Barreiro, Johannes Jakubik, Francisco Argüello +1Geospatial Foundation ModelsVision Foundation Model Adaptation

  21. Prompt-Free Lightweight SAM Adaptation for Histopathology Nuclei Segmentation with Strong Cross-Dataset Generalization

    Mar 20, 2026Muhammad Hassan Maqsood, Yanming Zhu, Alfred Lam +3Histopathology Image SegmentationVision Foundation Model Adaptation