Vision Foundation Model Adaptation

Overview

This field studies how to reuse pretrained vision models when target tasks, data, or sensors differ from their original training conditions. Common approaches include full or partial fine-tuning, parameter-efficient methods such as LoRA and prompt or adapter tuning, feature alignment, and distillation into smaller models. Applications range from medical and remote-sensing segmentation to video understanding, robotics, and 3D geometry, often with limited labels or shifted test data. A central tension is that adaptation can improve target-task accuracy while weakening robustness or transfer to unfamiliar settings, so efficiency and out-of-domain performance remain important evaluation criteria.

Latest papers

CardsList

352 papers27 papers in the last four weeks, down 34% on the four weeks before. 0.2% of all new papers.

  1. EasyControlEdge: A Foundation-Model Fine-Tuning for Edge Detection

    Feb 18, 2026Hiroki Nakamura, Hiroto Iino, Masashi Okada +1Edge DetectionVision Foundation Model Adaptation

  2. Spanning the Visual Analogy Space with a Weight Basis of LoRAs

    Feb 17, 2026Hila Manor, Rinon Gal, Haggai Maron +2Vision Foundation Model AdaptationLow-Rank Adaptation

  3. Depth Completion as Parameter-Efficient Test-Time Adaptation

    Feb 16, 2026Bingxin Ke, Qunjie Zhou, Jiahui Huang +5Depth CompletionTest-Time Adaptation

  4. STORM: Slot-based Task-aware Object-centric Representation for robotic Manipulation

    Jan 28, 2026Alexandre Chapin, Emmanuel Dellandréa, Liming ChenVision Foundation Model AdaptationGeneralization in Robotic Manipulation

  5. Attentive multilayer fusion for vision transformers

    Jan 14, 2026Laure Ciernik, Marco Morik, Lukas Thede +4Linear ProbingVision Transformer

  6. Multi-View Foundation Models

    Dec 17, 2025Leo Segre, Or Hirschorn, Shai AvidanMulti-View ConsistencyVision Foundation Model Adaptation

  7. Rethinking Infrared Small Target Detection: A Foundation-Driven Efficient Paradigm

    Dec 5, 2025Chuang Yu, Jinmiao Zhao, Yunpeng Liu +5Infrared Small Target DetectionVision Foundation Model Adaptation

  8. ColonAdapter: Geometry Estimation Through Foundation Model Adaptation for Colonoscopy

    Nov 27, 2025Zhiyi Jiang, Yifu Wang, Xuelian Cheng +1Endoscopic 3D ReconstructionVision Foundation Model Adaptation

  9. D2^{2}-VPR: A Parameter-efficient Visual-foundation-model-based Visual Place Recognition Method via Knowledge Distillation and Deformable Aggregation

    Nov 16, 2025Zheyuan Zhang, Jiwei Zhang, Boyu Zhou +2Visual Place RecognitionVision Foundation Model Adaptation

  10. AD-SAM: Adapting the Segment Anything Model for Semantic Segmentation in Autonomous Driving

    Oct 30, 2025Het Patel, Mario Camarena, Fatemeh Nazari +3Vision Foundation Model AdaptationAutonomous Driving Perception

  11. Evaluating Fundus-Specific Foundation Models for Diabetic Macular Edema Detection

    Oct 8, 2025Franco Javier Arellano, José Ignacio OrlandoMedical Imaging Foundation ModelsVision Foundation Model Adaptation

  12. Phantom-Insight: Adaptive Multi-cue Fusion for Video Camouflaged Object Detection with Multimodal LLM

    Sep 8, 2025Hua Zhang, Changjiang LuoVideo Object SegmentationVision Foundation Model Adaptation

  13. EndoUFM: Utilizing Foundation Models for Monocular depth estimation of endoscopic images

    Aug 25, 2025Xinning Yao, Bo Liu, Bojian Li +3Medical ImagingMonocular Depth Estimation

  14. Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens

    Aug 6, 2025Rit Gangopadhyay, Jung-Hee Kim, Xien Chen +3Domain AdaptationDepth Estimation

  15. WaRA: Wavelet Low-Rank Adaptation for Medical Image Classification

    Jun 25, 2025Moein Heidari, Yijin Huang, Yasamin Medghalchi +3Vision Foundation Model AdaptationLow-Rank Adaptation

  16. Unlocking Pretrained Vision Transformers for Time Series Classification

    Jun 10, 2025Simon Roschmann, Quentin Bouniot, Vasilii Feofanov +2Time Series ClassificationVision Transformer

  17. SARTM: Segment Any RGB Thermal Model with Language aided Distillation

    May 4, 2025Dong Xing, Jinhe Zhang, Hang Yang +1Vision Foundation Model AdaptationSemantic Segmentation

  18. C-LoRA: Continual Low-Rank Adaptation for Pre-trained Visual Models

    Feb 25, 2025Xin Zhang, Liang Bai, Xian YangContinual LoRALow-Rank Adaptation

  19. Large Pretraining Datasets Don't Guarantee Robustness after Fine-Tuning in Image Classification

    Oct 28, 2024Jaedong Hwang, Brian Cheung, Zhang-Wei Hong +3Neural Network RobustnessOOD Generalization