Overview

Vision foundation models learn reusable visual representations from large image or video collections, often through self-supervised methods such as contrastive learning, masked prediction, and feature prediction, or through image-text and generative training. Researchers adapt them using frozen-feature probes, prompts, lightweight fine-tuning, distillation, and feature fusion for tasks ranging from classification and segmentation to depth, 3D geometry, and video understanding. These methods can transfer across tasks and domains, but specialized pretraining or adaptation can still be important in settings such as medical imaging, remote sensing, and scientific vision. A central open tension is whether broad pretrained representations can provide reliable spatial, temporal, and domain-robust understanding while remaining efficient and consistently evaluated.

Latest papers

CardsList

152 papers16 papers in the last four weeks, up 7% on the four weeks before. 0.1% of all new papers.

  1. SPROUT: A Scalable Diffusion Foundation Model for Multi-Crop Plant Phenotyping

    Mar 29, 2026Shuai Xiang, James Burridge, Shouyang Liu +4Agricultural Image AnalysisPlant Phenotyping

  2. THFM: A Unified Video Foundation Model for 4D Human Perception and Beyond

    Mar 26, 2026Letian Wang, Andrei Zanfir, Eduard Gabriel Bazavan +2Video Foundation ModelsVision Foundation Models

  3. MuRF: Unlocking the Multi-Scale Potential of Vision Foundation Models

    Mar 26, 2026Bocheng Zou, Mu Cai, Mark Stanley +2Multi-Scale Feature FusionVision Foundation Models

  4. Estimating Individual Tree Height and Species from UAV Imagery

    Mar 24, 2026Jannik Endres, Etienne Laliberté, David Rolnick +1Vision Foundation ModelsTree Species Classification

  5. CanViT: Toward Active-Vision Foundation Models

    Mar 23, 2026Yohaï-Eliel Berreby, Sabrina Du, Audrey Durand +1Active VisionActive Perception

  6. Efficient Universal Perception Encoder

    Mar 23, 2026Chenchen Zhu, Saksham Suri, Cijo Jose +8Visual Representation LearningVision Foundation Models

  7. Evaluating Vision Foundation Models for Pixel and Object Classification in Microscopy

    Mar 20, 2026Carolin Teuber, Anwai Archit, Tobias Boothe +3Vision Foundation ModelsSemantic Segmentation

  8. WorldAgents: Can Foundation Image Models be Agents for 3D World Models?

    Mar 20, 2026Ziya Erkoç, Angela Dai, Matthias NießnerProcedural 3D Generation3D Scene Generation

  9. Video Understanding: From Geometry and Semantics to Unified Models

    Mar 18, 2026Zhaochong An, Zirui Li, Mingqiao Ye +9Video Foundation ModelsVideo Understanding

  10. Eye image segmentation using visual and concept prompts with Segment Anything Model 3 (SAM3)

    Mar 18, 2026Diederick C. Niehorster, Marcus NyströmMedical Image SegmentationPromptable Image Segmentation

  11. Interp3R: Continuous-time 3D Geometry Estimation with Frames and Events

    Mar 15, 2026Shuang Guo, Filbert Febryanto, Lei Sun +2Vision Foundation Models3D Reconstruction

  12. GP-VM×\timesSMA: Benchmarking General-Purpose Vision Models and Specialized Architectures for 2D Medical Image Segmentation

    Mar 13, 2026Vanessa Borst, Anna Riedmann, Samuel KounevImage SegmentationVision Foundation Models

  13. SAP: Segment Any 4K Panorama

    Mar 13, 2026Lutao Jiang, Zidong Cao, Weikai Chen +14Instance SegmentationVision Foundation Models

  14. Revisiting Model Stitching In the Foundation Model Era

    Mar 12, 2026Zheda Mai, Ke Zhang, Fu-En Wang +6Model StitchingVision Foundation Models

  15. OmniStream: Mastering Perception, Reconstruction and Action in Continuous Streams

    Mar 12, 2026Yibin Yan, Jilan Xu, Shangzhe Di +2Streaming Video UnderstandingVision Foundation Models

  16. BackdoorIDS: Zero-shot Backdoor Detection for Pretrained Vision Encoder

    Mar 12, 2026Siquan Huang, Yijiang Li, Ningzhi Gao +3Backdoor DetectionVision Foundation Models

  17. RandMark: On Random Watermarking of Visual Foundation Models

    Mar 11, 2026Anna Chistyakova, Mikhail PautovGNN WatermarkingModel Ownership Verification

  18. Revisiting Shape from Polarization in the Era of Vision Foundation Models

    Mar 5, 2026Chenhao Li, Taishi Ono, Takeshi Uemori +1Surface Normal EstimationPolarimetric Imaging

  19. Modeling Cross-vision Synergy for Unified Large Vision Model

    Mar 3, 2026Shengqiong Wu, Lanhu Wu, Mingyang Bao +5Vision Foundation ModelsUnified Multimodal Models

  20. Generalizable Knowledge Distillation from Vision Foundation Models for Semantic Segmentation

    Mar 3, 2026Chonghua Lv, Dong Zhao, Shuang Wang +4Domain Generalization for Semantic SegmentationKnowledge Distillation

  21. Xray-Visual Models: Scaling Vision models on Industry Scale Data

    Feb 18, 2026Shlok Mishra, Tsung-Yu Lin, Linda Wang +24Vision Foundation ModelsMultimodal Pretraining

  22. Vision Transformers for Zero-Shot Clustering of Animal Images: A Comparative Benchmarking Study

    Feb 3, 2026Hugo Markoff, Stefan Hein Bengtson, Michael ØrstedClusteringImage Clustering

  23. SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models

    Jan 16, 2026Turhan Can Kargin, Wojciech Jasiński, Adam Pardyl +2Spatial Reasoning BenchmarksVisual Spatial Reasoning

  24. Towards Open-Ended Visual Scientific Discovery with Sparse Autoencoders

    Nov 21, 2025Jacob Beattie, Samuel Stevens, Neil Rosser +2Vision Foundation ModelsSparse Autoencoders

  25. Foundation Models in Medical Image Analysis: A Systematic Review and Meta-Analysis

    Oct 19, 2025Praveenbalaji Rajendran, Mojtaba Safari, Wenfeng He +4Medical Imaging Foundation ModelsVision Foundation Models