Vision Foundation Model Adaptation

Follow this topic Ask about this topic

Momentum

22 papers in the last four weeks, up 83% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 204

All topics

PriorNet: Prior-Guided Engagement Estimation from Face Video
May 5, 2026Alexander VedernikovVision Foundation Model Adaptation
Helsinki, Finland
Sparsity Hurts: Simple Linear Adapter Can Boost Generalized Category Discovery
May 5, 2026Bo Ye, Kai Gan, Tong Wei +1Vision Foundation Model Adaptation Parameter-Efficient Fine-Tuning
School of Computer Science and Engineering, Southeast University, Nanjing 210096, China, and the Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, China.
Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Models
May 5, 2026Zihao Guo, Yiding Sun, Jihua Zhu +23D Foundation Models Mamba
Xi’an Jiaotong University, Xi’an, China · School of Artificial Intelligence and Robotics, Hunan University, China · University of Western Australia, Perth, Australia
Global-Local Feature Decoding with Adapter-Guided SAMv2 for Salient Object Detection
May 4, 2026Morteza Moradi, Mohammad Moradi, Simone Palazzo +2Salient Object Detection Vision Foundation Model Adaptation
University of Catania, Catania, Italy · Quintic AI, San Francisco, CA, USA
SpectraDINO: Bridging the Spectral Gap in Vision Foundation Models via Lightweight Adapters
May 4, 2026Yagiz Nalcakan, Hyeongjin Ju, Incheol Park +3Cross-Modal Knowledge Distillation Multispectral Object Detection
Yonsei University, Seoul, Republic of Korea
CUE: Concept-Aware Multi-Label Expansion to Mitigate Concept Confusion in Long-Tailed Learning
May 2, 2026Ruichi Zhang, Chikai Shang, Jiacheng Yang +4Long-Tailed Classification Vision Foundation Model Adaptation
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, China · College of Computer Science and Software Engineering, Shenzhen University, China · Institute of High Performance Computing, A*STAR, Singapore
REALM: An RGB- and Event-Aligned Latent Manifold for Cross-Modal Perception
Apr 30, 2026Vincenzo Polizzi, David B. Lindell, Jonathan KellyCross-Modal Learning Event-Based Vision
University of Toronto, Robotics Institute · University of Toronto, Department of Computer Science
Parameter-Efficient Adaptation of Pre-Trained Vision Foundation Models for Active and Passive Seismic Data Denoising
Apr 30, 2026Jiahua Zhao, Umair bin Waheed, Jing Sun +3Test-Time Adaptation Vision Foundation Model Adaptation
Computation-based Science and Technology Research Center, The Cyprus Institute, Nicosia, Cyprus · Department of Geosciences, College of Petroleum Engineering and Geosciences, King Fahd University of Petroleum & Minerals, Dhahran, Saudi Arabia · Department of Intelligent Systems, Faculty of Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, Delft, Netherlands +2
TAP into the Patch Tokens: Leveraging Vision Foundation Model Features for AI-Generated Image Detection
Apr 29, 2026Ahmed Abdullah, Nikolas Ebert, Oliver WasenmüllerVision Foundation Models Vision Foundation Model Adaptation
Mannheim University of Applied Sciences, Germany
Generalized Category Discovery under Domain Shifts: From Vision to Vision-Language Models
Apr 29, 2026Hongjun Wang, Po Hu, Kai HanVLM Adaptation Vision Foundation Model Adaptation
School of Computing and Data Science, The University of Hong Kong
Towards Robust Deep Learning-based Rumex Obtusifolius Detection from Drone Images
Apr 28, 2026Fabian Dionys Schrag, Mehmet Ozgur Turkoglu, Konrad Schindler +1Unsupervised Domain Adaptation Agricultural Remote Sensing
Agroscope NBA, Tänikon 1, Ettenhausen, 8356, TG, Switzerland · Agroscope Earth Observation of Agroecosystems Team, Reckenholz 191, Zurich, 8046, ZH, Switzerland · ETH Zurich, Stefano-Franscini-Platz 5, Zurich, 8093, ZH, Switzerland
Dino-NestedUNet: Unlocking Foundation Vision Encoders for Pathology Tumor Bulk Segmentation via Dense Decoding
Apr 27, 2026Tianyang Wang, Ziyu Su, Abdul Rehman Akbar +7Histopathology Image Segmentation U-Net
Department of Pathology, College of Medicine, The Ohio State University Wexner Medical Center, Columbus, OH, USA · Department of Biomedical Engineering, The Ohio State University, Columbus, OH, USA
Are Natural-Domain Foundation Models Effective for Accelerated Cardiac MRI Reconstruction?
Apr 24, 2026Anam Hashmi, Mayug Maniparambil, Julia Dietlmeier +2Domain Generalization Vision Foundation Model Adaptation
1Dublin City University, Ireland · University College Dublin, Ireland
Unlocking Optical Prior: Spectrum-Guided Knowledge Transfer for SAR Generalized Category Discovery
Apr 24, 2026Jingyuan Xia, Ruikang Hu, Ye Li +3Domain Adaptation Frequency-Domain Feature Learning
College of Electronic Science and Technology, National University of Defense Technology, Changsha, 410073, China · State Key Laboratory of Complex System Simulation and Modeling Technology, Beijing, 100091, China
Amodal SAM: A Unified Amodal Segmentation Framework with Generalization
Apr 22, 2026Bo Zhang, Zhuotao Tian, Xin Tao +3Vision Foundation Model Adaptation
Department of Computer Science, Harbin Institute of Technology at Shenzhen, Shenzhen 518057, China · Kuaishou Technology, Shenzhen, Guangdong, China
Semantic-Fast-SAM: Efficient Semantic Segmenter
Apr 22, 2026Byunghyun KimImage Segmentation Vision Foundation Model Adaptation
Kyungpook National University, Korea
DINO Eats CLIP: Adapting Beyond Knowns for Open-set 3D Object Retrieval
Apr 21, 2026Xinwei He, Yansong Zheng, Qianru Han +7Multi-View Learning Vision Foundation Model Adaptation
Huazhong Agricultural University · Huazhong University of Science and Technology · Shenzhen University
Attend what matters: Leveraging vision foundational models for breast cancer classification using mammograms
Apr 21, 2026Samyak Sanghvi, Piyush Miglani, Sarvesh Shashikumar +3Medical Imaging Vision Foundation Model Adaptation
Department of Computer Science and Engineering, IIT Delhi, New Delhi, India · Yardi School of AI, IIT Delhi, New Delhi, India · Department of Radiodiagnosis, PGIMER Chandigarh, Chandigarh, India
Multi-Domain Learning with Global Expert Mapping
Apr 20, 2026Pourya Shamsolmoali, Masoumeh Zareapoor, Huiyu Zhou +3Vision Foundation Model Adaptation Expert Routing
Department of Computer Science, University of York, UK · School of Computing and Mathematical Sciences, University of Leicester, UK · Centre for Vision Speech and Signal Processing, University of Surrey, UK +2
Feasibility of Indoor Frame-Wise Lidar Semantic Segmentation via Distillation from Visual Foundation Model
Apr 20, 2026Haiyang Wu, Juan J. Gonzales Torres, George Vosselman +1Cross-Modal Knowledge Distillation Vision Foundation Model Adaptation
Department of Earth Observation Science, Faculty of Geo-Information Science and Earth Observation (ITC), University of Twente, 7522 NB Enschede, The Netherlands
Spike-NVPT: Learning Robust Visual Prompts via Bio-Inspired Temporal Filtering and Discretization
Apr 20, 2026Qiugang Zhan, Anning Jiang, Ran Tao +4Vision Foundation Model Adaptation Visual Prompt Learning
Complex Laboratory of New Finance and Economics, Southwestern University of Finance and Economics · Engineering Research Center of Intelligent Finance, Ministry of Education · School of Computer Science and Engineering, 4Laboratory of Intelligent Collaborative Computing, University of Electronic Science and Technology of China +3
Sharpening Lightweight Models for Generalized Polyp Segmentation: A Boundary Guided Distillation from Foundation Models
Apr 20, 2026Shivanshu Agnihotri, Snehashis Majhi, Deepak Ranjan NayakImage Segmentation Vision Foundation Model Adaptation
Dept. of Computer Science and Engineering Malaviya National Institute of Technology Jaipur, India
R-FLoRA: Residual-Statistic-Gated Low-Rank Adaptation for Single-Image Face Morphing Attack Detection
Apr 19, 2026Raghavendra RamachandraImage Forgery Detection Vision Foundation Model Adaptation
SAFE Center, Department of Information Security and Communication Technology, Norwegian University of Science and Technology (NTNU), Norway
Adaptive Forensic Feature Refinement via Intrinsic Importance Perception
Apr 18, 2026Jiazhen Yang, Junjun Zheng, Kejia Chen +5Image Forgery Detection Vision Foundation Model Adaptation
Zhejiang University · Hangzhou, China · Alibaba Inc +1
Frozen Vision Transformers for Dense Prediction on Small Datasets: A Case Study in Arrow Localization
Apr 18, 2026Maxwell ShepherdVision Foundation Model Adaptation
A Benchmark Study of Segmentation Models and Adaptation Strategies for Landslide Detection from Satellite Imagery
Apr 17, 2026Md Kowsher, Weiwei Zhan, Chen ChenRemote Sensing Image Segmentation Vision Foundation Model Adaptation
University of Central Florida
DINOv3 Beats Specialized Detectors: A Simple Foundation Model Baseline for Image Forensics
Apr 17, 2026Jieming Yu, Qiuxiao Feng, Zhuohan Wang +1Image Forgery Detection Digital Image Forensics
The Hong Kong University of Science and Technology · Harvard University
AdaVFM: Adaptive Vision Foundation Models for Edge Intelligence via LLM-Guided Execution
Apr 17, 2026Yiwei Zhao, Yi Zheng, Huapeng Su +9Vision Foundation Models Vision Foundation Model Adaptation
Carnegie Mellon University · Meta
Robustness of Vision Foundation Models to Common Perturbations
Apr 16, 2026Hongbin Liu, Zhengyuan Jiang, Cheng Hong +1Image Corruption Robustness Vision Foundation Models
Duke University · Ant Group
WILD-SAM: Phase-Aware Expert Adaptation of SAM for Landslide Detection in Wrapped InSAR Interferograms
Apr 16, 2026Yucheng Pan, Heping Li, Zhangle Liu +2Remote Sensing Image Segmentation Vision Foundation Model Adaptation
School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China · Hubei Luojia Laboratory, Wuhan 430079, China

May 5, 2026, cs.CVJ/K move · Enter open · S save

PriorNet: Prior-Guided Engagement Estimation from Face Video

Alexander Vedernikov

Helsinki, Finland

Vision Foundation Model Adaptation

Open paper AskPDF arXiv

Engagement estimation from face video remains challenging because facial evidence is often incomplete, labeled data are limited, and engagement annotations are subjective. We present PriorNet, a prior-guided framework that injects task-relevant priors at three stages of the pipeline: preprocessing, model adaptation, and objective design. PriorNet converts face-detection failures into explicit zero-frame placeholders so that missing-face events remain represented in the input sequence, adapts a frozen Self-supervised Video Facial Affect Perceiver (SVFAP) backbone through a Prior-guided Low-Rank Adaptation module (Prior-LoRA) for parameter-efficient specialization, and trains with a Dirichlet-evidential, uncertainty-weighted objective under hard-label supervision. We evaluate PriorNet on EngageNet, DAiSEE, DREAMS, and PAFE using each dataset's native evaluation protocol. Across these benchmarks, PriorNet improves over the strongest listed prior reference within each dataset's evaluation framing, while component ablations on EngageNet and DAiSEE indicate that the gains arise from complementary contributions of preprocessing, adaptation, and objective-level priors. These results support explicit prior injection as a useful design principle for face-video engagement estimation under the benchmark conditions studied in this work.

Momentum

Related topics

Latest papers 204