cs.CVMar 24, 2026

MVRD-Bench: Multi-View Learning and Benchmarking for Dynamic Remote Photoplethysmography under Occlusion

Authors: Zuxian He, Xu Cheng, Zhaodong Sun, Haoyu Chen, Jingang Shi, Xiaobai Li, Guoying Zhao

Organizations: Nanjing University of Information Science and Technology · University of Oulu · Xi’an Jiaotong University · Zhejiang University

Abstract

Remote photoplethysmography (rPPG) is a non-contact technique that estimates physiological signals by analyzing subtle skin color changes in facial videos. Existing rPPG methods often encounter performance degradation under facial motion and occlusion scenarios due to their reliance on static and single-view facial videos. Thus, this work focuses on tackling the motion-induced occlusion problem for rPPG measurement in unconstrained multi-view facial videos. Specifically, we introduce a Multi-View rPPG Dataset (MVRD), a high-quality benchmark dataset featuring synchronized facial videos from three viewpoints under stationary, speaking, and head movement scenarios to better match real-world conditions. We also propose MVRD-rPPG, a unified multi-view rPPG learning framework that fuses complementary visual cues to maintain robust facial skin coverage, especially under motion conditions. Our method integrates an Adaptive Temporal Optical Compensation (ATOC) module for motion artifact suppression, a Rhythm-Visual Dual-Stream Network to disentangle rhythmic and appearance-related features, and a Multi-View Correlation-Aware Attention (MVCA) for adaptive view-wise signal aggregation. Furthermore, we introduce a Correlation Frequency Adversarial (CFA) learning strategy, which jointly enforces temporal accuracy, spectral consistency, and perceptual realism in the predicted signals. Extensive experiments and ablation studies on the MVRD dataset demonstrate the superiority of our approach. In the MVRD movement scenario, MVRD-rPPG achieves an MAE of 0.90 and a Pearson correlation coefficient (R) of 0.99. The source code and dataset will be made available.

Figures & tables

Explore similar work

CardsList
  1. Video-based Heart Rate Estimation with Angle-guided ROI Optimization and Graph Signal Denoising

    Apr 13, 2026Gan Pei, Junhao Ning, Boqiu Shen +2Heart Rate EstimationRemote Photoplethysmography

  2. PhysVR: Vision-Language Model Guided Interference-aware Temporal Feature Refinement for Remote Physiological Measurement

    Aug 30, 2026Zixu Li, Jianjun Qian, Hang Shao +3Remote PhotoplethysmographyPhotoplethysmography

  3. Rhythm-Structured Predictive Learning for Remote Photoplethysmography

    Jun 30, 2026Ba-Thinh Nguyen, Huu-Dung Nguyen, Thi-Duyen Ngo +1Remote PhotoplethysmographyMamba