cs.MMMar 12, 2026

Stage-Adaptive Reliability Modeling for Continuous Valence-Arousal Estimation

Authors: Yubeen Lee, Sangeun Lee, Junyeop Cha, Eunil Park

Organizations: Electronics and Telecommunications Research Institute

Abstract

Continuous valence-arousal estimation in real-world environments is challenging due to inconsistent modality reliability and interaction-dependent variability in audio-visual signals. Existing approaches primarily focus on modeling temporal dynamics, often overlooking the fact that modality reliability can vary substantially across interaction stages. To address this issue, we propose SAGE, a Stage-Adaptive reliability modeling framework that explicitly estimates and calibrates modality-wise confidence during multimodal integration. SAGE introduces a reliability-aware fusion mechanism that dynamically rebalances audio and visual representations according to their stage-dependent informativeness, preventing unreliable signals from dominating the prediction process. By separating reliability estimation from feature representation, the proposed framework enables more stable emotion estimation under cross-modal noise, occlusion, and varying interaction conditions. Extensive experiments on the Aff-Wild2 benchmark demonstrate that SAGE consistently improves concordance correlation coefficient scores compared with existing multimodal fusion approaches, highlighting the effectiveness of reliability-driven modeling for continuous affect prediction.

Figures & tables

Explore similar work

CardsList
  1. Team RAS in 10th ABAW Competition: Multimodal Valence and Arousal Estimation Approach

    Mar 13, 2026Elena Ryumina, Maxim Markitantov, Alexandr Axyonov +4Valence-Arousal ModelingAffective Computing

  2. Distance-aware Soft Prompt Guidance for Multimodal Valence-Arousal Estimation

    Mar 12, 2026Byeongjin Jung, Chanyeong Park, Sejoon LimValence-Arousal ModelingMultimodal Emotion Recognition

  3. Reliability-aware Cross-sample Enhancement for Robust Multimodal Sentiment Analysis

    Sep 24, 2026Menghua Jiang, Haokai Gao, Xiangui Kang +2Multimodal Sentiment AnalysisMultimodal Robustness