cs.CVNov 1, 2026

MUPA2{}^2S: Multimodal Unified Perception with Asymmetric Attention for Stress Assessment

Authors: Stefanos Gkikas, Thomas Kassiotis, Yu Fang, Christian Arzate Cruz, Miao Cheng, Zongyi Jiang, Zacharias Kamarianakis, Houshyar Asadi, 

Organizations: Honda Research Institute Japan Wako City, Japan · Department of Electronic Engineering Hellenic Mediterranean University Chania, Greece · Research Institute of Electrical Communication Tohoku University Sendai, Japan · University of Canberra Canberra, Australia · 

Abstract

Stress is a leading contributor to long-term physical and mental health decline. The automatic assessment of stress is a promising approach for continuous monitoring and mitigating human biases. However, the development of automated systems remains challenging due to the heterogeneity of physiological and behavioral signals. This paper presents MUPA2{}^2S, a multimodal framework for automatic stress assessment that combines facial video and ECG signals within a unified perception architecture. Both modalities are mapped into a shared token representation without modality-specific components, and processed through asymmetric attention comprising segment-local cross-attention and global self-attention across segment states. Experiments on a newly collected 58-subject stress dataset, evaluated under a stratified subject-level protocol, show that facial video achieves 69.44% test accuracy, while ECG-only performance remains close to chance under the proposed representation. Unified Video-ECG fusion achieves a test accuracy of 69.58% at approximately half the number of parameters of feature-level fusion, with negligible additional computational cost. Feature-level fusion does not exceed the video-only baseline, while unified input-level integration provides a parameter-efficient mechanism for jointly processing the two modalities.

Figures & tables

Explore similar work

CardsList
  1. MUPA2^{2}E: Multimodal Unified Perception with Asymmetric Attention for Emotion Assessment

    Aug 17, 2026Stefanos Gkikas, Eric Nichols, Christian Arzate Cruz +1Dataset BiasMultimodal Emotion Recognition

  2. FUSE: Frame-Unified Stress Estimation from Facial Video

    Aug 11, 2026Stefanos Gkikas, Thomas Kassiotis, Yang Guo +2Emotion RecognitionTemporal Video Understanding

  3. UNWIND: Any-Length Facial Video for Stress Detection without Temporal Windowing

    Aug 26, 2026Stefanos Gkikas, Christian Arzate Cruz, Eric Nichols +2Temporal Video UnderstandingLong-Video Understanding