eess.SPDate pending

State-specific respiratory signatures for affective and stress recognition: Interpretable respiratory markers, autocorrelation lags, and compact CNN models

Authors: Andrei Velichko, Mehmet Tahir Huyut

Abstract

Respiratory activity is a direct and interpretable physiological channel for wearable stress and affective-state recognition, yet many studies emphasize classification accuracy without identifying which respiratory properties separate different states. Using the chest respiratory channel of the WESAD dataset, we analyze 60 s windows under leave-one-subject-out validation and combine two complementary branches: compact raw-signal one-dimensional convolutional neural networks (1D-CNNs) and physically grouped handcrafted respiratory signatures. The primary task is stress versus non-stress detection, while baseline, stress, amusement, and meditation are additionally analyzed in a one-vs-rest setting to reveal state-specific respiratory markers. The feature space is organized into respiratory timing, breath-to-breath variability, waveform statistics, spectral/time-frequency descriptors, and autocorrelation/nonlinear predictability descriptors, with the raw 60 s signal treated as a sixth representation for the CNN branch. We introduce autocorrelation transition lags (Zpm/Zmp) as interpretable markers of respiratory correlation scale and separately evaluate exploratory forecast-error-growth/Lyapunov-like descriptors. In the final CNN refit setting, the raw-signal model achieved the strongest stress-vs-rest performance (accuracy 96.72%, macro-F1 95.30%, MCC 90.61%). In contrast, compact feature models were stronger for baseline (MCC 65.34%), amusement (MCC 35.69%), and especially meditation (MCC 88.65%). Strict nested reanalysis of the auxiliary Top-20 stress search yielded mean MCC=82.29% versus 85.45% originally, indicating modest selection optimism. These results show that CNNs are most useful for the practical stress detector, whereas interpretable respiratory signatures provide stronger and more physiologically transparent state-specific markers for several non-stress conditions.

Explore similar work

CardsList
Aug 6, 2026q-bio.QM

A Low-Power Wearable Respiratory Sensor for Non-Invasive Stress Monitoring

Respiration provides a continuously available window into physiological state and behavior. However, monitoring it outside controlled settings remains challenging because a wearable system must capture small body deformations while remaining comfortable, low power, and robust to changes in posture and motion. We present a compact non-invasive respiratory sensing system based on a force-sensitive resistor (FSR) embedded in an abdominal belt and integrated with a custom Bluetooth Low Energy acquisition board. The system combines a simple piezoresistive readout with a mechanical holder designed to transfer abdominal expansion to the sensor without analog amplification. We evaluate the complete sensing pipeline across multiple breathing patterns and body positions. In stationary settings, the recorded signals exhibit consistent amplitude changes and recurring peak-to-peak timing across breathing maneuvers; under light movement, these variations remain visible despite motion-induced baseline shifts. We further design a five-phase stress-induction protocol and collect respiratory recordings from 12 participants. Using interpretable time-domain features and standard classifiers, we examine whether the acquired signals distinguish relaxation from stress-induction phases. In this preliminary experiment, the best-performing model achieves 88.0% test accuracy, indicating that the extracted respiratory features distinguish stress-induced phases from relaxation phases in this dataset. Overall, our results show that the proposed platform enables real-time respiratory monitoring across diverse daily-life scenarios and captures respiratory changes that distinguish stress-induction from relaxation phases, supporting its potential for affective-computing applications.
Mohammad Hosseini, Hamed Khatounabadi, Mohammad Fakharzadeh
Remote Physiological MeasurementTrier Social Stress TestRespiratory Sound ClassificationSensorsSensing
AskPDF
May 14, 2026cs.MA

Decision-Level Fusion for Robust Wearable Affect Recognition

Automatic recognition of affective state from wearable physiology has clear societal impact for public health, preventive care, and stress-aware interventions, but real deployments require robustness to non-stationary dynamics, artefacts, and missing sensors. We study this problem on WESAD, using baseline, stress, and amusement conditions, where common fixed-basis spectral features such as FFT bandpower and Welch PSD can oversmooth short-lived discriminative patterns. We propose a non-stationary pipeline that combines Fourier-Bessel Series Expansion (FBSE) with EWT data-driven spectral segmentation to extract mode-wise transient descriptors. For multimodal integration, we adopt decision-level aggregation over per-modality predictors and weight each modality by predictive uncertainty and modality reliability. Results on WESAD, using 15 subjects and ECG, EDA, BVP, EMG, and ACC signals across three classes, indicate that decision-level aggregation is approximately 84 percent of the time at least as good as feature-level aggregation, and approximately 48 percent of the time strictly better, suggesting improved robustness under heterogeneous and partially reliable sensing.
Lokesh Singh, Athina Georgara, Jayati Deshmukh +2
Remote Physiological MeasurementAffective ComputingInput Modality
AskPDF
Jul 23, 2026cs.CV

Explainable graph attention network for stress recognition (StressGAT) via differential action units

Stress is a dynamic process characterized by significant individual variability in facial expression. Traditional architectures, such as Recurrent Neural Networks (RNNs) and Convolutional Neural Networks (CNNs), often overlook person-specific baselines or lack the representational capacity to model the non-linear temporal progression of distress due to sequential bottlenecks and rigid grid-based constraints. Furthermore, many deep learning models lack the interpretability required for clinical deployment. This study introduces StressGAT, a Graph Attention Network that leverages the relational inductive bias of graph modeling to capture complex facial dynamics that indicate acute stress. By using Differential Action Units, the framework normalizes individual responses relative to neutral baselines to achieve personalized recognition. The proposed model achieves 88.62% accuracy on a diverse stress-induction cohort (58 participants) using a subject-independent, Leave-One-Subject-Out (LOSO) cross-validation protocol. Beyond predictive accuracy, the architecture integrates a Multiple Instance Learning (MIL) attention mechanism to identify peak stress intervals and reveal distinct expressivity phenotypes. By simultaneously optimizing for accuracy and interpretability, this framework provides a robust, explainable solution for personalized affective monitoring.
Thomas Kassiotis, Stefanos Gkikas, Nikolaos Smyrnis +1
Trier Social Stress TestAffective ComputingFacial Expression RecognitionHeterogeneous Graph Transformers
AskPDF