Global Time-Aware Conditioning (GTC): A Mechanism for Time-Aware Pediatric Sleep Representation Learning
Organizations: Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA · School of Data and Information Sciences, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
Abstract
Sleep physiology evolves throughout the night, with changes in sleep cycles, respiratory stability, and cardiovascular dynamics. However, self-supervised learning (SSL) methods for sleep typically process short, fixed-duration windows without explicitly modeling where each window occurs within the full sleep session. We introduce Global Time-Aware Conditioning (GTC), a mechanism that complements local positional encodings by conditioning latent representations on the global time-of-sleep of each input window. We integrate GTC into three representative SSL frameworks and evaluate them on five clinically relevant tasks with extreme class imbalance across two independent pediatric cohorts. GTC generally improves F1 and AUPRC across architectures and tasks, with gains persisting under cross-cohort transfer, highlighting the value of global temporal context for sleep representation learning.
Figures & tables
| Model | Arch. | Train | GTC | Performance (%) | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Sleep Scoring | Apnea | EEG Arousal | Oxygen Desat. | Hypopnea | |||||||||||||||||||
| (0.8%) | (4.6%) | (8.7%) | (1.9%) | ||||||||||||||||||||
| Acc. | F1 | ROC | PR | Acc. | F1 | ROC | PR | Acc. | F1 | ROC | PR | Acc. | F1 | ROC | PR | Acc. | F1 | ROC | PR | ||||
| SleepFM | CNN | CL | None | 71.0 (0.2) | 64.2 (0.1) | 90.8 (0.0) | 69.0 (0.1) | 97.0 (0.2) | 17.5 (0.5) | 87.6 (0.4) | 11.2 (0.4) | 93.8 (0.1) | 46.0 (0.2) | 89.4 (0.0) | 41.4 (0.1) | 78.9 (1.3) | 32.8 (0.5) | 77.0 (0.2) | 25.5 (0.2) | 94.9 (0.1) | 20.2 (0.5) | 83.1 (0.4) | 12.7 (0.1) |
| One | 71.5 (0.1) | 64.6 (0.0) | 91.1 (0.0) | 69.7 (0.1) | 97.2 (0.3) | 18.1 (0.5) | 87.4 (0.1) | 11.4 (0.1) | 93.6 (0.1) | 46.2 (0.1) | 89.5 (0.1) | 41.6 (0.3) | 78.9 (1.1) | 32.0 (0.4) | 76.4 (0.4) | 24.4 (0.5) | 94.5 (1.1) | 21.0 (0.3) | 82.6 (0.4) | 13.4 (0.4) | |||
| All | 71.4 (0.1) | 64.4 (0.0) | 91.1 (0.0) | 69.6 (0.1) | 97.3 (0.5) | 18.4 (0.9) | 87.5 (0.2) | 11.5 (0.3) | 93.9 (0.2) | 46.1 (0.2) | 89.5 (0.1) | 41.9 (0.2) | 79.4 (1.2) | 32.3 (0.5) | 76.5 (0.4) | 24.8 (0.5) | 94.9 (0.4) | 21.2 (0.4) | 82.6 (0.4) | 13.3 (0.3) | |||
| Model | GTC | Performance (%) | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Sleep Scoring | Apnea | EEG Arousal | Oxygen Desat. | Hypopnea | |||||||||||||||||
| (2.4%) | (8.0%) | (17.0%) | (3.9%) | ||||||||||||||||||
| Acc. | F1 | ROC | PR | Acc. | F1 | ROC | PR | Acc. | F1 | ROC | PR | Acc. | F1 | ROC | PR | Acc. | F1 | ROC | PR | ||
| SleepFM | None | 76.6 (0.2) | 71.2 (0.2) | 94.0 (0.0) | 76.3 (0.0) | 94.2 (0.2) | 14.7 (0.2) | 81.5 (0.1) | 8.6 (0.1) | 92.3 (0.3) | 58.1 (0.1) | 92.9 (0.1) | 57.2 (0.3) | 76.4 (0.6) | 44.6 (0.3) | 77.7 (0.3) | 41.1 (0.7) | 91.9 (0.8) | 21.4 (0.5) | 80.1 (0.4) | 13.8 (0.4) |
| One | 78.0 (0.3) | 72.8 (0.3) | 94.8 (0.1) | 78.5 (0.1) | 91.8 (0.4) | 14.6 (0.3) | 81.7 (0.4) | 8.3 (0.1) | 93.0 (0.2) | 61.6 (0.0) | 93.9 (0.0) | 62.1 (0.2) | 77.3 (0.1) | 44.6 (0.4) | 77.4 (0.3) | 42.0 (0.6) | 90.4 (0.2) | 21.6 (0.1) | 81.5 (0.3) | 14.3 (0.3) | |
| All | 78.1 (0.2) | 73.0 (0.2) | 94.9 (0.1) | 78.8 (0.1) | 92.0 (0.9) | 14.8 (0.1) | 81.6 (0.4) | 8.3 (0.1) | 93.0 (0.3) | 62.0 (0.2) | 94.0 (0.0) | 62.8 (0.1) | 76.7 (1.2) | 44.8 (0.3) | 77.5 (0.1) | 42.3 (0.1) | 90.3 (0.3) | 21.6 (0.2) | 81.4 (0.3) | 14.1 (0.3) | |