A Cardiorespiratory Foundation Model Pretrained on Ten Physiological Signals for Perioperative and Critical Care
Organizations: Healthcare AI Research Institute, Seoul National University Hospital, Seoul, Republic of Korea · Interdisciplinary Program in Medical Informatics, College of Medicine, Seoul National University, Seoul, Republic of Korea · Department of Transdisciplinary Medicine, Seoul National University Hospital, Seoul, Republic of Korea · Department of Anesthesiology and Pain Medicine, Seoul National University College of Medicine and Seoul National University Hospital, Seoul, Republic of Korea
Abstract
Arterial, venous, pulmonary artery and intracranial pressures and ventilator waveforms guide decisions in operating rooms and intensive care units, yet foundation models for physiological waveforms have been built almost entirely on the electrocardiogram and photoplethysmogram. We present CARMEN, a single encoder pretrained without labels on ten cardiorespiratory waveforms (2.27 million modality-hours). CARMEN accepts any combination of co-recorded signals from 10 s to 5 min, and a conditioning mechanism, LSCNorm, restores the absolute signal level that normalization removes; without it, the AUROC for intraoperative hypotension fell from 0.894 to 0.780. Across 19 tasks from Korean and US cohorts, the frozen encoder outperformed supervised models on 12 of 15 and three foundation models, one general-purpose and two for biosignals, on 14 to 17 of 19, with none exceeding it on any task. Given the electrocardiogram or photoplethysmogram alone, it matched or exceeded signal-specific foundation models in most comparisons, and it retained its performance when channels were missing.
Figures & tables
| Model | Modality | Input | Arrhythmia (Macro-AUROC) | Atrial Fibrillation (AUROC) | Age (MAE, yr) |
| CARMEN | ECG+PPG | 10 s | 0.967 (0.953–0.979) | 0.964 (0.956–0.972) | 6.45 (6.18–6.73) |
| NormWear 19 | ECG+PPG | 6 s | 0.914 (0.894–0.934) | 0.924 (0.911–0.936) | 7.21 (6.92–7.52) |
| SPOTR 20 | ECG+PPG | 10 s | 0.865 (0.842–0.886) | 0.854 (0.838–0.870) | 8.40 (8.07–8.71) |
| BIOT 13 | ECG+PPG | 10 s | 0.828 (0.794–0.861) | 0.772 (0.749–0.796) | 7.90 (7.58–8.20) |
| CARMEN | ECG+PPG | Full window | 0.978 (0.967–0.988) | 0.968 (0.960–0.976) | 6.38 (6.11–6.64) |
| CARMEN | ECG | 10 s | 0.967 (0.957–0.977) | 0.963 (0.955–0.971) | 7.67 (7.37–7.98) |
| Task | Model | AUROC (95% CI) | AUPRC (95% CI) |
| Arrhythmia | CARMEN-Large | 0.981 (0.971–0.989) | 0.882 (0.831–0.919) |
| CARMEN-Base | 0.978 (0.967–0.988) | 0.887 (0.835–0.924) | |
| CARMEN-Small | 0.976 (0.965–0.986) | 0.863 (0.803–0.908) | |
| MOMENT | 0.948 (0.932–0.964) | 0.764 (0.699–0.813) | |
| NormWear | 0.929 (0.907–0.949) | 0.715 (0.640–0.778) | |
| SPOTR | 0.875 (0.848–0.900) | 0.598 (0.541–0.662) |
| Task | Model | AUROC (95% CI) | AUPRC (95% CI) |
| Intraoperative Hypotension | CARMEN-Large | 0.895 (0.891–0.901) | 0.338 (0.323–0.354) |
| CARMEN-Base | 0.895 (0.890–0.900) | 0.336 (0.322–0.352) | |
| CARMEN-Small | 0.888 (0.883–0.894) | 0.305 (0.292–0.319) | |
| MOMENT | 0.664 (0.650–0.677) | 0.094 (0.086–0.104) | |
| NormWear | 0.661 (0.647–0.675) | 0.097 (0.087–0.108) | |
| SPOTR | 0.651 (0.639–0.664) | 0.089 (0.082–0.097) |
| Task | Model | AUROC (95% CI) | AUPRC (95% CI) |
| Cardiac Arrest | CARMEN-Large | 0.634 (0.568–0.696) | 0.471 (0.387–0.571) |
| CARMEN-Base | 0.634 (0.566–0.697) | 0.493 (0.402–0.592) | |
| CARMEN-Small | 0.636 (0.570–0.701) | 0.507 (0.417–0.608) | |
| MOMENT | 0.510 (0.444–0.576) | 0.342 (0.278–0.426) | |
| NormWear | 0.571 (0.502–0.640) | 0.452 (0.364–0.552) | |
| SPOTR | 0.581 (0.511–0.646) | 0.441 (0.354–0.540) |
| Task | Model | MAE | Within-subject | |
| PPV | CARMEN-Large | 2.38 (2.16–2.61) | 0.625 | 0.468 |
| CARMEN-Base | 2.52 (2.27–2.80) | 0.547 | 0.425 | |
| CARMEN-Small | 2.54 (2.30–2.80) | 0.548 | 0.431 | |
| MOMENT | 2.80 (2.52–3.11) | 0.436 | 0.375 | |
| NormWear | 2.83 (2.56–3.14) | 0.384 | 0.346 | |
| SPOTR | 3.20 (2.93–3.49) | 0.244 | 0.132 |
| Task | Model | MAE | AUROC (95% CI) | |
| Age | CARMEN-Large | 6.28 (6.03–6.54) | 0.743 | — |
| CARMEN-Base | 6.38 (6.11–6.64) | 0.732 | — | |
| CARMEN-Small | 6.58 (6.31–6.85) | 0.718 | — | |
| MOMENT | 6.97 (6.68–7.25) | 0.658 | — | |
| NormWear | 7.21 (6.92–7.51) | 0.645 | — | |
| SPOTR | 8.26 (7.94–8.56) | 0.545 | — |
| Category | Hyperparameter | Value |
| Patch | Patch size | 25 (0.25 s) |
| Stride | 25 (non-overlapping) | |
| Residual MLP hidden dim | 50 ( ) | |
| GLU FFN hidden dim | 2048 (Base; rounded to a multiple of 8; Small 1,368, Large 2,736) 56 | |
| Data pipeline | Record window / crop range | 300 s / 10 s – 300 s |
| Context length (bin width) | Phase 1: 32,000 samples (1,280 tokens) / Phase 2: 48,000 samples (1,920 tokens) |
Time-Series Foundation Models
Time-series foundation models are pretrained sequence models designed to transfer across forecasting, classification, anomaly detection, and other temporal tasks.
See all 345 papers