ICare-DT: a digital twin for continuous forecasting of intensive care patients
Organizations: SCAI Lab, Department of Health Science and Technology, ETH Zurich, Switzerland · Swiss Paraplegic Research, Nottwil, Switzerland · Department of Statistical Sciences, University of Toronto, Canada
Abstract
Digital twins of intensive care patients should update forecasts from new data and predict treatment responses, but few studies test whether routine records support either. We propose ICare-DT, a Transformer-based twin that updates a latent patient state hourly from new measurements without retraining. We trained it on 140,473 eICU-CRD stays to forecast vital signs crossing their training-set means. On test data, later forecasts beat the twin's own hour-6 forecasts of the same windows in all 12 settings (+0.073 to +0.153 AUROC). On validation data, controls that withheld or swapped the new hours traced the gain to the patient's own measurements. Without refitting, the model kept its gain on a second database (8 of 9 settings, +0.025 to +0.114 AUROC) in a prespecified evaluation of the previously analyzed MIMIC-IV test split. Refitted within MIMIC-IV, a twin state fine-tuned on clinical endpoints gave gradient boosting a significant gain for acute kidney injury (+0.0035 AUROC; hypotension +0.0010, not significant). To test response prediction, we built a benchmark that replaces the treatments in real records with simulated doses and injects responses of known size, visible only at measurement times. Ridge models supervised with injected effects recovered them from real records only through frequently measured variables (heart rate) read at their measurement times. We asked standard learners to predict these effects for a dosing regime no patient had received. No standard learner outperformed predicting zero effect at an out-of-support query. When told how the simulated responses were generated, a separate learner recovered the effects from the same records without seeing their true values (R2 0.30 to 0.40 at one effect size). Routine records support forecasts that improve with each patient's new data, and our benchmark is a testbed for models that learn how responses are generated.
Figures & tables
| Cohort or split | Stays | Patients | Role in this study |
|---|---|---|---|
| eICU-CRD (208 hospitals) | 200,825 | 139,362 | Model training and all analyses except the MIMIC-IV read |
| Training split | 140,473 | 97,553 | Model training; clinical-endpoint probes (Supplementary Fig. S3) |
| Fitting set | 119,330 | 82,946 | Fitting of the endpoint probes |
| Tuning set | 21,143 | 14,607 | Scoring of the endpoint probes |
| Validation split | 30,213 | 20,904 | Checkpoint selection; control inputs and gradient-boosted comparison (read before) |
| Test set | 30,099 | 20,886 | Hour-48 forecasts, synchronization and last-value comparison (read before) |
| Analysis (status) | Data | Decision rule | Outcome |
|---|---|---|---|
| Forecasting | |||
| Hour-48 forecasts (registered; death forecast descriptive) | eICU-CRD test set, hour 48 | All 17 settings and five seeds reported; nothing fitted on test data | AUROC 0.646 to 0.820 (threshold crossings, 16 settings), 0.798 (death in the unit within 48 h); mean death forecast far below the observed rate, in part by construction |
| MIMIC-IV, death and unit-exit forecasts (disclosed secondaries) | MIMIC-IV test set, hour 48 | Frozen eICU-CRD weights; hospital death and leaving the unit; all 6 settings reported; no criterion | AUROC 0.687 (hospital death, unit exit within 48 h), 0.726 (hospital death), 0.765 (leaving the unit within 48 h); calibration in the text |
| Synchronization (registered) | eICU-CRD test set | Synchronized vs hour-6 forecast in stays with the target measured every hour through the label window (592 to 6,648 stays per setting), Holm over 12 settings | 12/12 settings, +0.073 to +0.153 AUROC |
| Last-value comparison (disclosed) | eICU-CRD test set | Synchronized vs the patient’s last measured value on the same stays, Holm over 12 settings | 11/12 settings, median +0.044 AUROC (range +0.010 to +0.085) |
| Gradient-boosted comparator (prospective protocol) | eICU-CRD validation split | Twin forecasting heads (seed-29 checkpoint) vs multivariate CatBoost on the same rows, Holm over 120 contrasts; CatBoost with the twin state added vs CatBoost alone, Holm over 36 contrasts | Heads: median 0.012 AUROC, worse in 3/12 settings after correction; state added: median +0.004 AUROC, no AUROC gain after correction |
| Analysis (status) | Data | Decision rule | Outcome |
|---|---|---|---|
| Clinical-endpoint probes | |||
| Endpoint probe P0, frozen state (registered) | eICU-CRD tuning set | Frozen state boosting on 2/4 endpoints, or within 0.02 of it on 3/4, or a gain with interval above 0 from adding the state to boosting on 2/4 | Not met: state 0.020 to 0.086 below boosting; gain from adding it to boosting +0.0014, no interval above 0 |
| Endpoint probe P1, encoders trained on the endpoints (registered) | eICU-CRD tuning set | Better encoder within 0.01 of boosting on 3/4 endpoints, or hybrid gain +0.005 with interval above 0 on 2/4 | Not met (near threshold): hybrid +0.0042 (hypotension) and +0.0075 (acute kidney injury), intervals above 0; better encoder (from random initialization) 0.004 to 0.021 below boosting |
| MIMIC-IV, endpoint probes (registered) | MIMIC-IV test set | Hybrid vs boosting on hypotension and acute kidney injury, refitted within MIMIC-IV, one-sided, Holm over 2 | Acute kidney injury only: +0.0035; hypotension +0.0010 |
| Analysis (status) | Data | Decision rule | Outcome |
|---|---|---|---|
| Semi-synthetic data and individual treatment effects | |||
| Realism audit (locked) | Semi-synthetic dataset | Discriminator AUC 0.75 and all summary checks | Pass: AUC 0.572 |
| Washout-panel realism audit (registered, after all but two of the panels’ other analyses) | Three washout panels | Locked audit per panel: AUC 0.75 and all summary checks | Pass in 3/3: AUC 0.714 to 0.727, but the audit did not flag added measurement noise of 0.15 reference SD (weak evidence); other sensitivity controls not detected or not run |
| Recoverability map (exploratory) | 400 eICU-CRD stays, three treatment-response pairs | A reader clears the bar ( ) and, if the history-blind reader also clears it, beats that reader | At real cadence, of the mapped readers only the cadence-aware reader cleared the bar, and so separated: on heart rate (value changes in 57% of hours) for both drugs at amplitudes of 0.75 and 1 SD ( at 1 SD). At real cadence, none cleared it on creatinine (value changes in 4% of hours) |
| Registered cell, cadence-aware reader (registered after exploration) | Three washout panels | Clears the bar ( ) and, if the history-blind reader also clears it, beats that reader | Separated in the discovery panel ( ) and in a replication panel of 400 stays, 395 of them new, carrying nearly identical injected effects ( ); did not separate on the fixed schedule ( , interval reaching below the bar) |
| Analysis (status) | Data | Decision rule | Outcome |
|---|---|---|---|
| Semi-synthetic data and individual treatment effects (continued) | |||
| Static CATE learners (registered) | Registered cell (decision query outside the support) | 13 learners vs the oracle-structure learner, Holm over 78 comparisons | Oracle-structure learner: 77 wins, 0 losses, 1 unresolved; no learner beats zero |
| Sequence CATE models (registered) | Registered cell (decision query outside the support) | Causal Transformer, RMSN and CRN vs the oracle-structure learner, Holm over 18 comparisons | Oracle-structure learner: 12 wins, 0 losses, 6 unresolved (the comparisons with the excluded CRN); no model beats zero |
| G-computation model (registered) | Registered cell | Holm over 6 comparisons vs oracle-structure learner; Holm over 2 vs predicting zero | Oracle-structure learner: 6 wins, 0 losses, 0 unresolved; G-Net (Causal Transformer code) does not beat zero |
| In-support query control (registered) | Two panels, hours 30 and 42 | Each learner vs predicting zero, Holm over 64; vs oracle-structure learner, Holm over 128 | No hour met the overlap criteria |
| ICare-RH placebo gate (registered) | Three washout panels and their zero-effect copies | Label-free lag and placebo-spread rules, checked before any target was read | Not met at the label-free stage; no target read, so ICare-RH was not scored on real records |
Appendix figures & tables17 assets
Supplementary material from the paper’s appendix.
Appendix
| Analysis | Protocol and result | Jobs |
|---|---|---|
| Joint model training | Corrected competing-event model, five seeds; validation-only checkpoint selection | (before protocol registration began); selection 5255 |
| Joint forecasts, test set (registered) | PHASE1_TEST_ANALYSIS_PLAN (locked before the read) and all-results receipt; Supplementary Note 6 | 5276, 5293, 5312 (verification) |
| Subgroups and decision curves, test set (descriptive) | JOINT_FACTUAL_STRATIFIED_20260918 ; ethnicity re-read; Supplementary Tables S7 and S8 | 10545; 10697 |
| Further single-seed reads under the same plan (registered) | Earlier synchronization contrast (superseded) and frozen-state probe versus LightGBM; Supplementary Note 6 | 5264, 5275; 5265 |
| Synchronization, test set (registered) | State-synchronization v2 lock and release review; re-run without the hour-30 condition | 10707, 10708; 10755, 10937 |
| Last-value comparison (disclosed) | Landmark last-value baseline | 10754 |
| Outcome | Phenylephrine | NaCl | Norepinephrine | Dextrose | FiO 2 |
|---|---|---|---|---|---|
| Mean arterial pressure | 0 | +0.415 | +0.269 | +0.255 | 0 |
| SpO 2 | 0 | +0.765 | 0 | +0.122 | +0.119 |
| Lactate | 0 | -0.291 | 0 | -0.175 | -0.466 |
| Heart rate | -0.230 | 0 | -0.228 | 0 | -0.121 |
| Respiratory rate | 0 | -0.261 | -0.270 | -0.145 | 0 |
| Urine output | 0 | +0.437 | +0.111 | +0.636 | +0.019 |
| Generated dataset | Washout panels | |
|---|---|---|
| Records | All 200,825 eICU-CRD stays, first 336 hours | 400 eICU-CRD windows per panel, hours 24 to 163 |
| Channels | 12 outcome channels written; all 161 channels kept | 12 outcome channels read |
| Standardization | Cohort normalization statistics | Fixed reference values (heart rate 85 and 15 beats per minute) |
| Missing cells | Mean-filled for simulation; real missingness restored | Filled with reference means; not restored |
| Treatments | Recorded doses (indicator drives the model) | Simulated binary dosing of one treatment |
| Background scale | 0.02 | 1 |
| Target | S2 | S1 | S2 S1 | S1 IC | S1 IC-A | S1 IC-O | S1 SH | S2 IC | ||
|---|---|---|---|---|---|---|---|---|---|---|
| SaO 2 | (12, 6) | 6206 | 0.739 | 0.661 | 0.077 | 0.010 ∗ | 0.013 | 0.012 | 0.044 | 0.088 |
| SaO 2 | (18, 12) | 3579 | 0.733 | 0.641 | 0.092 | 0.008 | 0.011 | 0.008 | 0.045 | 0.100 |
| SaO 2 | (30, 24) | 1650 | 0.694 | 0.580 | 0.114 | 0.010 | 0.019 | 0.015 | 0.036 | 0.124 |
| SpO 2 | (12, 6) | 2582 | 0.730 | 0.651 | 0.079 | 0.010 | 0.028 | 0.019 | 0.049 | 0.090 |
| SpO 2 | (18, 12) | 1395 | 0.735 | 0.669 | 0.066 | 0.013 | 0.038 | 0.023 | 0.045 | 0.080 |
| SpO 2 | (30, 24) | 551 | 0.693 | 0.576 | 0.117 | 0.025 | 0.033 | 0.024 | 0.014 | 0.142 |
| Target | Ratio | R1 | R2 | Share | Gap | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| SaO 2 | (12, 6) | 0.268 | 0.498 | 0.248 | 0.437 | 0.154 | 0.885 | 0.070 | 0.020 | 0.205 | 0.013 |
| SaO 2 | (18, 12) | 0.394 | 0.501 | 0.211 | 0.458 | 0.127 | 0.878 | 0.051 | 0.010 | 0.114 | 0.018 |
| SaO 2 | (30, 24) | 0.565 | 0.424 | 0.097 | 0.375 | 0.074 | 1.084 | 0.071 | 0.009 | 0.242 | 0.026 |
| SpO 2 | (12, 6) | 0.340 | 0.491 | 0.220 | 0.385 | 0.098 | 0.943 | 0.077 | 0.031 | 0.319 | 0.004 |
| SpO 2 | (18, 12) | 0.490 | 0.510 | 0.273 | 0.334 | 0.082 | 0.939 | 0.095 | 0.059 | 0.447 | 0.003 |
| SpO 2 | (30, 24) | 0.664 | 0.414 | 0.134 | 0.304 | 0.020 | 0.985 | 0.056 | 0.017 | 0.299 | 0.071 |
| Generator version | Audit AUC | TV (any law) | (Gaussian) | TV (Gaussian) |
|---|---|---|---|---|
| No correction (probe) | 0.963 | 0.727 | 2.525 | 0.793 |
| Measurement hold only (probe) | 0.956 | 0.704 | 2.417 | 0.773 |
| Treatment missingness only (probe) | 0.767 | 0.317 | 1.029 | 0.393 |
| Both corrections (probe) | 0.641 | 0.152 | 0.510 | 0.201 |
| Both corrections (full dataset) | 0.572 | 0.074 | 0.255 | 0.101 |
| Tolerance | 0.750 | 0.292 | 0.953 | 0.366 |
| Heart rate | Creatinine | |||
| proxy | panel rate | proxy | panel rate | |
| Median retention | 0.806 | 0.607 | 0.048 | 0.036 |
| Mean retention | 0.702 | 0.610 | 0.070 | 0.058 |
| Patients with (%) | 2 | 2 | 51 | 59 |
| Energy in intervals with (%) | 10.8 | 13.7 | 72.1 | 70.6 |
| Energy after the last draw (%) | 0.5 | 0.6 | 12.8 | 17.3 |
| Phenylephrine | Norepinephrine | NaCl | |
| on heart rate | on heart rate | on creatinine | |
| Crossing persistence (single carrier) | 0.642 | 0.640 | 0.642 |
| Hourly records | |||
| Single carrier, calibrated persistence | 0.55 | 0.54 | 0.90 |
| Twelve channels | 0.46 | 0.53 | 0.46 |
| Observed ( ) | 0.70 | 1.01 | 1.02 |
| Learner | Panel | Beats zero | ||||
|---|---|---|---|---|---|---|
| Oracle-structure learner | Disc. | 0.550 | 0.580 | 0.664 | 0.001 | yes |
| Repl. | 0.528 | 0.645 | 0.584 | 0.014 | yes | |
| Fixed | 0.526 | 0.550 | 0.697 | 0.001 | yes | |
| Linear response model (structure given) | Disc. | 0.556 | 0.581 | 0.662 | 0.001 | yes |
| Repl. | 0.536 | 0.645 | 0.584 | 0.012 | yes | |
| Fixed | 0.531 | 0.556 | 0.691 | 0.001 | yes |
| Discovery | Replication | Fixed schedule | |
|---|---|---|---|
| 0.0068 | 0.0419 | 0.0703 | |
| (limit 0.05) | 0.0071 | 0.0179 | 0.0450 |
| (limit 0.25) | 1.045 | 0.428 | 0.640 |
| Decay at bound, active copy (folds) | 5/5 | 5/5 | 1/5 |
| Decay at bound, zero-effect copy (folds) | 5/5 | 5/5 | 3/5 |
| Median query contrast, active copy (range over folds) | 0.012–0.048 | – | – |
| Stage | Stays | Patients | Restriction or note |
|---|---|---|---|
| Raw ICU stays | 356,849 | – | eICU-CRD 200,859; MIMIC-III 61,532; MIMIC-IV 94,458 |
| Harmonized stays | 356,815 | – | BlendedICU harmonization; 34 eICU-CRD stays removed |
| Experimental cohort | 323,677 | – | eICU-CRD 200,825; MIMIC-IV 94,458; MIMIC-III 28,394 CareVue stays of 23,692 patients not in MIMIC-IV (from 61,532 stays of 46,476 patients) |
| eICU-CRD (208 hospitals) | 200,825 | 139,362 | Split by patient |
| Training split | 140,473 | 97,553 | |
| Validation split | 30,213 | 20,904 |
| Setting | Seed | S2 | S1 | S1-adm | LOCF | S2 S1 | S2 LOCF |
|---|---|---|---|---|---|---|---|
| SpO 2 (12, 6) | 13 | 0.604 | 0.574 | 0.556 | 0.675 | +0.030 | 0.071 |
| 17 | 0.576 | 0.562 | 0.542 | 0.675 | +0.014 | 0.099 | |
| 23 | 0.594 | 0.564 | 0.551 | 0.675 | +0.031 | 0.081 | |
| 29 | 0.593 | 0.569 | 0.560 | 0.675 | +0.024 | 0.083 | |
| 31 | 0.590 | 0.562 | 0.537 | 0.675 | +0.028 | 0.085 | |
| Five-seed mean | 0.592 | 0.566 | 0.549 | 0.675 | +0.025 | 0.084 |
| ID | Record | Jobs | Date | What was read on the MIMIC-IV test split |
|---|---|---|---|---|
| REG-5227 | TEST_READ_REGISTRY.md:14 | 5227 (re-export of the job-2754 aggregate) | 2026-08-09 | previously opened Track B aggregate cells (mortality, LOS) |
| REG-C01 | TEST_READ_REGISTRY.md:24 | 5896-5898 | 2026-08-10 | mortality at 24 h of MIMIC-IV fine-tunes of the same joint lineage (parent seed 29, selection 744fe1a1 ); C01 preparation also read TEST features for eligibility |
| TRB-M4-01 | :66 | not recorded | 2026-05-23 to 05-27 | mortality and LOS at 6/12/24/48 h; legacy onsets (AKI, hypotension, hypoxemia, lactate, vasopressor start) |
| TRB-M4-02 | :67 | 2674 | 2026-06-05 | legacy events (SBP 90, SpO 2 90, HR 130); legacy onsets; mortality; LOS |
| TRB-M4-03 | :68 | 2694 | 2026-06 | as TRB-M4-02 (metrics at least) |
| TRB-M4-04 | :69 | 2731 | 2026-06-10 | legacy events and onsets; mortality 6 and 24 h; LOS |
| Registry row | Date (2026) | Analysis | Results |
|---|---|---|---|
| TRB-M4-01 | 23 to 27 May | Baselines and early model variants: mortality, length of stay and legacy onsets | Outputs only |
| TRB-M4-05 | 7 to 14 June | eICU-pretrained model with its head fine-tuned on each database, against the same model trained from random initialization; conventional baselines; mortality and length of stay at 6 to 48 hours | Note 8 (withdrawn) |
| TRB-M4-06 | 15 June | Outcome-regression head of an earlier model version on each database; future values of the regression targets | Internal notes |
| TRB-M4-07 | June | Frozen eICU-trained A0_dyn applied without fine-tuning, with and without online weight adaptation | Internal notes |
| TRB-M4-08 | June | A0_dyn fine-tuned on 1% to 100% of the MIMIC-III training split, with and without online weight adaptation | Note 8 |
| TRB-M4-09 | 3 July | XGBoost, LSTM, GRU-D and Transformer trained, calibrated and tested within each database; 28 tasks | Internal notes |
Digital Twins
Digital twins are virtual models synchronized with real systems to support monitoring, prediction, simulation, and decision-making.
See all 274 papers