AI Generalisation Gap In Comorbid Sleep Disorder Staging
Organizations: International Institute of Information Technology (IIIT-H), Hyderabad, India · Queen Square Institute of Neurology, University College London, United Kingdom · National Institute of Mental Health and Neuroscience (NIMHANS), Bangalore, India · Alan Turing Institute, London and University College London, United Kingdom
Abstract
Accurate sleep staging is essential for diagnosing OSA and hypopnea in stroke patients. Although PSG is reliable, it is costly, labor-intensive, and manually scored. While deep learning enables automated EEG-based sleep staging in healthy subjects, our analysis shows poor generalization to clinical populations with disrupted sleep. Using Grad-CAM interpretations, we systematically demonstrate this limitation. We introduce iSLEEPS, a newly clinically annotated ischemic stroke dataset (to be publicly released), and evaluate a SE-ResNet plus bidirectional LSTM model for single-channel EEG sleep staging. As expected, cross-domain performance between healthy and diseased subjects is poor. Attention visualizations, supported by clinical expert feedback, show the model focuses on physiologically uninformative EEG regions in patient data. Statistical and computational analyses further confirm significant sleep architecture differences between healthy and ischemic stroke cohorts, highlighting the need for subject-aware or disease-specific models with clinical validation before deployment. A summary of the paper and the code is available at https://himalayansaswatabose.github.io/iSLEEPS_Explainability.github.io/
Figures & tables
| Datasets | Model | Overall Results | ||
| ACC | MF1 | |||
| SleepEDF-20 (Healthy Cohort) | NAS [ 4 ] | 82.7 | 75.9 | 0.76 |
| DeepSleepNet [ 10 ] | 82.0 | 76.9 | 0.76 | |
| XSleepNet2 [ 7 ] | 83.9 | 78.7 | 0.77 | |
| SleepContextNet [ 13 ] | 84.8 | 79.8 | 0.79 | |
| SEResnet-Transformer [ 5 ] | 79.3 | 74.7 | 0.72 | |
| Dataset | W | N1 | N2 | N3 | REM |
| SleepEDF-20 | 92.0 | 56.9 | 89.9 | 87.9 | 85.9 |
| SleepEDF-78 | 92.1 | 50.1 | 85.2 | 82.1 | 82.1 |
| SHHS | 89.1 | 54.4 | 89.2 | 87.9 | 88.9 |
| iSLEEPS | 79.9 | 32.9 | 80.9 | 74.2 | 70.6 |
Sleep Stage Classification
Sleep stage classification assigns sleep epochs to physiological stages from signals such as EEG, helping quantify sleep architecture and support clinical monitoring.
See all 40 papers