Unsupervised domain transfer: Overcoming signal degradation in sleep monitoring by increasing scoring realism
Organizations: Department of Electrical and Computer Engineering, Aarhus University, Denmark
Abstract
Objective: Investigate whether hypnogram 'realism' can be used to guide an unsupervised method for handling arbitrary types of signal degradation in mobile sleep monitoring. Approach: Combining a pretrained, state-of-the-art 'u-sleep' model with a 'discriminator' network, we align features from a target domain with a feature space learned during pretraining. To test the approach, we distort the source domain with realistic signal degradations, to see how well the method can adapt to different types of degradation. We compare the performance of the resulting model with best-case models designed in a supervised manner for each type of transfer. Main Results: Depending on the type of distortion, we find that the unsupervised approach can increase Cohen's kappa with as little as 0.03 and up to 0.29, and that for all transfers, the method does not decrease performance. However, the approach never quite reaches the estimated theoretical optimal performance, and when tested on a real-life domain mismatch between two sleep studies, the benefit was insignificant. Significance: 'Discriminator-guided fine tuning' is an interesting approach to handling signal degradation for 'in the wild' sleep monitoring, with some promise. In particular, what it says about sleep data in general is interesting. However, more development will be necessary before using it 'in production'.
Figures & tables
| Dataset | Subjects | Records | Dataset | Subjects | Records | |
|---|---|---|---|---|---|---|
| ABC | 49 | 132 | CCSHS | 515 | 515 | |
| CFS | - | 730 | DCSM | 255 | 255 | |
| DOD-H | 25 | 25 | DOD-O | 55 | 55 | |
| EESM19 | 20 | 200 | HOMEPAP | - | 233 | |
| ISRUC-SG1 | 100 | 91 | ISRUC-SG2 | 8 | 6 | |
| ISRUC-SG3 | 10 | 10 | MASS-C1 | 53 | 40 |
| Metric | Model | EEG | EOG |
|---|---|---|---|
| Pretrained model | 0.23 | 0.02 | |
| Finetuned model | 0.42 | 0.18 | |
| (Fine–Pre) | 0.29 | 0.16 | |
| p-value | |||
| Accuracy | Pretrained model | 0.46 | 0.31 |
| Finetuned model | 0.60 | 0.42 |
| Frequency (Hz) | ||||
|---|---|---|---|---|
| Metric | Model | 20 | 25 | 30 |
| Pretrained | 0.30 | 0.29 | 0.28 | |
| Fine-tuned | 0.41 | 0.38 | 0.36 | |
| (Fine–Pre) | 0.11 | 0.09 | 0.08 | |
| p-value | ||||
| Accuracy | Pretrained | 0.49 | 0.48 | 0.48 |
| Low-cut frequency (Hz) | |||||
|---|---|---|---|---|---|
| Metric | Model | 1 | 5 | 7 | 10 |
| Pretrained | 0.68 | 0.36 | 0.33 | 0.27 | |
| Fine-tuned | 0.71 | 0.52 | 0.47 | 0.42 | |
| (Fine–Pre) | 0.03 | 0.16 | 0.15 | 0.15 | |
| p-value | |||||
| Accuracy | Pretrained | 0.77 | 0.55 | 0.53 | 0.45 |
| Class | Support | Pretrained Model | pre-trained Model | ||||
|---|---|---|---|---|---|---|---|
| Precision | Recall | F1-score | Precision | Recall | F1-score | ||
| W | 27467 | 0.5593 | 0.5485 | 0.5538 | 0.5940 | 0.6161 | 0.6048 |
| N1 | 6664 | 0.2412 | 0.2758 | 0.2574 | 0.2420 | 0.2938 | 0.2654 |
| N2 | 45262 | 0.5674 | 0.6449 | 0.6037 | 0.6203 | 0.6547 | 0.6370 |
| N3 | 16756 | 0.6886 | 0.2730 | 0.3910 | 0.7630 | 0.4530 | 0.5685 |
| REM | 14221 | 0.3508 | 0.4371 | 0.3892 | 0.4245 | 0.4796 | 0.4504 |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
Unsupervised Domain Adaptation
Unsupervised domain adaptation transfers models from labeled source data to unlabeled target domains with different data distributions.
See all 183 papers