Parameter-Efficient Self-Supervised Adaptation for EEG-FM under Fixed Computational Budgets
Organizations: University of Tübingen, Germany · Hertie Institute for AI in Brain Health (Hertie AI), Tübingen, Germany · Dept. of Neurology and Epileptology, University Clinic Tübingen, Germany · Hertie Institute for Clinical Brain Research, Tübingen, Germany
Abstract
EEG foundation models pretrained via self-supervised learning promise transferable representations, but their generalization remains limited, especially across diverse clinical datasets. Full fine-tuning is impractical for resource-constrained clinical settings due to high computational requirements. In this work, we investigate whether parameter-efficient self-supervised adaptation, updating only 9% of parameters suffices to align representations to target tasks. We evaluate our method on two state-of-the-art models with different pretraining objectives: BIOT (contrastive) and CBraMod (masked reconstruction), and evaluate on three clinical EEG datasets for abnormality detection (TUAB), event classification (TUEV), and seizure detection (CHB-MIT) under both in-distribution and out-of-distribution conditions. SSL adaptation yields consistent gains over linear probing, up to 20x AUCPR. Under a fixed compute budget, peak performance requires only 20--50% of available unlabeled data. Critically, when total window count is fixed, performance remains invariant to patient count, suggesting that performance is dependent on overall temporal window diversity only. Our findings demonstrate that parameter-efficient adaptation enables effective deployment of EEG Foundation models (EEG-FM) with minimal computational overhead and data collection burden. Code available at: https://github.com/c3n-group/efficient-eeg-adapt
Figures & tables
| Dataset | Method | Bal. ACC | AUCPR / Kappa | AUCROC / F1 |
|---|---|---|---|---|
| BIOT ( , ) | ||||
| TUEV | LP | 30.52 1.21 | 33.86 2.84 | 65.87 1.64 |
| SA | 31.78 0.46 +1.26 | 40.45 1.41 +6.59 | 69.43 0.63 +3.56 | |
| TUAB | LP | 63.93 0.15 | 74.97 0.13 | 75.08 0.11 |
| SA | 70.86 0.23 +6.93 | 77.39 0.24 +2.42 | 78.34 0.26 +3.26 | |
| CHB-MIT | LP | 50.74 0.21 | 1.53 0.03 | 46.93 0.30 |
| Model | Layers | Param. | AUCROC | AUCPR | Bal. Acc |
|---|---|---|---|---|---|
| BIOT | 0.92M | 88.67 | 35.62 | 60.62 | |
| 1.71M | 88.44 | 35.05 | 60.82 | ||
| All | 3.19M | 88.60 | 36.79 | 62.18 | |
| CBRAMOD | 0.44M | 87.16 | 31.25 | 67.60 | |
| 0.84M | 86.62 | 21.90 | 58.69 | ||
| All | 4.4M | 88.20 | 29.41 | 50.98 |
EEG Foundation Models
Electroencephalography (EEG) foundation models learn reusable representations of brain signals for transfer across people, tasks, and recording setups.
See all 100 papers