Benchmarking Label-Revealed Online Updates for EEG BCI Decoding
Organizations: Independent Researcher, France · Independent Researcher, Germany · School of Information Technology, York University, Toronto, Canada
Abstract
Electroencephalography (EEG) signals drift over time, which can cause static brain-computer interface (BCI) models to degrade in practice. We present a benchmark for online adaptation and compare two widely used pipeline families, Common Spatial Patterns (CSP) and Riemannian covariance-based methods, under time-ordered prequential (test-then-train) evaluation. We examine (i) which pipelines benefit most from label-revealed updates, (ii) whether controlled forgetting of older data improves robustness, and (iii) how a minimal-calibration cold start compares with starting from a pretrained model. Across four datasets (three motor-imagery datasets and one movement-decoding dataset), label-revealed online updates improve 13 of 14 model/dataset pairs on the two largest streams, with relative accuracy gains of up to about 18% over a frozen model. A Shapley-based data-valuation analysis over temporal blocks assigns the largest mean value to the most recent block in each of the three analyzed datasets, while older blocks retain positive value.
Figures & tables
| ACM+TS+SVM | FBCSP | |||
|---|---|---|---|---|
| Metric | Frozen | Online refit | Frozen | Online refit |
| Final | 0.689 | 0.767 | 0.639 | 0.673 |
| Final | 0.644 | 0.760 | 0.627 | 0.649 |