ThinkNet: Compact Architecture Selection and Validation-Gated Ensembles for Subject-Independent MI-EEG Decoding
Organizations: eBRAIN Lab, Division of Engineering New York University (NYU) Abu Dhabi, Abu Dhabi, UAE
Abstract
Practical assistive and rehabilitative brain--computer interfaces require subject-independent motor-imagery EEG (MI-EEG) decoders that generalize to new users under limited target-user data and constrained compute. However, held-out-subject performance can be overstated when test-subject information influences preprocessing, model selection, or ensemble selection. We present \textit{ThinkNet}, a validation-controlled framework that combines train-only normalization, validation-guided evolutionary search, and validation-gated inference to identify compact decoders and inference policies for held-out subjects. We evaluate four-class BCI Competition IV-2a (session T) decoding with nine Leave-One-Subject-Out (LOSO) folds, three seeds, seven fixed decoder entries, and a broader search over ten representative decoder families; the held-out subject is never used for normalization, hyperparameter, architecture, or ensemble-policy selection. In the fixed benchmark, the validation-selected compact decoder achieved 44.3515.41% accuracy with 4.9K parameters, 19 KB FP32 weights, and 0.99 ms batch-1 Orin CUDA inference. Across the broader search, compact models (25K parameters) achieved higher mean held-out accuracy than mid-size and large alternatives after selected retraining (40.10% vs. 35.09% and 34.78%). Validation-gated ensembling improved over validation-selected single-model inference, reaching 43.9816.25% in the fixed benchmark and 43.3115.88% for the compact six-family ensemble. A non-deployable oracle analysis revealed a 6.1-point family-selection gap and near-zero validation--test correlation, showing that validation reliability remains a key bottleneck under subject shift. Thus, ThinkNet is a validation-controlled framework for compact MI-EEG model and inference-policy selection, rather than a single-architecture benchmark.
Figures & tables
| Method family | Compact | SI/LOSO | Search/sel. | Sel.-gap |
|---|---|---|---|---|
| CSP/FBCSP, Riemannian [ 6 , 7 ] | ||||
| Compact/temporal CNNs [ 5 , 9 ] | ||||
| Filter-bank/attention/conformer models [ 11 , 12 , 13 , 14 ] | ||||
| Transfer/domain adaptation [ 4 , 15 , 16 ] | ||||
| EEG NAS / general ensembles [ 17 , 18 , 19 ] | ||||
| ThinkNet |
| Frozen model | Params | Acc. (%) |
|---|---|---|
| Reference EEGNet | 2.8K | 67.33 |
| Submitted compact | 5.4K | 65.22 |
| EEG-TCNet | 4.7K | 65.44 |
| CNN | 1.26M | 61.54 |
| Transformer | 804K | 64.57 |
| Model | Params | Mem. | Orin ms | Test Acc. (%) |
|---|---|---|---|---|
| ThinkNet compact | 4.9K | 19 KiB | 0.99 | 44.35 15.70 |
| EEGNet baseline | 2.9K | 11 KiB | 0.98 | 44.06 16.04 |
| EEG-TCNet | 4.0K | 16 KiB | 2.73 | 41.13 14.81 |
| CNN | 1.27M | 4.9 MiB | 1.84 | 40.17 13.78 |
| Shallow ConvNet | 39.5K | 154 KiB | 0.56 | 38.77 11.89 |
| EEG-Inception | 1.23M | 4.8 MiB | 7.23 | 38.30 11.61 |
| Operating point | Params | MiB | ms |
|---|---|---|---|
| Validation-best individual | 18.0K | .069 | 2.24 |
| Compact-six logit avg. | 64.1K | .244 | 9.41 |
| Full-ten logit avg. | 464.9K | 1.773 | 20.98 |
| Full-ten realized gate | – | – | 12.15 |