Neural Decoding as Cognitive Inference
Organizations: Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China. · University of Chinese Academy Sciences, Beijing, China. · Department of Computing, The Hong Kong Polytechnic University, Hong Kong. · Department of Mathematics, Hong Kong Baptist University, Hong Kong.
Abstract
The brain maintains stable cognition despite continuously changing neural activity. How to extract stable cognitive states from variable neural observations remains a central problem in neural decoding. Existing neural decoding methods map neural observations to predefined external labels based on the stimulus-response principle, often capturing recording-specific spurious correlations. Inspired by how the brain infers the world, and specifically by Bayesian brain theory, we recast neural decoding as cognitive inference constrained by brain-intrinsic priors, yielding high-level meta-neural semantic representations. In decoding experiments spanning five neural recording modalities and three cognitive domains (motor, perception and internal mentation), our cognitive inference method reorganized the geometry of neural observation representations, yielding meta-neural semantic representations that exhibited consistent geometric relationships across cognitive tasks and enabled the recovery of stable cognitive states from variable neural observations. Our work provides an account of how the brain maintains relatively stable cognition despite continual changes in the external environment. Cognitive stability is sustained through cognitive inference from changing neural activity, without requiring fixed neural activity patterns.
Figures & tables
| No. | Dataset | Modality | Task | Ref. | |
|---|---|---|---|---|---|
| 1 | FACED | EEG | 123 | Affective video viewing | 11 |
| 2 | SEED-V | EEG | 16 | Affective video viewing | 42 |
| 3 | BCIC-IV-2a | EEG | 9 | Motor imagery | 9 |
| 4 | SHU-MI | EEG | 25 | Motor imagery | 44 |
| 5 | TUEV | EEG | 518 | Clinical EEG event classification | 23 |
| 6 | SomatoMotor | MEG + EEG | 5 | Somatosensory stimulation | 39 |