iBrain: A Unified Foundation Model Reading the Brain from Surface to Spikes
Organizations: Chinese Institute for Brain Research
Abstract
Invasive neural recordings provide high-fidelity measurements of brain activity, with signals such as intracranial EEG (iEEG) and intracortical spiking activity capturing neural dynamics at different spatial and temporal scales. Yet existing neural foundation models have largely been developed independently for different invasive recording paradigms, leaving joint pretraining across heterogeneous invasive signals underexplored. In this work, we introduce iBrain, a unified foundation model that jointly learns from iEEG and spiking activity. iBrain employs signal-specific encoders to accommodate their distinct signal characteristics and a shared spatiotemporal Transformer backbone to model dependencies across recording channels and time. We pretrain iBrain on over 7,000 hours of heterogeneous neural recordings using masked signal reconstruction and channel-view alignment, promoting contextual modeling of neural dynamics and robustness across different channels. iBrain consistently outperforms single-signal pretraining baselines and achieves state-of-the-art performance on multiple benchmarks. Further experiments demonstrate that iBrain exhibits transferability and data efficiency across diverse recording settings. These results highlight the potential of joint pretraining on heterogeneous invasive neural recordings to support scalable neural modeling and transferable representations across recording settings and downstream tasks.
Figures & tables
| Dataset | Pitch | Volume | Onset | Speech | MC-Maze | Area2-Bump | Perich T-CO | Perich T-RT |
|---|---|---|---|---|---|---|---|---|
| iEEG only | 0.68 | 0.85 | 0.84 | 0.86 | – | – | – | – |
| Spike only | – | – | – | – | 0.89 | 0.89 | 0.77 | 0.64 |
| iEEG + Spike | 0.68 | 0.89 | 0.86 | 0.89 | 0.91 | 0.90 | 0.79 | 0.69 |
| Model | MC-Maze | Area2-Bump | ||
|---|---|---|---|---|
| Fine-tune | Frozen | Fine-tune | Frozen | |
| Full | 0.914 | 0.904 | 0.903 | 0.867 |
| w/o channel align. | 0.893 | 0.872 | 0.886 | 0.855 |
| w/o channel attn. | 0.889 | 0.881 | 0.875 | 0.842 |
| w/o time attn. | 0.901 | 0.902 | 0.874 | 0.850 |
EEG Foundation Models
Electroencephalography (EEG) foundation models learn reusable representations of brain signals for transfer across people, tasks, and recording setups.
See all 96 papers