cs.CVNov 1, 2026

Band2Net: Frequency-to-Network Transport Distillation for fMRI-Privileged, EEG-Only Session-Condition Decoding

Authors: Nishi Kanta Paul, Md Shihabul Islam Shovo, Dwarikanath Mahapatra

Organizations: NIMISHES Lab, Dhaka, Bangladesh · Khalifa University, Abu Dhabi, UAE

Abstract

Functional MRI resolves large-scale brain networks but is expensive and stationary, whereas EEG is portable but poorly localised. We treat fMRI as privileged information, available during training and absent at deployment, with EEG and fMRI acquired from the same participants under matched conditions but not simultaneously. Band2Net encodes EEG into five frequency-specific connectivity graphs and fMRI into seven canonical network tokens from a frozen teacher, and solves a balanced entropic transport problem between the two token sets that gives each EEG band its own fMRI target. In subject-grouped cross-validation on the PsiConnect psilocybin data set, Band2Net reaches 0.801 ROC-AUC for EEG-only session-condition decoding, 5.0 AUC points (95% CI 1.8-8.2) above an EEG-only student. Although its margins over a single shared plan, a KL-relaxed plan and label-free network descriptors remain unresolved, secondary comparisons favour band-specific transported targets over logit, global-feature, contrastive and pooled-target distillation, though not after Holm correction.

Figures & tables

Explore similar work

Aug 29, 2026

MEL: Coordinate-Preserving EEG Tokenization for fMRI Translation

Background and Objective: Predicting regional blood-oxygen-level-dependent (BOLD) activity from EEG provides a computational approach to studying electrophysiological-hemodynamic associations. However, changes in input representation, readout architecture, and ensembling can obscure the source of a prediction gain. We investigate the contribution of target-relative spectral estimation under matched readout conditions. Methods: MEL converts each preceding 16-second EEG history into calibrated lag-channel-frequency measurements. Four equal-dimensional representations are compared using matched Ridge and multilayer perceptron (MLP) readouts. The retrospective analysis includes 29 resting-state scans from 22 participants, participant-paired uncertainty estimates, aggregation and correspondence controls, leave-one-participant-out regression, and refitted models on an external Oddball cohort. Results: Morlet-Ridge achieved a mean scan-wise correlation of 0.508 across six regional targets and the global signal, compared with 0.432 for canonical Fourier features. The participant-paired mean difference was 0.069 (95% bootstrap confidence interval, 0.037-0.101), with improvements in 19 of 22 participants. The Morlet MLP prediction ensemble reached 0.491. Shared coordinate permutations preserved prediction after refitting, whereas sample-wise permutations degraded it. Canonical Fourier regression reached 0.377 under participant exclusion; external unseen-participant correlation was 0.026. Conclusions: Spectral estimation materially affected regional BOLD prediction without requiring additional nonlinear readout capacity. MEL provides an explicit measurement interface for controlled comparisons, but weak external results constrain its generalizability. Confirmation requires untouched participant-separated data and split-aware preprocessing.
Sep 11, 2026

FRIST: FMRI Representation Informed Shared-space Training Improves EEG-only Individual-Finger BCI Decoding

Finger-level motor decoding is important for naturalistic brain-computer interface (BCI) control, yet individual-finger decoding from scalp electroencephalography (EEG) remains challenging because finger representations are spatially close in the sensorimotor cortex and blurred by volume conduction. Leveraging the high spatial resolution of functional MRI (fMRI), we introduce fMRI Representation-Informed Shared-Space Training (FRIST), a two-stage EEG decoding framework that first learns fMRI-informed spectral projections from simultaneous EEG-fMRI recordings and then uses fMRI-derived class geometry to guide residual refinement of EEG predictions. FRIST transfers information across recordings through shared finger labels without requiring paired trials and uses only EEG at inference. We evaluated 12 able-bodied participants during movement execution (ME) and motor imagery (MI) under two-class and three-class chronological session-held-out decoding simulating the online scenario. Using EEGNet as the EEG feature extractor, FRIST increased group average accuracy from 66.93% to 74.53% for two-class ME, from 44.83% to 56.58% for three-class ME, from 80.78% to 85.63% for two-class MI, and from 60.93% to 69.90% for three-class MI compared with the EEG-only EEGNet baseline. FRIST is also shown to improve EEG-only decoding when the target participant's own fMRI data were unavailable. FRIST also generalized across multiple EEG decoding backbones, reaching 87.40% in two-class MI and 72.54% in three-class MI with EEG Conformer as the EEG feature extractor. These findings indicate that fMRI provide useful spatial constraints for EEG representation learning. FRIST improves noninvasive EEG-based finger-level BCI decoding, offering a multimodal strategy for integrating the spatial specificity of fMRI with real-time applicability of EEG.
May 19, 2026

Fine-tuning language encoding models on slow fMRI improves prediction for fast ECoG

Neuroscientists have recently turned to intracranial brain recording methods, like electrocorticography (ECoG), for human experiments because of the fine spatial and temporal resolution that they afford. Models trained on this data, however, are fundamentally restricted by the patient populations that can receive the implants necessary for recording. We propose using non-invasive fMRI to bridge the gap in training data. Using spoken language representations fine-tuned on fMRI, we build encoding models of ECoG. These representations showed improved prediction performance in ECoG, even though the temporal resolution of fMRI is two orders of magnitude worse. Prediction improved in frequency bands well beyond what is directly measured in fMRI. Next, to test the procedure's generalization ability, we fine-tuned models on fMRI responses that were temporally downsampled by a factor of 2. Despite the loss in resolution, these models were able to predict fMRI and ECoG responses at levels comparable to the original fMRI-tuned models. Finally, we showed that ECoG performance steadily scales with the amount of fMRI-tuning data. Our results show that "slow" data like fMRI can be a valuable resource for building better models of "fast" brain data like ECoG. In the future, integrating across multiple recording methods may further improve performance in other applications, like decoding.