cs.LGNov 16, 2026

Motor Imagery Classification Using Hybrid Cross-Subject Class Mixup and Selective Attention

Authors: Jiwon Kim, Chae-Won Lee, Jong-Seok Lee

Organizations: Yonsei University Republic of Korea

Abstract

Motor imagery (MI) enables a brain-computer interface (BCI) to decode movement intentions without overt movement. Hybrid electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) classification combines complementary signals, but inter-subject variability and the design of information exchange between modalities affect generalization to new subjects. We propose a framework that combines Cross-Subject Class Mixup (CSCM) with Selective Attention. CSCM aims to construct new training data to make the model robust against inter-subject variability. It independently selects EEG and fNIRS donor trials from other training subjects within the anchor class and mixes each modality while preserving the original label. Selective Attention provides an effective way to simultaneously model the temporal signal characteristics and fuse the two modalities. It retains causal temporal self-attention for EEG and uses a classification token (CLS) to integrate both modalities, without fNIRS attention updates or direct cross-modal temporal-token attention. Leave-one-subject-out (LOSO) evaluation across 28 subjects on a public EEG-fNIRS dataset yields a mean balanced accuracy (BA) of 76.85% and a macro-averaged F1 score (Macro-F1) of 76.58%. The proposed model achieves the highest mean performance among five reimplemented baselines. We also examine the contributions of CSCM and Selective Attention through modality-specific mixing and donor-policy comparisons, temporal-policy comparisons, interventions on direct cross-modal paths, and component ablations.

Figures & tables

Explore similar work

CardsList
  1. ATCNet-CIAM for Multi-Session Motor Imagery EEG Signal Classification

    Jul 26, 2026Le Huu Son Hai, Nguyen Chi Hai, Truong Viet Vu +3MI ClassificationBrain-Computer Interfaces

  2. Bio-MF: Low-Latency and High-Fidelity EEG-to-fNIRS Cross-Modal Generation for Hybrid Motor-Imagery Brain--Computer Interfaces

    Sep 17, 2026Boyuan Zhao, Sifan Zhang, Luping ChenBrain-Computer InterfacesMultimodal Generation

  3. EEG Decoding Using CNN and LSTM Network

    Aug 13, 2026Athanasios KaragounisCross-Subject EEG DecodingMI Classification