MEBM-Speech: Multi-scale Enhanced BrainMagic for Robust MEG Speech Detection
Organizations: Speech and Hearing Research Center, School of Intelligence Science and Technology, Peking University, Beijing, China 100871 · Center for BioMed-X Research, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China 100871
Abstract
We propose MEBM-Speech, a multi-scale enhanced neural decoder for speech activity detection from non-invasive magnetoencephalography (MEG) signals. Built upon the BrainMagic backbone, MEBM-Speech integrates three complementary temporal modeling mechanisms: a multi-scale convolutional module for short-term pattern extraction, a bidirectional LSTM (BiLSTM) for long-range context modeling, and a depthwise separable convolutional layer for efficient cross-scale feature fusion. A lightweight temporal jittering strategy and average pooling further improve onset robustness and boundary stability. The model performs continuous probabilistic decoding of MEG signals, enabling fine-grained detection of speech versus silence states - an ability crucial for both cognitive neuroscience and clinical applications. Comprehensive evaluations on the LibriBrain Competition 2025 Track1 benchmark demonstrate strong performance, achieving an average F1 macro of 89.3% on the validation set and comparable results on the official test leaderboard. These findings highlight the effectiveness of multi-scale temporal representation learning for robust MEG-based speech decoding.
Figures & tables
| Model Variant | F1 macro (%) | Acc macro (%) |
|---|---|---|
| Full Model | 89.34±0.24 | 89.25±0.37 |
| w/o BM Encoder | 88.36±0.13 | 88.29±0.24 |
| w/o Multi-scale Conv | 89.17±0.19 | 88.98±0.28 |
| w/o BiLSTM | 89.21±0.17 | 89.27±0.22 |
| w/o BM Encoder + Multi-scale Conv | 87.91±0.13 | 87.76±0.38 |
| w/o Multi-scale Conv + BiLSTM | 89.17±0.21 | 89.20±0.24 |