SpikingMoE: SDPrompt-Guided Dynamic Expert Fusion in Spiking Neural Networks

Yukai Yang; Chenxi Qin; Jungang Li; Xin Zhang; Wenwei Shao; Liqun Chen

cs.NEMay 22, 2026

SpikingMoE: SDPrompt-Guided Dynamic Expert Fusion in Spiking Neural Networks

Authors: Yukai Yang, Chenxi Qin, Jungang Li, Xin Zhang, Wenwei Shao, Liqun Chen

Organizations: Tianjin University, Medical School, Tianjin 300072, China · Southern University of Science and Technology, Department of Computer Science and Engineering, Shenzhen, Guangdong 518055, China · Chinese Academy of Medical Sciences, Institute of Biomedical Engineering, Tianjin 300192, China

Abstract

Spiking Neural Networks (SNNs) provide an energy-efficient paradigm for visual recognition. We present SpikingMoE, which integrates a spike-driven Transformer with a Mixture-of-Experts (MoE) framework for dynamic computation. Inspired by the lateral geniculate nucleus (LGN), a spike-driven prompt (SDprompt) enables input-dependent expert routing in a biologically plausible manner. By replacing standard MLPs with spike-compatible expert modules and enforcing binary spike communication, SpikingMoE is designed for neuromorphic hardware. Experiments on CIFAR-10 and CIFAR-100 achieve 94.09% and 74.54% top-1 accuracy, showing that modular expert routing can be incorporated while retaining reasonable performance. To our knowledge, SpikingMoE is the first open-source SNN framework that integrates MoE into a spike-driven Transformer with LGN-inspired routing.

Explore similar work

SMM Transformer: Leveraging Spiking Neural Networks for Multimodal Tasks
Aug 3, 2026Xiubo Liang, Jinxing Han, Yuke Li +3Spiking Neural Networks Multimodal Transformers
SAFformer:Improving Spiking Transformer via Active Predictive Filtering
May 8, 2026Zequan Xie, Weiming Zeng, Yunhua Chen +3Spiking Neural Networks Hybrid Transformer
Elastic Spiking Transformers for Efficient Gesture Understanding
May 4, 2026Alberto Ancilotto, Gianluca Amprimo, Stefano Di Carlo +1Spiking Neural Networks Neuromorphic Hardware

Aug 3, 2026 · cs.NEJ/K move · Enter open · S save

SMM Transformer: Leveraging Spiking Neural Networks for Multimodal Tasks

Xiubo Liang, Jinxing Han, Yuke Li, Haoqi Zhu+2

Spiking Neural Networks (SNNs) enable event-driven computation with sparse activations, but building multimodal Transformers on SNNs is hindered by unstable training in deep spiking stacks and the mismatch between dense softmax attention and spike-based communication. We propose SMM Transformer, an SNN-based multimodal Transformer framework that combines (i)PLMP, a Parallel LIF with Multistage Learnable Parameters neuron and a tailored P-STBP algorithm for stable deep SNN training, (ii) SMSA, an attention-inspired spike-driven token-mixing module that replaces dense pairwise softmax attention with channel-wise spike co-activation and self-compensation, and (iii)SMoE, a spiking mixture-of-experts module for modality-aware fusion. Across visual and multimodal benchmarks, SMM Transformer achieves competitive accuracy compared to ANN baselines. Under a standard MAC/AC arithmetic model, SMSA reduces the estimated operator-level compute energy of the attention module by up to 97%, while whole-model profiling shows more moderate but consistent efficiency gains.

Spiking Neural Networks Multimodal Transformers Sparse Expert Activation Neural Network

Open paper Ask about it PDF

Abstract

Explore similar work

SMM Transformer: Leveraging Spiking Neural Networks for Multimodal Tasks

SAFformer:Improving Spiking Transformer via Active Predictive Filtering

Elastic Spiking Transformers for Efficient Gesture Understanding