cs.LGAug 27, 2026

MM-Spectrum: Multimodal Multi-spectral Molecular Structural Elucidation with a Stable MoE Framework

Authors: Hai-tao Yu, Nan Min, Zheng Fang, Hongyu Zhan, Yusen Tan, Yuhan Wang, Jun Xia

Organizations: The Hong Kong University of Science and Technology (Guangzhou) · Southeast University · The Hong Kong University of Science and Technology · Fudan University

Abstract

Inferring molecular structures from multimodal spectroscopic measurements requires integrating complementary yet highly heterogeneous signals. However, the common paradigm of directly concatenating multispectral sequences can exhibit anomalous performance degradation, primarily due to pronounced heterogeneity and the resulting multimodal imbalance across modalities. As a remedy, we propose MM-Spectrum, a sparse Mixture-of-Experts framework tailored for multimodal multispectral spectra-to-structure elucidation. To better match the information characteristics under multispectral imbalance, MM-Spectrum introduces an explicit modality-aware routing mechanism that exposes spectral identity to the router in addition to token content representations. Moreover, it incorporates shared and interaction experts, together with heterogeneous expert capacities, to extract multispectral modality-unique and cross-modal synergistic information while suppressing noise-induced interference. Across full-modality, bimodal, and missing-modality settings on molecular structural elucidation, MM-Spectrum achieves consistent and substantial improvements, supported by ablation studies and interpretability analyses.

Figures & tables

Appendix figures & tables11 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. SpecX: A Large-Scale Benchmark for Multi-Modal Spectroscopy and Cross-Paradigm Evaluation

    May 11, 2026Chengrui Xiang, Tengfei Ma, Yujie Chen +3Multimodal Model Evaluation

  2. Robust small-molecule identification from incomplete, degraded, and inconsistent spectra using multimodal mixed-condition training

    Sep 13, 2026Bowen Gao, Lei Zhu, Yiying Wang +1Missing-Modality LearningMultimodal Robustness

  3. MAST: Motif-Augmented Diffusion with Search Tree for Spectroscopic Molecular Structure Elucidation

    Oct 8, 2026Chenghao Jia, Mengdi Liu, Hong Chang +2Molecular GenerationDiffusion Sampling