From MS/MS evidence to adaptive spectroscopic characterization: Reinforcement learning guided by candidate molecular structures
Organizations: State Key Laboratory of Materials for Integrated Circuits, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China · University of Chinese Academy of Sciences, Beijing 100049, China
Abstract
Small-molecule identification from tandem mass spectrometry (MS/MS) may require complementary measurements. Herein, we propose a structure-informed deep Q-network (SI-DQN) that uses existing MS/MS evidence to decide whether further characterization is needed, which measurement to request, and when to stop. The policy combines spectral representations and candidate rankings with score-weighted descriptors of the candidates' chemical features and structural differences. The policy was evaluated on 79,462 held-out samples with simulated MS/MS, infrared (IR), and nuclear magnetic resonance (NMR) spectra from the Multimodal Spectroscopic Dataset. Evaluation used fixed hard candidate sets containing the correct structure and equal normalized acquisition costs. Averaged across three training runs, SI-DQN increased Top-1 accuracy from 80.10% to 93.78% for positive-ion MS/MS starts and from 70.44% to 93.31% for negative-ion starts. The corresponding mean additional measurement counts were only 0.227 and 0.340 per sample, respectively. Complete acquisition achieved 97.72% accuracy with four additions, whereas SI-DQN reduced the additional measurement count by 94.3% and 91.5%. Relative to a rule-based policy, SI-DQN reduced the composite loss combining terminal ranking error and acquisition cost by 19.3% and 25.5%. Adding structural information to DQN further improved accuracy while reducing requests across all three training runs. At comparable ranking uncertainty, SI-DQN increased request rates relative to DQN more strongly in groups with high structural disagreement, where larger reductions in composite loss were also observed. Together, these results support using the ambiguity among candidate structures after MS/MS analysis to guide further characterization, providing a quantitative basis for balancing identification performance against subsequent measurement effort.
Figures & tables
| Action | Description |
|---|---|
| Request IR | Add IR to observed evidence. |
| Request 1 H NMR | Add 1 H NMR to observed evidence. |
| Request 13 C NMR | Add 13 C NMR to observed evidence. |
| Request MS/MS + | Add MS/MS + (40 eV) to observed evidence. |
| Request MS/MS - | Add MS/MS - (40 eV) to observed evidence. |
| Stop | Stop acquisition and return the current ranking. |
| Chemical category | Number of descriptors | Descriptors |
|---|---|---|
| Elemental composition | 4 | N; O; S; halogens |
| Functional groups | 3 | Carbonyl; hydroxyl; nitrile |
| Carbon environments | 3 | Aromatic, aliphatic sp 3 , and heteroatom-bonded carbons |
| Hydrogen environments | 2 | Hydrogens on (non)aromatic carbons |
Mass Spectrometry
Mass spectrometry measures ion mass-to-charge patterns to identify and quantify molecules, with AI linking spectra to structures, peptides, and biological signals.
See all 35 papers