MoEDDI: Semantic Mixtures of Experts for Long Tailed Drug Drug Interaction Prediction
Organizations: University of Technology Sydney, Australia · Taipei Medical University, Taiwan · National Central University, Taiwan · Vietnam National University, Vietnam ·
Abstract
Descriptor-based drug--drug interaction (DDI) models typically apply a single global predictor despite heterogeneous physicochemical evidence and severely long-tailed labels. We introduce MoEDDI (Mixture-of-Experts for Drug--Drug Interaction prediction), a chemically organized mixture-of-experts that routes overlapping descriptor families using low-dimensional statistics and combines their sparse top- mixture with a global T-DDI pathway through a residual logit correction. The residual parameterization can exactly preserve a supplied T-DDI checkpoint at initialization, although the evaluated models are trained from scratch. Across complete test partitions with 178, 86, and 92 classes, MoEDDI improves macro-F1 over reproduced seed-2026 T-DDI baselines from 0.8284 to 0.8485, 0.4729 to 0.6536, and 0.1807 to 0.4671. On the 3,780-feature corpus, the lowest-support group (89 classes with fewer than 50 test examples) shows the largest mean classwise gain (+3.30 F1 points). Calibration improves on one corpus but worsens on two. These single-seed results support semantic conditional specialization while motivating matched ablations and distribution-shift evaluation.
Figures & tables
| Corpus | Train | Validation | Test | Classes | Features | MoEDDI views |
|---|---|---|---|---|---|---|
| DDI2025 | 520,841 | 173,614 | 173,614 | 178 | 3,780 | seven chemical families |
| DeepDDI-86 | 115,372 | 38,462 | 38,450 | 86 | 100 | DrugA, DrugB, Generalist |
| FDA-DDI-92 | 239,412 | 79,805 | 79,804 | 92 | 434 | DrugA, DrugB, Generalist |
| Corpus | Model | Accuracy | Macro-F1 | Weighted F1 | Top-3 | Top-5 | ECE |
|---|---|---|---|---|---|---|---|
| DDI2025 | T-DDI-Acc | 0.9219 | 0.8004 | 0.9215 | 0.9934 | 0.9980 | 0.0044 |
| T-DDI-MF | 0.9269 | 0.8284 | 0.9264 | 0.9930 | 0.9978 | 0.0213 | |
| MoEDDI | 0.9363 | 0.8485 | 0.9361 | 0.9946 | 0.9982 | 0.0440 | |
| DeepDDI-86 | T-DDI-Acc | 0.5377 | 0.2540 | 0.5021 | 0.8474 | 0.9282 | 0.0534 |
| T-DDI-MF | 0.6618 | 0.4729 | 0.6554 | 0.9185 | 0.9656 | 0.1122 | |
| MoEDDI | 0.8161 | 0.6536 | 0.8134 | 0.9749 | 0.9912 | 0.0704 |