Distilling and Adapting: A Topology-Aware Framework for Zero-Shot Interaction Prediction in Multiplex Biological Networks
Organizations: Department of Computer Science, Western University, London, ON, Canada · Department of Biochemistry, Western University, London, ON, Canada
Abstract
Multiplex Biological Networks (MBNs), which represent multiple interaction types between entities, are crucial for understanding complex biological systems. Yet, existing methods often inadequately model multiplexity, struggle to integrate structural and sequence information, and face difficulties in zero-shot prediction for unseen entities with no prior neighbourhood information. To address these limitations, we propose a novel framework for zero-shot interaction prediction in MBNs by leveraging context-aware representation learning and knowledge distillation. Our approach leverages domain-specific foundation models to generate enriched embeddings, introduces a topology-aware graph tokenizer to capture multiplexity and higher-order connectivity, and employs contrastive learning to align embeddings across modalities. A teacher-student distillation strategy further enables robust zero-shot generalization. Experimental results demonstrate that our framework outperforms state-of-the-art methods in interaction prediction for MBNs, providing a powerful tool for exploring various biological interactions and advancing personalized therapeutics.
Figures & tables
| Context | # of Nodes | ITs | # of ITs | |
| DGIdb | Drug-Gene | 1846 | Interaction mechanisms | 5 |
| ChEMBL | Compound-Bacteria | 9368 | Response phenotypes | 3 |
| PINNACLE | Protein-Protein | 7044 | Interaction in different cell types | 12 |
| MetaConserve | Protein-Metabolite | 329 | Conservation in bacteria strains | 4 |
| TRRUST | Gene-Gene | 2,862 | Gene regulartory roles | 3 |
| Type | Benchmark Models |
| Sequence-based | MultiLayer Perceptron (MLP), XGBoost (XGB) |
| Single graph-based | GCN , GraphSAGE, Graph Transformer, DGI |
| Multiplex graph-based/Relation-Aware | MultiplexSAGE, DMGI, HDMI, R-GCN, R-GAT |
| Domain-Specific | (1) Drug-Gene & Compoud-Bacteria: CoSMIG, DGCL (2) Protein-Protein: PIPR, xCAPT5 (3) Protein-Metabolite: DrugBAN, MolTrans (4) Gene-Gene: DL-GGI, GENER |
| Setting | Model | AUROC | AUPRC | HS | SA |
| T | Graph Transformer | 0.505 0.007 | 0.514 0.005 | 0.493 0.004 | 0.508 0.003 |
| HDMI | 0.551 0.006 | 0.557 0.007 | 0.540 0.012 | 0.511 0.006 | |
| DGCL | 0.519 0.005 | 0.531 0.004 | 0.527 0.007 | 0.512 0.006 | |
| CAZI-MBN | 0.715 0.007 | 0.729 0.009 | 0.687 0.011 | 0.684 0.015 | |
| ZS | Graph Transformer | 0.498 0.011 | 0.502 0.004 | 0.486 0.004 | 0.504 0.007 |
| DMGI | 0.524 0.008 | 0.528 0.016 | 0.529 0.004 | 0.502 0.006 |
| Setting | Model | AUROC | AUPRC | HS | SA |
| T | DGI | 0.651 0.019 | 0.719 0.005 | 0.738 0.012 | 0.673 0.011 |
| HDMI | 0.663 0.012 | 0.762 0.014 | 0.789 0.012 | 0.730 0.006 | |
| CoSMIG | 0.661 0.021 | 0.732 0.011 | 0.755 0.009 | 0.702 0.025 | |
| CAZI-MBN | 0.812 0.008 | 0.863 0.006 | 0.889 0.014 | 0.757 0.011 | |
| ZS | Graph Transformer | 0.628 0.011 | 0.720 0.008 | 0.725 0.013 | 0.628 0.014 |
| DMGI | 0.652 0.021 | 0.745 0.015 | 0.756 0.007 | 0.711 0.009 |
| Setting | Model | AUROC | AUPRC | HS | SA |
| T | Graph Transformer | 0.701 0.007 | 0.704 0.015 | 0.700 0.005 | 0.726 0.024 |
| HDMI | 0.773 0.022 | 0.798 0.023 | 0.776 0.017 | 0.766 0.016 | |
| xCAPT5 | 0.781 0.011 | 0.804 0.014 | 0.726 0.012 | 0.752 0.015 | |
| CAZI-MBN | 0.831 0.018 | 0.845 0.011 | 0.751 0.009 | 0.772 0.013 | |
| ZS | Graph Transformer | 0.687 0.019 | 0.690 0.017 | 0.680 0.018 | 0.705 0.019 |
| HDMI | 0.748 0.025 | 0.776 0.021 | 0.757 0.024 | 0.742 0.014 |
| Setting | Model | AUROC | AUPRC | HS | SA |
| T | DGI | 0.668 0.020 | 0.673 0.019 | 0.665 0.010 | 0.669 0.010 |
| HDMI | 0.726 0.015 | 0.729 0.021 | 0.715 0.006 | 0.718 0.015 | |
| DrugBAN | 0.737 0.010 | 0.714 0.012 | 0.710 0.019 | 0.711 0.008 | |
| CAZI-MBN | 0.752 0.020 | 0.744 0.012 | 0.779 0.008 | 0.656 0.014 | |
| ZS | Graph Transformer | 0.651 0.007 | 0.660 0.020 | 0.652 0.015 | 0.648 0.015 |
| HDMI | 0.709 0.017 | 0.710 0.014 | 0.704 0.014 | 0.707 0.009 |
| Setting | Model | AUROC | AUPRC | HS | SA |
| T | DGI | 0.841 0.014 | 0.844 0.011 | 0.845 0.009 | 0.847 0.006 |
| HDMI | 0.878 0.008 | 0.879 0.014 | 0.883 0.005 | 0.881 0.004 | |
| GENER | 0.867 0.012 | 0.868 0.006 | 0.865 0.010 | 0.869 0.006 | |
| CAZI-MBN | 0.905 0.013 | 0.872 0.008 | 0.791 0.023 | 0.784 0.015 | |
| ZS | DGI | 0.832 0.011 | 0.835 0.014 | 0.836 0.007 | 0.838 0.006 |
| HDMI | 0.868 0.006 | 0.869 0.010 | 0.872 0.006 | 0.870 0.004 |
Appendix figures & tables16 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Interaction Types | # Nodes | # Edges | # Interaction Types | Multiplex Rate (%) |
| DGIdb | Inhibitor (7,004) | 1,846 | 8,443 | 5 | 1.34 |
| Modulator (1,439) | |||||
| Agonist (915) | |||||
| Activator (104) | |||||
| Other (170) | |||||
| ChEMBL | S (120,265) | 9,368 | 248,582 | 3 | 14.45 |
| Component | Value/Detail |
| Optimizer | Adam |
| Learning rate | 1e-4 |
| Batch size | 256 |
| Number of epoches | 10000 |
| Early stopping | Yes |
| Order of UGT | 5 |
| Setting | Model | AUROC | AUPRC | HS | SA |
| T | XGB | 0.350 0.010 | 0.389 0.011 | 0.579 0.011 | 0.421 0.011 |
| MLP | 0.284 0.013 | 0.375 0.005 | 0.609 0.009 | 0.407 0.011 | |
| XGB (LLM) | 0.517 0.012 | 0.572 0.009 | 0.541 0.014 | 0.488 0.010 | |
| MLP (LLM) | 0.511 0.011 | 0.561 0.008 | 0.536 0.010 | 0.503 0.012 | |
| GCN | 0.482 0.010 | 0.493 0.005 | 0.511 0.003 | 0.491 0.003 | |
| GraphSAGE | 0.447 0.005 | 0.467 0.003 | 0.527 0.006 | 0.473 0.006 |
| Setting | Model | AUROC | AUPRC | HS | SA |
| T | XGB | 0.515 0.013 | 0.607 0.018 | 0.699 0.007 | 0.587 0.012 |
| MLP | 0.531 0.005 | 0.629 0.012 | 0.657 0.009 | 0.613 0.010 | |
| XGB (LLM) | 0.648 0.014 | 0.694 0.016 | 0.735 0.010 | 0.721 0.011 | |
| MLP (LLM) | 0.624 0.008 | 0.678 0.013 | 0.718 0.011 | 0.697 0.009 | |
| GCN | 0.632 0.014 | 0.700 0.008 | 0.709 0.004 | 0.641 0.012 | |
| GraphSAGE | 0.631 0.005 | 0.698 0.012 | 0.734 0.006 | 0.663 0.005 |
| Setting | Model | AUROC | AUPRC | HS | SA |
| T | XGB | 0.650 0.007 | 0.644 0.007 | 0.651 0.005 | 0.660 0.023 |
| MLP | 0.676 0.008 | 0.668 0.008 | 0.656 0.011 | 0.666 0.016 | |
| XGB (LLM) | 0.742 0.010 | 0.767 0.009 | 0.744 0.007 | 0.734 0.018 | |
| MLP (LLM) | 0.733 0.011 | 0.751 0.010 | 0.699 0.010 | 0.708 0.014 | |
| GCN | 0.659 0.010 | 0.670 0.012 | 0.666 0.014 | 0.679 0.021 | |
| GraphSAGE | 0.692 0.017 | 0.677 0.008 | 0.686 0.005 | 0.693 0.025 |
| Setting | Model | AUROC | AUPRC | HS | SA |
| T | XGB | 0.611 0.006 | 0.612 0.023 | 0.617 0.021 | 0.613 0.010 |
| MLP | 0.617 0.010 | 0.614 0.015 | 0.620 0.017 | 0.628 0.007 | |
| XGB (LLM) | 0.662 0.009 | 0.671 0.018 | 0.658 0.020 | 0.669 0.013 | |
| MLP (LLM) | 0.694 0.012 | 0.702 0.015 | 0.707 0.016 | 0.703 0.010 | |
| GCN | 0.630 0.007 | 0.642 0.022 | 0.628 0.011 | 0.633 0.018 | |
| GraphSAGE | 0.649 0.013 | 0.646 0.011 | 0.644 0.021 | 0.645 0.012 |
| Setting | Model | AUROC | AUPRC | HS | SA |
| T | XGB | 0.786 0.006 | 0.791 0.016 | 0.794 0.005 | 0.788 0.007 |
| MLP | 0.796 0.008 | 0.799 0.019 | 0.801 0.011 | 0.803 0.012 | |
| XGB (LLM) | 0.854 0.019 | 0.863 0.027 | 0.852 0.014 | 0.867 0.018 | |
| MLP (LLM) | 0.861 0.022 | 0.868 0.031 | 0.856 0.017 | 0.859 0.021 | |
| GCN | 0.810 0.008 | 0.815 0.022 | 0.812 0.008 | 0.817 0.005 | |
| GraphSAGE | 0.822 0.010 | 0.826 0.007 | 0.819 0.008 | 0.824 0.010 |
| Variant | Description |
| w/o UGT | Remove UGT; use only LLM-derived features as input |
| w/o LLMs | Replace LLM features with 6-mer and Morgan fingerprints |
| w/o CAE | Replace CAE with a single GCN per interaction type |
| w/o MoE | Replace MoE with a plain MLP per interaction type |
| w/o | Discard discriminator |
| w/o | Discard consensus regularizer and replace with attention-only fusion for Z |
| Dataset | Model | AUROC | AUPRC | HS | SA |
| DGIdb | w/o UGT | 0.666 0.015 | 0.705 0.008 | 0.639 0.012 | 0.634 0.017 |
| w/o LLMs | 0.563 0.021 | 0.579 0.023 | 0.591 0.014 | 0.582 0.016 | |
| w/o CAE | 0.601 0.014 | 0.635 0.018 | 0.613 0.016 | 0.602 0.012 | |
| w/o MoE | 0.672 0.019 | 0.707 0.011 | 0.645 0.020 | 0.637 0.018 | |
| w/o | 0.692±0.024 | 0.701±0.017 | 0.673±0.019 | 0.655±0.022 | |
| w/o | 0.679 0.012 | 0.696 0.013 | 0.660 0.010 | 0.644 0.014 |
| Dataset | Model | AUROC | AUPRC | HS | SA |
| DGIdb | w/o UGT | 0.633 0.015 | 0.664 0.010 | 0.637 0.012 | 0.625 0.014 |
| w/o LLMs | 0.527 0.017 | 0.553 0.025 | 0.599 0.018 | 0.573 0.015 | |
| w/o CAE | 0.589 0.019 | 0.607 0.020 | 0.618 0.009 | 0.604 0.012 | |
| w/o MoE | 0.641 0.012 | 0.662 0.015 | 0.639 0.011 | 0.631 0.011 | |
| w/o | 0.643 0.017 | 0.677 0.009 | 0.819 0.022 | 0.690 0.015 | |
| w/o | 0.593±0.012 | 0.616±0.013 | 0.621±0.011 | 0.601±0.012 |
| DGIdb | TRRUST | PINNACLE | MetaConserve | |
| GAPDH ( gapA ) | 34 / 41 (82.9%) | 2 / 3 (66.7%) | 103 / 140 (73.6%) | – |
| PC ( accC ) | 2 / 2 (100%) | 2 / 2 (100%) | – | – |
| RPS14 ( rpsK ) | 3 / 5 (60%) | – | 340 / 454 (74.9%) | – |
| OAT ( orn ) | 1 / 1 (100%) | 2 / 2 (100%) | 11 / 16 (68.7%) | – |
| NDUFAB1 ( fabD ) | 3 / 3 (100%) | – | 46 / 57 (80.7%) | 5 / 8 (62.5%) |
| Total | 43 / 52 (82.7%) | 6 / 7 (85.7%) | 500 / 666 (75.1%) | 5 / 8 (62.5%) |
| MetaConserve | DGIdb | TRRUST | PINNACLE | ChEMBL | |
| # Nodes | 329 | 1,846 | 2,862 | 7,044 | 9,368 |
| # Interaction Types | 4 | 5 | 3 | 12 | 3 |
| Teacher Total GPU Hours | 0.463 h | 3.191 h | 2.137 h | 31.34 h | 8.456 h |
| Teacher Time/Epoch | 0.574 s | 4.332 s | 3.903 s | 115.037 s | 43.201 s |
| Student Total GPU Hours | 0.00109 h | 0.0567 h | 0.0098 h | 0.4275 h | 0.114 h |
| Student Time/Epoch | 0.005 s | 0.129 s | 0.078 s | 3.802 s | 1.311 s |
| Setting | Model | AUROC | AUPRC | HS | SA |
| T | XGB | 0.786 0.006 | 0.791 0.016 | 0.788 0.017 | 0.792 0.014 |
| MLP | 0.796 0.008 | 0.799 0.019 | 0.809 0.013 | 0.812 0.018 | |
| GCN | 0.810 0.008 | 0.815 0.022 | 0.821 0.011 | 0.826 0.010 | |
| GraphSAGE | 0.822 0.010 | 0.826 0.007 | 0.824 0.014 | 0.829 0.015 | |
| Graph Transformer | 0.832 0.005 | 0.835 0.015 | 0.841 0.010 | 0.834 0.012 | |
| DGI | 0.841 0.014 | 0.844 0.011 | 0.851 0.013 | 0.853 0.011 |
Link Prediction
Link prediction estimates missing or future relationships in graphs, from social ties and knowledge-graph facts to biological interactions.
See all 46 papers