Enhancing Molecular Property Predictions by Learning from Bond Modelling and Interactions
Organizations: Department of Computing (COMP), The Hong Kong Polytechnic University · Department of Management and Marketing (MM), The Hong Kong Polytechnic University
Abstract
Molecule representation learning is crucial for understanding and predicting molecular properties. However, conventional atom-centric models, which treat chemical bonds merely as pairwise interactions, often overlook complex bond-level phenomena like resonance and stereoselectivity. This oversight limits their predictive accuracy for nuanced chemical behaviors. To address this limitation, we introduce DeMol, a dual-graph framework whose architecture is motivated by a rigorous information-theoretic analysis demonstrating the information gain from a bond-centric perspective. DeMol explicitly models molecules through parallel atom-centric and bond-centric channels. These are synergistically fused by multi-scale Double-Helix Blocks designed to learn intricate atom-atom, atom-bond, and bond-bond interactions. The framework's geometric consistency is further enhanced by a regularization term based on covalent radii to enforce chemically plausible structures. Comprehensive evaluations on diverse benchmarks, including PCQM4Mv2, OC20 IS2RE, QM9, and MoleculeNet, show that DeMol establishes a new state-of-the-art, outperforming existing methods. These results confirm the superiority of explicitly modelling bond information and interactions, paving the way for more robust and accurate molecular machine learning.
Figures & tables
| Model | # param. | MAE ( ) |
| MLP-Fingerprint | 16.1M | 0.1735 |
| GCN | 2.0M | 0.1379 |
| GIN | 3.8M | 0.1195 |
| GINE - | 13.2M | 0.1167 |
| GCN - | 4.9M | 0.1153 |
| GIN - | 6.7M | 0.1083 |
| Energy MAE (eV) | EwT (%) | |||||||||
| Model | ID | OOD Ads. | OOD Cat. | OOD Both | AVG. | ID | OOD Ads. | OOD Cat. | OOD Both | AVG. |
| SchNet | 0.6465 | 0.7074 | 0.6475 | 0.6626 | 0.6660 | 2.96 | 2.22 | 3.03 | 2.38 | 2.65 |
| DimeNet++ | 0.5636 | 0.7127 | 0.5612 | 0.6492 | 0.6217 | 4.25 | 2.48 | 4.40 | 2.56 | 3.42 |
| GemNet-T | 0.5561 | 0.7342 | 0.5659 | 0.6964 | 0.6382 | 4.51 | 2.24 | 4.37 | 2.38 | 3.38 |
| SphereNet | 0.5632 | 0.6682 | 0.5590 | 0.6190 | 0.6024 | 4.56 | 2.70 | 4.59 | 2.70 | 3.64 |
| Graphormer-3D | 0.4329 | 0.5850 | 0.4441 | 0.5299 | 0.4980 | - | - | - | - | - |
| Model | ZPVE | U | H | G | Avg. Rank | ||||||||
| EdgePred | 0.039 | 0.086 | 37.4 | 31.9 | 58.2 | 0.112 | 1.81 | 14.7 | 14.2 | 14.8 | 14.5 | 0.038 | 18.92 |
| AttrMask | 0.020 | 0.072 | 31.3 | 37.8 | 50.0 | 0.423 | 1.90 | 10.7 | 10.8 | 11.4 | 11.2 | 0.062 | 15.25 |
| InfoGraph | 0.041 | 0.099 | 48.1 | 38.1 | 72.2 | 0.114 | 1.69 | 16.4 | 14.9 | 14.5 | 16.5 | 0.030 | 19.08 |
| GraphCL | 0.027 | 0.066 | 26.8 | 22.9 | 45.5 | 0.095 | 1.42 | 9.6 | 9.7 | 9.6 | 10.2 | 0.028 | 10.0 |
| GPT-GNN | 0.039 | 0.103 | 35.7 | 28.8 | 54.1 | 0.158 | 1.75 | 12.0 | 24.8 | 14.8 | 12.2 | 0.032 | 18.17 |
| GraphMVP | 0.031 | 0.070 | 28.5 | 26.3 | 46.9 | 0.082 | 1.63 | 10.2 | 10.3 | 10.4 | 11.2 | 0.033 | 12.00 |
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
| Methods | Inference Time |
| Transformer-M | 28 ms/molecule |
| GPS++ (Ensemble) | 100 ms/molecule |
| DeMol | 34 ms/molecule |
| Methods | BBBP | Tox21 | ToxCast | SIDER | ClinTox | MUV | HIV | BACE | Avg |
| AttrMask | 72.68 | ||||||||
| ContextPred | 71.28 | ||||||||
| GraphCL | 70.78 | ||||||||
| InfoGraph | 70.98 | ||||||||
| GROVER | 71.01 | ||||||||
| MolCLR | 70.79 |
| Hyperparameter | Small | Large | HIV |
| Learning rate | [5e-5, 8e-5, 1e-4, 4e-4, 5e-4] | [2e-5, 1e-4] | [2e-5, 5e-5] |
| Batch size | [32, 64, 128, 256] | [128, 256] | [128, 256] |
| Epochs | [40 ,60, 80, 100] | [20, 40] | [2, 5, 10] |
| Pooler dropout | [0.0, 0.1, 0.2, 0.5] | [0.0, 0.1] | [0.0, 0.2] |
| Warmup ratio | [0.0, 0.06, 0.1] | [0.0, 0.06] | [0.0, 0.1] |
| Methods | |||||
| No Pre-training | 21.2 | 19.3 | 30.4 | 10.97 | 0.029 |
| Pre-training on PCQM4Mv2 | 16.4 | 15.7 | 26.8 | 6.29 | 0.021 |
Molecular Property Prediction
Molecular property prediction estimates chemical, physical, and biological properties from molecular structure and context.
See all 201 papers