On the limitations of molecular representations
Organizations: Department of Statistics, University of Oxford, Oxford, UK
Abstract
Molecular representations such as fingerprints and learned embeddings play a central role in cheminformatics and small-molecule machine learning. They serve as the primary input for a diverse array of tasks, including clustering, dataset splitting, and virtual screening, yet their evaluation is often limited to downstream model performance on narrow benchmark tasks. We carried out a systematic investigation of the quality of molecular representations, finding that none of the state-of-the-art molecular embedding models capture graph structure, 3D shape, or ADMET endpoint similarity better than fingerprints or physicochemical descriptors. However, classical fingerprints also revealed their own material limitations. For example, we show that depending on the representation, between 225M and 4B molecules have non-unique representations in the 10.8B Enamine REAL database, with implications for virtual screening. Our findings provide an insight into the current limitations of molecular representations, outlining future research directions for the development of more robust encodings of small molecules.
Figures & tables
| Molecular embedding models | ||||||
| Model | Model type | Params | Train set size | Pre-training objective | Loss function | Stereo-aware |
| MolBERT [ 23 ] | CLM (Transformer) | 87M | 1.3M | Masked language modelling, SMILES equivalence, descriptor prediction | Multi-task loss | No |
| ChemBERTa [ 2 ] | CLM (Transformer) | 3.4M | 77M | Masked language modelling | Categorical cross-entropy | No |
| MolFormer [ 64 ] | CLM (Transformer) | 44.4M | 1.1B | Masked language modelling | Multi-class cross-entropy | No |
| MolCLR [ 71 ] | GNN | 2.4M | 10M | Contrastive alignment following atom masking, bond deletion, and subgraph removal | Scaled cross-entropy contrastive loss | Yes |
| CheMeleon [ 6 ] | GNN | 9.3M | 1M | Prediction of 1,613 molecular descriptors | Masked mean squared error | Yes |
Appendix figures & tables8 assets
Supplementary material from the paper’s appendix.
Appendix
Molecular Representation Learning
Molecular representation learning encodes chemical structures and context for prediction, generation, and discovery across chemistry and biology.
See all 216 papers