Data Curation for Machine Learning Interatomic Potentials by Determinantal Point Processes
Organizations: Computational Science & Engineering Massachusetts Institute of Technology Cambridge, MA, 02139, USA
Abstract
The development of machine learning interatomic potentials faces a critical computational bottleneck with the generation and labeling of useful training datasets. We present a novel application of determinantal point processes (DPPs) to the task of selecting informative subsets of atomic configurations to label with reference energies and forces from costly quantum mechanical methods. Through experiments with hafnium oxide data, we show that DPPs are competitive with existing approaches to constructing compact but diverse training sets by utilizing kernels of molecular descriptors, leading to improved accuracy and robustness in machine learning representations of molecular systems. Our work identifies promising directions to employ DPPs for unsupervised training data curation with heterogeneous or multimodal data, or in online active learning schemes for iterative data augmentation during molecular dynamics simulation.
Figures & tables
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| Algorithm | Primary Reference | Similarity Metric | Subset Size | Type |
|---|---|---|---|---|
| SRS | – | None | Variable | Probabilistic |
| -means clustering | Huan et al. (2017) | Euclidean distance in descriptor space | Variable | Probabilistic |
| MaxVol | Podryabinkin and Shapeev (2017) | Fisher information matrix | Fixed | Deterministic |
| Entropy max. | Karabin and Perez (2020) | Entropy function | Variable | Deterministic |
| fixed-size DPP | This work | PSD kernel | Variable | Probabilistic |
| index | MP ID | set | no. configurations | no. Hf | no. O |
|---|---|---|---|---|---|
| 1 | – | HfO 2 figshare | 2052 | 36 | 72 |
| 2 | 352 | HfO 2 EOS 1D | 300 | 4 | 8 |
| 3 | 550893 | HfO 2 EOS 1D | 131 | 1 | 2 |
| 4 | 550893 | HfO 2 EOS 6D | 27620 | 1 | 2 |
| 5 | – | HfO gas | 129 | 1 | 1 |
| 6 | – | HfO EOS 1D | 14969 | 1 | 1 |
| index | MP ID | set | no. configurations | no. Hf | no. O |
|---|---|---|---|---|---|
| 1 | – | Hf 2 gas | 63 | 2 | 0 |
| 2 | 103 | Hf 2 EOS 1D | 202 | 2 | 0 |
| 3 | 103 | Hf 2 EOS 3D | 9377 | 2 | 0 |
| 4 | 103 | Hf 2 EOS 6D | 17205 | 2 | 0 |
| 5 | 100 | Hf EOS 1D | 201 | 1 | 0 |
| 6 | 100 | Hf 1D primitive | 201 | 1 | 0 |
Training Data Curation
Training data curation improves the quality, diversity, organization, and reliability of datasets used to train machine-learning models.
See all 153 papers