Electronic Density versus Geometry for Machine-Learned Molecular Absorption Spectra
Organizations: Scientific Computing Department, Science and Technology Facilities Council, Rutherford Appleton Laboratory, Didcot OX11 0QX, United Kingdom. · Scientific Computing Department, Science and Technology Facilities Council, Daresbury Laboratory, Warrington, WA4 4AD, United Kingdom.
Abstract
Molecular optical absorption spectroscopy provides a direct probe of electronic structure and is widely used for molecular identification, interpretation of photophysical behaviour, and planning of spectroscopy experiments. Calculating the absorption spectra using first-principle excited-state methods, however, is computationally demanding, at least compared to ground-state calculations, which limits their routine application across large molecular sets. Machine-learning (ML) surrogates can reduce this cost and allow rapid spectral prediction. However, their performance depends strongly on how molecular information is represented. Here, we compare using the ground-state electron density versus the molecular geometry as inputs to a ML model for predicting absorption spectra, for a training set of 6874 molecules selected from the QM7 dataset. For each of these molecules, the density was calculated using density functional theory (DFT) and the absorption spectrum was calculated using linear-response (LR) time-dependent DFT (TDDFT). Utilizing the ground-state density as the input to the ML model is motivated by the Hohenberg-Kohn and Runge-Gross theorems, and the fact that the ground-state density encodes information about bonding, charge localisation, and electronic delocalisation. Hence, it may be a more judicious starting point for the ML model compared to the geometry, as it effectively decouples the chemistry of the ground-state. The question we test is whether the benefits of using the density outweigh the (notprohibitive) penalty of requiring an additional single-point DFT calculation for the density. We find that the density-based convolutional neural network achieves a validation correlation of 0.9926, compared with 0.9795 for the best geometry-based graph model, reducing the residual decorrelation, by approximately 64%.
Figures & tables
| Exp. | Hidden irreps | Int. | LR | Dropout | Val loss | Val corr | |
|---|---|---|---|---|---|---|---|
| exp01 | 128x0e + 128x1o | 2 | 3 | 0.10 | 0.0171086 | 0.979423 | |
| exp02 | 128x0e + 128x1o | 3 | 3 | 0.10 | 0.0171974 | 0.979223 | |
| exp03 | 128x0e + 128x1o | 4 | 3 | 0.10 | 0.0174657 | 0.978854 | |
| exp04 | 192x0e + 192x1o | 2 | 3 | 0.10 | 0.0171763 | 0.979475 | |
| exp05 | 96x0e + 96x1o + 96x2e | 2 | 3 | 0.10 | 0.0175385 | 0.979077 | |
| exp06 | 128x0e (scalar control) | 2 | 3 | 0.10 | 0.0183623 | 0.977993 |
| Training loss | Val MAE | Val MSE | Val corr | Val KL | Val JS | Val |
|---|---|---|---|---|---|---|
| Wasserstein | 0.826412 | 0.723892 | 0.069020 | 4.307083 | ||
| Pearson corr. | 0.977388 | 0.435214 | 0.125681 | 205.415649 | ||
| JS divergence | 0.979338 | 0.017322 | 0.004197 | 4.735388 | ||
| KL divergence | 0.979314 | 0.017253 | 0.004210 | 4.724957 | ||
| MAE | 0.976748 | 0.020495 | 0.004796 | 5.737404 | ||
| MSE | 0.959622 | 0.045174 | 0.010397 | 16.948169 |
| Rank | Layers | Kernel | BaseF | Dropout | Val loss | Val corr | Val MAE |
|---|---|---|---|---|---|---|---|
| 1 | 7 | 15 | 8 | 0.20 | 6.66e-06 | 0.9926 | 7.14e-05 |
| 2 | 7 | 7 | 6 | 0.10 | 7.18e-06 | 0.9922 | 7.54e-05 |
| 3 | 8 | 5 | 4 | 0.10 | 1.84e-05 | 0.9794 | 1.44e-04 |
| 4 | 4 | 7 | 6 | 0.30 | 2.59e-05 | 0.9757 | 1.57e-04 |
| 5 | 10 | 9 | 8 | 0.30 | 2.98e-05 | 0.9682 | 1.79e-04 |
| Model | Parameters | Training time (h) | Hardware |
|---|---|---|---|
| SchNet | 228,534 | 2.30 | NVIDIA A100 40 GB |
| DimeNet++ | 6,545,808 | 3.80 | NVIDIA A100 40 GB |
| MACE | 2,814,211 | 3.22 | NVIDIA A100 40 GB |
| Density 3D-CNN | 401,295,280 | 91.07 | NVIDIA A100 40 GB |
| Model | Latency | Throughput | GPU memory |
|---|---|---|---|
| (ms molecule -1 ) | (molecules s -1 ) | (MB) | |
| SchNet | 4.69 | 213.15 | 10 |
| MACE | 12.44 | 80.39 | 106 |
| Density 3D-CNN | 43.95 | 22.75 | 2397 |
Molecular Property Prediction
Molecular property prediction estimates chemical, physical, and biological properties from molecular structure and context.
See all 197 papers