Interpretable and Steerable Molecular Graph Generation using Concept Bottlenecks
Organizations: Indian Institute of Science Education and Research Bhopal, India · CSIR-Central Scientific Instruments Organisation, Chandigarh, India · Academy of Scientific and Innovative Research (AcSIR), Ghaziabad, India · Stony Brook University AI Innovation Institute, Stony Book, NY, USA
Abstract
Deep graph generators (DGGs) largely lack interpretability, which is a significant limitation for one of their most crucial applications, drug discovery, where interpretable and transparent generation could provide greater control over the desirability of generated molecules, thereby reducing trial-and-error in candidate selection. Common approaches to interpretability, such as disentanglement, cannot guarantee that the learned representations are human-interpretable. To address this, we propose incorporating concept bottlenecks into DGGs, allowing users to interpret, debug, and steer the generation process. We show that this consistently improves distributional fidelity (lower FCD), with only modest, non-systematic effects on validity and uniqueness. We further explore Concept Controller, an optimization-based steering approach that has proven to be effective for steerable image generation. We evaluate our approach on a one-shot molecular graph generation framework, though the underlying ideas can be transferred to sequential graph generation as well.
Figures & tables
| Concept Set | Model | Activation | Deactivation | Hamm. Activation | Hamm. Deactivation | ||||
|---|---|---|---|---|---|---|---|---|---|
| Target | Non-Target | Target | Non-Target | Target | Non-Target | Target | Non-Target | ||
| B-10 | C-GVAE | ||||||||
| CB-GVAE | |||||||||
| CC-GVAE | |||||||||
| N-10 | C-GVAE | ||||||||
| CB-GVAE | |||||||||
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Subset | Concept Bits |
|---|---|
| B-10 | 96, 105, 121, 132, 151, 152, 153, 156, 158, 159 |
| N-10 | 11, 22, 96, 104, 109, 127, 150, 158, 160, 163 |
| B-35 | 11, 22, 57, 66, 83, 90, 91, 95, 96, 97, 104, 105, 109, 112, 116, 121, 127, 128, 129, 132, 139, 143, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 163 |
| N-35 | 11, 17, 19, 22, 38, 41, 43, 53, 69, 71, 74, 75, 76, 86, 89, 92, 93, 94, 96, 99, 101, 102, 104, 106, 109, 114, 123, 127, 136, 138, 141, 147, 158, 160, 163 |
| Concept Set | Epsilon | Activation | Deactivation | ||
|---|---|---|---|---|---|
| Target Acc. | Non Target Acc. | Target Acc. | Non Target Acc. | ||
| B-10 | 0.2 | ||||
| 0.5 | |||||
| N-10 | 0.2 | ||||
| 0.5 | |||||
| B-35 | 0.2 | ||||
Molecular Graph Generation
Molecular graph generation creates new chemically plausible molecules as graphs of atoms and bonds, often guided by desired properties or structures.
See all 46 papers