cs.LGAug 7, 2026

How Molecular Generative Models Organize Molecular Identity

Authors: Raul Ortega-OchoaTejs VeggeJens S. BakanderLuis Mantilla CalderonAlan Aspuru-GuzikTonio Buonassisi

Organizations: Toyota Research Institute, Los Altos, California, USA · Department of Energy Conversion and Storage, Technical University of Denmark · CAPeX Pioneer Center for Accelerating P2X Materials Discovery, Kgs. Lyngby, Denmark · Department of Computer Science, University of Toronto, Toronto, ON, Canada · Vector Institute for Artificial Intelligence, Schwartz Reisman Innovation Campus, Toronto, ON, Canada · NVIDIA, 431 King St. W #6th, Toronto, ON, Canada · Department of Chemistry, University of Toronto, Toronto, ON, Canada · Department of Chemical Engineering & Applied Chemistry, University of Toronto, Toronto, ON, Canada · Department of Materials Science & Engineering, University of Toronto, Toronto, ON, Canada · Acceleration Consortium, Toronto, ON, Canada · Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA

Abstract

Generative models for matter are often evaluated as samplers over output representations, and their latent spaces are commonly used as proxies for navigating chemical space. Much less is known about how these models internally arrange discrete chemical identities within those representations. We study this arrangement by making molecular identity explicit and pulling it back through the generative process. Through these pullbacks we probe the regions that generate the same object, exposing the trained model's internal repertoire: a fixed partition that determines which objects (novel or not) the model can produce. Across three molecular generative architectures, we find that this repertoire is arranged into piecewise-constant regions separated by recurring coarse-to-fine boundaries. Its organization depends on the representation probed, the identity convention, decoder stochasticity, and the metric used to compare coordinates. During training, local chemical organization stabilizes while the number of distinct molecular identities represented within each neighborhood continues to change. Internal organization must therefore be characterized, rather than assumed, before a generative space can be treated as chemically navigable.

Explore similar work

CardsList