cs.LGOct 14, 2025

Continuous SUN (Stable, Unique, and Novel) Metric for Generative Modeling of Inorganic Crystals

Authors: Masahiro Negishi, Hyunsoo Park, Kinga O. Mastej, Aron Walsh

Organizations: Department of Materials, Imperial College London, London, United Kingdom

Abstract

To address pressing scientific challenges such as climate change, increasingly sophisticated generative models are being developed to efficiently sample the large chemical space of potential functional materials. The proliferation of these models has necessitated the establishment of rigorous evaluation metrics. While uniqueness (U), novelty (N), and stability (S) of samples serve as standard metrics, their current formulations show several limitations. U and N rely on binary comparisons of crystals, rendering them dependent on heuristic thresholds, incapable of quantifying the degree of similarity, sensitive to atomic coordinate perturbations, and not invariant to sample permutation. Similarly, the binary assessment of S risks a premature exclusion of marginally unstable yet potentially novel candidates. These limitations are addressed by making the aforementioned metrics continuous. Furthermore, we integrate them into a unified metric ``continuous SUN" (cSUN), which offers a smoother score distribution and greater tunability than the conventional binary SUN metric. Experimental results demonstrate that our continuous metrics provide granular insights into sample distributions and secondarily serve as a soft screening score for selecting samples for further analysis. Finally, the use of cSUN as a reward signal in reinforcement learning is explored, showing that its adjustable weighting scheme effectively enhances sample diversity and convergence to a better optima in a Chemeleon2 case study.

Figures & tables

Explore similar work

CardsList
  1. LeMat-GenBench: A Unified Evaluation Framework for Crystal Generative Models

    Dec 4, 2025Siddharth Betala, Samuel P. Gleason, Ali Ramlaoui +12Crystal Structure GenerationGenerative AI Evaluation

  2. Crys-JEPA: Accelerating Crystal Discovery via Embedding Screening and Generative Refinement

    May 14, 2026Nian Liu, Nikita Kazeev, Stephen Gregory Dale +8Joint-Embedding Predictive ArchitectureGenerative Modeling

  3. Reinforcement Learning on the Discrete Composition Channel of a Crystal Generator: Validated Gains and Reward Hacking

    Oct 2, 2026Pawan Prakash, Philipp Höllmer, Addis Fuhr +4Crystal Structure GenerationReward Hacking