Evolutionary Algorithms for Generating Graphs Matching Desired Laplacian Spectra
Authors: Hendrik Richter, Frank Neumann
Organizations: HTWK Leipzig University of Applied Sciences, Faculty of Engineering, D–04251 Leipzig, Germany · Optimisation and Logistics, Adelaide University, Adelaide, SA 5005, Australia
Graphs with diverse structural characteristics play a central role in modelling and optimization tasks. The ability to generate different types of graphs that exhibit shared properties is likewise essential for algorithm selection and configuration. However, constructing graphs that preserve high-level properties across a broad range of graph classes remains a challenging problem. We present a novel evolutionary approach to evolve graphs based on the Laplacian graph spectra descriptor. This descriptor can be used as part of a fitness function to evaluate graphs according to their desired high-level properties. Our evolutionary algorithm evolves graphs towards this descriptor in order to obtain graphs having properties that are consistent with it but are different from each other in terms of non-spectral graph metrics, such as path length, clustering coefficient and betweenness centrality. Our experimental results show that our approach is successful for different classes of graphs and a wide range of Laplacian graph spectra.
Figures & tables
Figure 1: Examples of target graphs and target densities for graph size n=12 . (a) Star graph S11 . (b) Circulant graph C121234 . (c) Circulant graph C12123 . (d) Spectral densities of φT(x) , see Eq. ( 1 ), of the target graphs (a)-(c).
Figure 2: Evolution of the spectral density φG(x) over generations κ for n=24 , 12 -regular initial graphs and the target graph C241,2,…,6 .
Design parameter
Symbol
Value(s)
Population size
ℓ
40
Generations
K
1000
Tournament size
st
2
Mutation rate
α
0.75
Mutation strength
β
4
Connectivity threshold
λ2t
0.001
Table 1: Design parameter of the algorithm.
Figure 3: Results for target graphs of size n=24 . Boxplots for 30 runs and 1000 generations showing the final best fitness measured by the distance d , see Eq. ( 2 ), for eight initial graph populations and three crossover implementations. (a) Star graph S23 (b) Circulant graph C241,2,…,8 . (c) Circulant graph C241,2,…,6 .
Figure 4: Results for target graphs of varying size. Boxplots showing the final best fitness measured by the logarithmic distance log(d) for eight initial graph populations and graph size n={64,128,256,512} . (a) Star graph Sn−1 (b) Circulant graph Cn1,2,…,⌊n/3⌋ . (c) Circulant graph Cn1,2,…,⌊n/4⌋ .
Figure 5: Scatter plots of final best fitness versus graph metrics for the circulant target graph C241,2,…,8 . The color code indicates different initial populations. (a) Algebraic connectivity (AC). (b) (Average) path length (PL). (c) (Global) clustering coefficient (CC). (d) (Average) betweenness centrality (BC).
Figure 6: Boxplots of the diversity contribution, see Eq. ( 3 ). (a) Star graph S23 (b) Circulant graph C241,2,…,8 . (c) Circulant graph C241,2,…,6 .
Graphs play a crucial role in many applications, ranging from drug discovery to social network modeling and astronomy. Generative models for graphs have substantially advanced in recent years, but we identify relatively simple scenarios where state-of-the-art models struggle to converge within a standard compute budget, or exhibit prohibitively slow generation times. We propose a generative architecture that achieves quality competitive with state-of-the-art models and is orders of magnitude faster at generation. Our approach is inspired by the Aldous-Hoover theorem, a classic representation theorem that characterizes any probability distribution of graphs that is invariant to permutations of node indices or exchangeable. This theorem establishes that three ingredients suffice: a graph-level latent variable, a set of exchangeable node-specific latent variables, and a so-called graphon function that maps graph- and node-level variables to the probability of an edge between any node pair. Given a training set of graphs, our exchangeable Variational Graph AutoEncoder (xVGAE) learns an approximation to their underlying graphons, as well as graph- and node-level latent variables. We show that our xVGAE encodes latent representations that correlate with graph- and node-level properties, and can (quickly, in one shot) generate new graphs that closely match key training set statistics.
Daniele Micheletti, Federica Zoe Ricci, Erik B. Sudderth
University of California, Irvine · Swarthmore College
Molecule generation methods that leverage generative models have been successfully applied to drug discovery. However, they often require extensive pre-training, suffer statistical biases in the training data, and might suffer from limited interpretability of generated chemical structures. In this work, we introduce SpectralMol, an algorithm based on evolutionary computation that processes chemical structures as a compact matrix of Fourier coefficients, projected onto a fixed basis to generate position-wise latent vectors for SELFIES decoding. The NSGA-II algorithm enforces diversity and enable separate objective functions rather than collapsed objectives into a scalar reward. The quality of the algorithm was tested against standardized benchmarks. The results show comparable aggregate benchmark performance with a task-dependent profile: SpectralMol is strongest on several multi-parameter optimization tasks. The same benchmark was used to perform an ablation study to demonstrate the advantages of a structured latent matrix. Finally, method was tested on a realistic ClpP-targeted drug-discovery benchmark, comparing it with the reinforcement-learning-based model under a fixed oracle-call budget. SpectralMol generates more docking hits and more diverse scaffolds while maintaining competitive physicochemical properties. The representation adopted in this work can cleanly separates scaffold-level modifications from localized substructure variations, as the former occur with perturbations of low-frequency Fourier modes and the latter with perturbations of high-frequency Fourier modes. The results support the evidence that frequency-controlled evolutionary dynamics provide an interpretable, efficient, and training-free route to multi-objective molecular design.
Elia Colleoni, Paolo Guida, Didier Barradas-Bautista +1
Clean Energy Research Center (CERP) Physical Science and Engineering (PSE) Division King Abdullah University of Science and Technology Thuwal, Saudi Arabia 23955 · Kaust Visualization Lab (KVL) Core Lab Division King Abdullah University of Science and Technology Thuwal, Saudi Arabia 23955
Graph-based techniques and spectral graph theory have enriched the field of machine learning with a variety of critical advances. A central object in the analysis is the graph Laplacian L, which encodes the structure of the graph. We consider the problem of learning over this Laplacian in a distributed streaming setting, where new edges of the graph are observed in real time by a network of workers. In this setting, it is hard to learn quickly or approximately while keeping a distributed representation of L. To address this challenge, we present a novel algorithm, GSQUEAK, which efficiently sparsifies the Laplacian by maintaining a small subset of effective resistances. We show that our algorithm produces sparsifiers with strong spectral approximation guarantees, all while processing edges in a single pass and in a distributed fashion.
Daniele Calandriello, Ioannis Koutis, Alessandro Lazaric +1
SequeL team, INRIA Lille - Nord Europe, France · LCSL, IIT, Italy · New Jersey Institute of Technology, USA +1