Symplectic Normal Coordinates Flow for Generative Modeling of Hamiltonian Systems
Organizations: Physical Sciences Division, University of Chicago, Chicago, IL 60637
Abstract
In conditioned generative models of physical systems, the densities at different values of the conditioning parameters are often related through symplectic transformations. For stable linear Hamiltonian systems, there exists a symplectic transformation to "normal coordinates" such that the dynamics is reduced to rotations in each phase-space plane. This picture extends to the nonlinear case where, away from resonances, the Birkhoff normal form again consists of rotations in phase space, now with amplitude dependence. In this work, we introduce an invertible symplectic flow layer consisting of amplitude-dependent rotations in learned normal coordinates. We derive the condition under which the nonlinear rotation layer is symplectic and detail an architecture that guarantees it. Experiments are carried out on three conditional generative modeling problems: a synthetic chain of coupled nonlinear oscillators and two problems from accelerator physics. We show empirically that normalizing flows with the new layers achieve competitive or superior negative log-likelihoods compared to baseline flows, with gains that grow with the strength of the nonlinearity on the synthetic system.
Figures & tables
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | Average | |||||
|---|---|---|---|---|---|---|
| Real NVP | 0.974 | 0.988 | 0.960 | 0.961 | 0.987 | 0.974 |
| SympNet | 0.913 | 0.924 | 0.589 | 0.610 | 0.915 | 0.790 |
| Normal coordinates | 0.969 | 0.997 | 0.994 | 0.960 | 0.986 | 0.981 |
| Experiment | NLL (nats/sample) |
|---|---|
| Baseline | 11.6 (0.9) |
| Remove amplitude dependence of rotation layer | 17.0 (0.4) |
| Remove rotation layer | 16.7 (0.1) |
| Use MLP instead of GradNet in rotation layer | 13.0 (0.5) |
| Conditioning Network Layer Width | NLL (nats/sample) |
|---|---|
| 16 | 11.2 (0.3) |
| 32 | 11.6 (0.8) |
| 64 (baseline) | 11.6 (0.9) |
| 128 | 11.2 (0.2) |
Normalizing Flows
Normalizing flows are invertible neural transformations that model complex probability distributions with tractable likelihoods and sampling.
See all 78 papers