SALTO: Solver-Anchored Lifted Transfer Operators for Nonlinear Event Inference
Organizations: Department of Aerospace Engineering San Diego State University San Diego, CA 92182, USA · Computational Science Research Center San Diego State University San Diego, CA 92182, USA · Department of Mechanical and Aerospace Engineering University of California, Irvine, CA 92697, USA
Abstract
Learned dynamical models can accurately predict trajectories while producing unreliable sensitivities when differentiated or transposed, limiting their use in inverse problems and scientific decision-making. Classical adjoints provide exact local derivatives, but a single adjoint cannot represent the nonlinear response of a system to a family of finite-amplitude perturbations. We introduce SALTO (Solver-Anchored Lifted Transfer Operators), a Koopman-based framework for inferring finite-amplitude sources. In the lifted space, the nonlinear dynamics are approximated by a linear propagator, and its transpose carries each sensor backward in a single solve. The result is a reusable lifted adjoint that predicts the measurement produced by any candidate localized event with one encoder pass and an inner product. To give the model the simulator's exact local behavior, SALTO imposes three structural constraints: it anchors the physical-state dynamics to the simulator's linearized propagator, centers the learned observables so that they vanish to second order at the reference state, and uses a block-triangular lifted propagator. These constraints guarantee that the model reduces to the simulator's tangent dynamics and classical adjoint as the amplitude vanishes, while the learned observables carry only the finite-amplitude correction. On three nonlinear PDE systems, SALTO predicts the measurements of finite-amplitude sources to within 2-8% where the classical adjoint is in error by 41-165%, recovers source position and intensity from sparse sensors nearly as accurately as inversion through the solver, and samples the joint posterior of two interacting sources, matching the solver's posterior on reaction-diffusion at a twentieth of its cost. One trained model serves new sensor layouts and measurement times with a single backward solve.
Figures & tables
| accuracy | cost | ||||
|---|---|---|---|---|---|
| case | model | (%) | (cells) | (%) | seconds |
| Burgers self-advection | linear | 72.9 | 6.00 | 15.2 | 0.003 |
| quadratic | 96.1 | 3.00 | 8.9 | 4.1 | |
| lifted (ours) | 1.8 | 1.00 | 3.6 | 9.6 | |
| solver | – | 1.00 | 3.4 | 167 | |
| reaction–diffusion saturation | linear | 164.5 | 0.63 | 40.2 | 0.005 |
| reaction–diffusion | Kolmogorov flow | |||||||
| (%) | gradient (%) | (%) | gradient (%) | |||||
| model | top band | weak | train | top band | weak | train | ||
| lifted (ours) | 6.0 | 0.7 | 21 | 13 | 0.6 | 17 | ||
| unconstrained | 3.2 | 0.23 | 4.9 | 7.8 | 14 | 0.67 | 16 | 25 |
| centering only | 4.8 | 2.9 | 17 | 14 | 10 | 20 | ||
| anchoring only | 9.2 | 1.9 | 11 | 23 | 22 | 8.2 | 17 | 27 |
Appendix figures & tables17 assets
Supplementary material from the paper’s appendix.
Appendix
| (%), training range | at | inference (%) | |||||||
|---|---|---|---|---|---|---|---|---|---|
| problem | ours | unconstr. | linear | ours | unconstr. | linear | ours | brute force | linear |
| Burgers, base flow | 0.9 | – | 40.7 | – | 5.8 | 5.8 | 20.1 | ||
| reaction–diffusion | 3.0 | 1.9 | 76.7 | 12.6 | 10.7 | 35.9 | |||
| Kolmogorov flow | 5.7 | 9.7 | 18.4 | 3.8 | 2.7 | 8.3 | |||
| forward error at , linearized solver | 10.9% | 31.7% | 79.4% |
| forward error at , lifted model | 0.5% | 0.5% | 1.6% |
| (%) per intensity band | (ratio) at | inference | |||||
|---|---|---|---|---|---|---|---|
| model | (%) | ||||||
| lifted (ours) | 1.2 | 1.7 | 6.0 | 13.9 | 0.145 | 12.6 | |
| unconstrained lift | 1.3 | 1.1 | 3.2 | 6.9 | 0.143 | 11.3 | |
| centering only | 0.9 | 1.3 | 4.8 | 12.1 | 0.155 | 15.7 | |
| anchoring only | 3.4 | 4.2 | 9.2 | 28.8 | 0.181 | 14.3 | |
| linear adjoint | 23.3 | 59.8 | 146.9 | 165.2 | 0.147 | 35.9 | |
| (%) per intensity band | (ratio) at | inference | |||||
|---|---|---|---|---|---|---|---|
| model | (%) | ||||||
| lifted (ours) | 1.6 | 3.0 | 12.6 | 20.7 | 0.111 | 3.8 | |
| unconstrained lift | 9.6 | 5.6 | 14.0 | 26.3 | 0.114 | 4.7 | |
| centering only | 4.1 | 3.5 | 13.5 | 22.6 | 0.106 | 4.2 | |
| anchoring only | 8.1 | 8.3 | 21.9 | 39.6 | 0.133 | 5.0 | |
| linear adjoint | 4.3 | 11.3 | 39.6 | 65.9 | 0.204 | 8.3 | |
| val. | (%) | (ratio) at | inference | |||||
| iters | MSE | top band | beyond | (%) | ||||
| reaction–diffusion | ||||||||
| 1 | 2,304 | 300 | 11.4 | 9.0 | 0.192 | 13.7 | ||
| 2 | 4,608 | 300 | 6.0 | 13.9 | 0.145 | 12.6 | ||
| 4 | 9,216 | 300 | 1.6 | 4.0 | 0.113 | 8.7 | ||
| Kolmogorov flow | ||||||||
| reaction–diffusion, band | Kolmogorov flow, band | |||||||||
| model | ||||||||||
| lifted (ours) | 0.7 | 3.3 | 7.5 | 21 | 73 | 0.6 | 2.6 | 7.9 | 17 | 35 |
| unconstrained lift | 4.9 | 2.9 | 4.7 | 7.8 | 24 | 16 | 13 | 18 | 25 | 37 |
| centering only | 2.9 | 3.1 | 5.3 | 17 | 60 | 10 | 8.1 | 11 | 20 | 29 |
| anchoring only | 11 | 7.0 | 12 | 23 | 114 | 17 | 19 | 19 | 27 | 54 |
| neural surrogate | 66 | 61 | 66 | 94 | 170 | 18 | 17 | 17 | 37 | 68 |
| case | model | (cells) | (%) |
|---|---|---|---|
| Burgers | linear | 6.00 [5.00, 6.00] | 15.2 [13.8, 16.5] |
| quadratic | 3.00 [2.00, 3.00] | 8.9 [8.2, 9.7] | |
| lifted | 1.00 [1.00, 1.00] | 3.6 [3.3, 3.9] | |
| solver | 1.00 [1.00, 1.00] | 3.4 [3.1, 3.7] | |
| reaction–diffusion | linear | 0.63 [0.51, 0.84] | 40.2 [34.7, 45.5] |
| quadratic | 0.91 [0.60, 1.21] | 37.1 [23.2, 44.6] |
| inter- | lifted functional | linear embedding | brute force | speed-up | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| problem | pairs | action (%) | (%) | both (%) | (%) | both (%) | (%) | both (%) | brute/lifted | |||
| reaction–diffusion | separated | 0.3 | 0.009 | 0.7 | 100.0 | 0.092 | 33.9 | 96.7 | 0.008 | 0.6 | 100.0 | 18 |
| separated, strong | 0.9 | 0.010 | 1.3 | 100.0 | 0.116 | 42.2 | 96.7 | 0.007 | 0.7 | 100.0 | 24 | |
| overlapping | 16.1 | 0.035 | 9.0 | 83.3 | 0.145 | 37.1 | 63.3 | 0.027 | 6.4 | 93.3 | 24 | |
| overlapping, strong | 22.6 | 0.045 | 9.4 | 80.0 | 0.208 | 49.4 | 33.3 | 0.024 | 5.8 | 100.0 | 26 | |
| Kolmogorov flow | separated | 47.9 | 0.168 | 6.3 | 79.2 | 0.343 | 30.0 | 20.8 | 0.007 | 0.4 | 100.0 | 240 |
| reaction–diffusion | Kolmogorov flow | |||||||||
| model | , | , | 25 rand., | , | pairs | , | , | 25 rand., | , | pairs |
| top training band, | ||||||||||
| lifted (ours) | 1.5 | 1.6 | 1.5 | 1.4 | 0.8 | 6.0 | 11 | 5.8 | 4.4 | 5.2 |
| direct readout | 2.3 | 2.2 | 2.0 | 1.5 | 1.3 | 4.6 | 9.4 | 4.7 | 3.1 | 4.6 |
| direct CNN | 9.2 | 11 | – | – | 5.1 | 17 | 25 | – | – | 8.5 |
| parameter MLP | 5.8 | 5.5 | 5.3 | 7.8 | – | 4.6 | 15 | 4.9 | 5.0 | – |
| reaction–diffusion | Kolmogorov flow | |||||||||||||||
| band | 1 | 2 | 3 | 4 | 1 | 2 | 3 | 4 | 1 | 2 | 3 | 4 | 1 | 2 | 3 | 4 |
| lifted, 400 traj. | 0.2 | 0.3 | 1.5 | 4.2 | 0.3 | 0.8 | 4.7 | 13 | 1.2 | 1.6 | 6.0 | 12 | 1.4 | 2.2 | 6.6 | 17 |
| readout, 400 traj. | 0.5 | 0.7 | 2.3 | 5.2 | – | – | – | – | 1.1 | 2.1 | 4.6 | 10 | – | – | – | – |
| anchored CNN, 400 traj. | 3.4 | 3.3 | 12 | 67 | – | – | – | – | 2.3 | 4.0 | 9.1 | 14 | – | – | – | – |
| lifted, 50 traj. | 3.9 | 8.8 | 32 | 84 | 6.2 | 15 | 56 | 140 | 2.8 | 5.5 | 17 | 38 | 3.1 | 6.5 | 20 | 41 |
PDE Inverse Problems
Partial differential equation (PDE) inverse problems recover hidden fields, parameters, or sources from observations governed by physical laws.
See all 107 papers