Exponential-Nemytskii Neural Operators: Learning Field Evolution Across Step Sizes
Organizations: School of Mathematics, University of Birmingham, UK
Abstract
In variable-step operator learning, agreement at observed step sizes does not by itself determine predictions at other temporal resolutions. We propose an operator whose step-size dependence is prescribed by a first-order Duhamel approximation of semilinear dynamics. It combines exact linear propagation with a local nonlinear function of the field and its derivatives, allowing evaluation below the observation interval without supervision densely sampled across step sizes. Under suitable conditions and at fixed spatial resolution, we prove that agreement between models at two step sizes controls their prediction differences throughout a prescribed range. We also give conditions for local identifiability of both components from two step sizes, supporting interpretation of the learned structure. A latent extension applies the same construction to learned fields. We evaluate the base model on two synthetic problems and the extension on two real datasets against several baselines.
Figures & tables
| 2.895 | 3.676 | 4.200 | |
| 2.179 | 2.695 | 2.989 | |
| 0.313 | 0.721 | 1.115 | |
| 0.319 | 0.743 | 1.151 |
| truth | ||||
|---|---|---|---|---|
| recovered |
| Method | ||||
|---|---|---|---|---|
| ENNO ( ) | 0.197 0.008 | 0.313 0.015 | 0.721 0.032 | 1.115 0.049 |
| TI-DeepONet | 2.374 0.066 | 1.369 0.035 | 2.556 0.078 | 3.329 0.105 |
| E-WSINDy | 0.830 0.061 | 1.459 0.079 | 2.436 0.124 | 2.793 0.143 |
| OSG-FNO | 3.264 0.083 | 2.045 0.089 | 2.008 0.088 | 2.112 0.080 |
| KNO | — | 2.049 0.096 | 1.824 0.083 | 1.912 0.087 |
| NOMAD | 4.800 0.147 | 4.815 0.152 | 4.804 0.152 | 4.832 0.149 |
| 2.439 | 4.011 | 4.647 | |
| 0.021 | 0.074 | 0.129 | |
| 0.021 | 0.074 | 0.128 |
| truth | |||
|---|---|---|---|
| recovered |
| Method | ||||
|---|---|---|---|---|
| ENNO ( ) | 0.011 0.001 | 0.021 0.002 | 0.074 0.008 | 0.129 0.013 |
| E-WSINDy | 0.030 0.003 | 0.030 0.003 | 0.145 0.016 | 0.283 0.030 |
| KNO | — | 0.269 0.037 | 0.376 0.049 | 0.562 0.072 |
| OSG-FNO | 0.262 0.037 | 0.524 0.060 | 2.617 0.303 | 5.223 0.607 |
| TI-DeepONet | 14.597 2.122 | 14.551 2.068 | 29.970 3.330 | 50.831 5.843 |
| NOMAD | 79.330 5.491 | 60.124 4.971 | 59.634 4.909 | 58.969 4.898 |
| Method | 5 minutes | 25 minutes | 50 minutes |
|---|---|---|---|
| ENNO | 1.4 0.05 | 5.4 0.15 | 9.2 0.25 |
| KNO | 1.8 0.05 | 6.7 0.17 | 10.3 0.28 |
| OSG-FNO | 1.8 0.04 | 8.6 0.15 | 13.7 0.26 |
| NOMAD | 5.6 0.14 | 8.9 0.24 | 13.4 0.40 |
| TI-DeepONet | 6.4 0.16 | 11.4 0.29 | 19.5 0.50 |
| E-WSINDy | 12.5 0.30 | Failed | Failed |
| AUC-PR | ||
|---|---|---|
| Method | ||
| ENNO | ||
| KNO | ||
| OSG-FNO | ||
| TI-DeepONet | Unsupported | |
| NOMAD | Unsupported | |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| KdV | Advection–diffusion | SEVIR (VIL) | WildfireSpreadTS | |
|---|---|---|---|---|
| Latent channels | 1 | 1 | 20 | 4 ( ) / 20 ( ) |
| History length (frames) | 1 | 1 | 10 | |
| Encoder / decoder | identity (learnable variants in Table 11 ) | identity | pointwise MLPs and , 5 hidden layers 256 | same design, and , 5 hidden layers 256 |
| Cutoff ( ) a | 64 | 64 | 64 | 32 |
| Symbol degree | 3 (ablation over – , Table 1) | 2 (ablation over – , Table 4) | 6 | 6 |
| Constant term | trained | trained | fixed at 0 | fixed at 0 |
| KdV | Advection–diffusion | SEVIR | WildfireSpreadTS | |
|---|---|---|---|---|
| Domain and grid | periodic, 128 points | periodic, | km 2 ; VIL on pixels, average-pooled to | daily fire maps at 375 m, padded to |
| Source | Fourier pseudospectral in space, DOP853 in time (rtol ); 10,001 frames over , every 10th kept | explicit Euler, , central differences in space; 5,001 frames over , every 10th kept | real radar, 49 frames per event | real observations, 2018–2021 |
| Initial conditions | 3 sine modes (amplitude for mode ) plus 1 or 2 solitons (amplitude ) | sums of 1–3 Gaussian bumps (amplitude , ) and low-mode Fourier fields | — | — |
| Observation interval | 5 min | 1 day | ||
| Training step sizes | 5, 10 min | 1, 2 days | ||
| Targets at | every 5th frame of the same runs | every 5th frame of the same runs | — | — |
| Variant | |||
|---|---|---|---|
| , identity | 2.898 | 3.683 | 4.189 |
| , | 3.069 | 2.629 | 3.276 |
| , | 1.866 | 2.317 | 2.468 |
| , | 1.877 | 2.289 | 2.449 |
| , identity | 2.181 | 2.700 | 2.994 |
| , | 1.990 | 2.454 | 2.856 |
Neural Operators
Neural operators learn mappings between functions, enabling fast surrogates for PDEs and other continuous physical systems.
See all 313 papers