Deep-Learning Solvers and Surrogates for Infinity and p-Laplace Problems
Organizations: NVIDIA AI Technology Center, NVIDIA, Hong Kong, China · Department of Mathematics, Simon Fraser University, Burnaby, British Columbia, Canada · NVIDIA AI Technology Center, NVIDIA, Singapore, Singapore
Abstract
We investigate the use of neural network solvers for infinity and -Laplace problems, which are fundamental in nonlinear analysis and have practical applications. Our approach employs Physics-Informed Neural Networks (PINNs) and Deep Operator Networks (DeepONets) to address computational challenges associated with large values, ranging from to , on various 2D and 3D domains. Our method offers advantages over traditional physics-based solvers, especially in three dimensions where mesh-based solvers become very costly for these problems. We also establish conditional convergence results for PINN approximations of both problems and a universal approximation result for DeepONet on the parametric -Poisson problem. We demonstrate the effectiveness of these neural network solvers through numerical experiments and compare their performance with conventional methods.
Figures & tables
| Example | Equation of domain | Cell edge length | Mesh size | ||||
|---|---|---|---|---|---|---|---|
| mean | max | min | # cells | # vertices | # faces | ||
| 2D disc | e-02 | e-02 | e-02 | ||||
| Ellipse 1 | e-02 | e-02 | e-03 | ||||
| Ellipse 2 | e-02 | e-02 | e-03 | ||||
| Ellipse 3 | e-03 | e-02 | e-03 | ||||
| 3D ball | e-02 | e-02 | e-03 | ||||
| Training: | ||
| ( 6 ) | Enforces Dirichlet boundary data | |
| ( 7 ) | Enforces mixed Dirichlet-Neumann boundary data | |
| ( 8 ) | Enforces governing equation | |
| ( 9 ) | Total training objective | |
| Testing: | ||
| ( 26 ) | Infinity Laplacian: error vs infinity solution |
| Training: | ||
| ( 24 ) | Data-driven training objective | |
| Testing: | ||
| ( 27 ) | -Laplacian: error vs limiting infinity solution |
| Example | Exact solution | MSE | Runtime | |||
|---|---|---|---|---|---|---|
| Our method | Newton | PINN inference | Newton | |||
| (mean s.d.) | (+training) | |||||
| Arctan, Fig 4 | e-01 | e-07 | e-05 | e-04s (+ s) | s | |
| Aronsson (square), Fig 6 | e-01 | e-07 | e-05 | e-05s (+ s) | s | |
| Aronsson (disc), Fig 6 | e-01 | e-07 | e-04 | e-05s (+ s) | s | |
| Simple training | Iterative training | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| total loss | PINNs loss | total loss | PINNs loss | |||||||
| e-05 | e-05 | e-03 | e-03 | e-05 | e-05 | e-03 | e-03 | e+01 | e-01 | |
| e-05 | e-05 | e-03 | e-03 | e-05 | e-06 | e-03 | e-03 | e+00 | e-01 | |
| e-07 | e-07 | e-03 | e-04 | e-05 | e-06 | e-03 | e-04 | e+00 | e-01 | |
| e-07 | e-07 | e-03 | e-04 | e-05 | e-05 | e-03 | e-04 | e-01 | e-01 | |
| e-05 | e-06 | e-03 | e-04 | e-04 | e-05 | e-02 | e-04 | e-01 | e-01 | |
| total loss | PINNs loss | ||||||
|---|---|---|---|---|---|---|---|
| e-05 | e-05 | e-04 | e-02 | e-01 | e-07 | e-01 | |
| e-05 | e-06 | e-04 | e-02 | e-01 | e-05 | e-01 | |
| e-05 | e-06 | e-04 | e-02 | e-01 | e-05 | e-01 | |
| e-05 | e-06 | e-04 | e-02 | e-01 | e-05 | e-01 | |
| e-05 | e-06 | e-04 | e-03 | e-01 | e-06 | e-01 | |
| e-06 | e-07 | e-04 | e-05 | e-01 | e-06 | e-01 |
| Disc domain | Square domain | |||||
|---|---|---|---|---|---|---|
| (no limit reference) | (no limit reference) | |||||
| e-02 | e-02 | e-02 | e-02 | e-02 | e-02 | |
| e-05 | e-05 | e-05 | e-05 | e-05 | e-05 | |
| e-06 | e-06 | e-06 | e-05 | e-05 | e-05 | |
| e-06 | e-06 | e-06 | e-06 | e-06 | e-06 | |
| e-05 | e-05 | e-05 | e-06 |
| Example | Equation of domain | At largest training data | Runtime | |||
|---|---|---|---|---|---|---|
| DeepONet | Newton | |||||
| inference | ||||||
| 2D disc, Fig 9 (a) | e-01 | e-06 | e-06 | e-04s | s | |
| Ellipse 1, Fig 9 (b) | e-01 | e-06 | e-05 | e-04s | 3.5 hours | |
| Ellipse 2, Fig 9 (c) | e-01 | e-06 | e-05 | e-04s | ||
| Ellipse 3, Fig 9 (d) | e-01 | e-06 | e-06 | e-04s | ||
| Evaluation | |||
|---|---|---|---|
| Training | e-08 | e-03 | |
| Interpolation | e-06 | e-03 | |
| Training | e-08 | e-03 | |
| Interpolation | e-08 | e-03 | |
| Training | e-08 | e-04 | |
| Interpolation | e-08 | e-04 |
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| Single-network ( reference) | |||
| Variant | Arctan | Aronsson (square) | Aronsson (disc) |
| normal (baseline) | e-07 | e-07 | e-07 |
| Stabilization ablations | |||
| clip0 | e-07 | e-07 | e-07 |
| out0 | e-06 | e-06 | e-04 |
| eta0 | e-06 | e-07 | e-07 |
| Configuration | ||
|---|---|---|
| baseline (all enabled) | e-04 | e-02 |
| Single component disabled | ||
| clip0 (no residual clipping) | e-04 | e-03 |
| out0 (no outlier removal) | e-04 | e-02 |
| eta0 (no -regularization) | e-04 | e-02 |
| gradclip0 (no gradient norm clipping) | e-04 | |
| Band | values | Epochs/ | LR schedule | schedule |
|---|---|---|---|---|
| 1 | (11 values) | 100 | Cosine | AlphaPlateauScheduler (adaptive) |
| 2 | 20 | Constant | Fixed | |
| 3 | 20 | Constant | Fixed | |
| 4 | 20 | Constant | Fixed | |
| 5 | 20 | Constant | Fixed |
| Stage | values | Epochs/ | Interior points | LR schedule | schedule |
|---|---|---|---|---|---|
| 1 | up to | Cosine | AlphaPlateauScheduler | ||
| 2 | Cosine | Fixed | |||
| 3 | (refinement) | Cosine | Fixed | ||
| 4 | Cosine | Fixed | |||
| 5 | Cosine | Fixed | |||
| 6 | Constant | Fixed |
| Domain | Interior | Boundary | Test | Time (s) | Test MSE | |
| Distance-to-origin (2D) | ||||||
| Disc | 783,764 | 1,100 | 7,668 | 1.0 | 524 | |
| Square | 1,000,000 | 1,100 | 10,000 | 1.0 | 691 | |
| Distance-to-boundary (2D) | ||||||
| Disc | 783,764 | 10,000 | 7,668 | 1.0 | 523 | |
| Square | 1,000,000 | 40,000 | 10,000 | 1.0 | 681 | |
Neural PDE Solvers
Neural PDE solvers use trainable models to approximate solutions or solution operators for partial differential equations, often with physical constraints.
See all 271 papers