Coupling-Robust Accuracy in Multiphysics Physics Informed Neural Networks via Kronecker-Preconditioned Optimization
Organizations: Dept. of Control and Instrumentation Engineering, Korea University, Sejong, South Korea · BK21 FOUR Smart Mobility Education and Research Team, Korea University, Sejong, South Korea
Abstract
Physics-informed neural networks (PINNs) for coupled multiphysics systems suffer systematic accuracy degradation as inter-equation coupling strengthens. We provide a theoretical explanation through neural tangent kernel (NTK) analysis: for linearly coupled systems, the standard NTK's spectral radius grows as with coupling strength , shrinking the stable learning rate, while block-diagonal Gauss--Newton (GN) preconditioning yields a preconditioned NTK whose spectral radius is bounded by (number of networks), independent of . Adam's diagonal preconditioning destroys this projector structure -- inflating far above for any coupling type -- and its residual-dynamics kernel grows as , placing its stable learning rate strictly between gradient descent and GN. For one-way coupling the limitation is class-wide: no diagonal preconditioner, fixed or adaptive, halves the driving residual in fewer than iterations ( if fixed), whereas block-diagonal GN requires . We verify growth across linearly coupled benchmarks and confirm in all three 1D systems, including nonlinearly coupled NP+P. Combining the Kronecker-preconditioned optimizer SOAP with inverse-gradient-norm loss balancing (SOAP+GradNorm) yields coupling-robust accuracy: across 222 experiments spanning three 1D systems and a 2D electroosmotic flow benchmark, SOAP+GradNorm maintains final-epoch accuracy across coupling strengths, with degradation in nonlinear NP+P while Adam+GradNorm fails (). SOAP+GradNorm further scales to a 2D, 6-PDE electroosmotic flow at EDL-resolved conditions down to -- a regime all prior PINN electrokinetics studies have avoided -- where Adam+GradNorm fails entirely ().