cs.LGNov 6, 2026

Rethinking How to Leverage Cheap Physics for Data-Efficient Neural Operators

Authors: Shuo Zhang, Senwei Liang

Organizations: Department of Mathematics and Statistics, Texas Tech University, Lubbock, 79409, TX, USA

Abstract

Neural operators learn mappings from PDE inputs, such as initial conditions and coefficient fields, to the corresponding solutions. Once trained, they can rapidly predict solutions for new inputs. However, obtaining input-solution pairs for supervised training often requires expensive numerical simulations, whereas PDE inputs and governing equations provide inexpensive physical information. This raises a question: how can cheap physical information reduce the need for labeled solutions? A natural approach is to use physics to select inputs for labeling, but our acquisition experiments show no consistent advantage over random sampling. This observation motivates exploring an alternative: using cheap physics to improve neural operator initialization before supervised training. We propose Physics-Informed Initialization (PI-Init), a simple yet effective method that pretrains neural operators on unlabeled inputs using physics-informed losses and retains the learned parameters for supervised fine-tuning on the labeled dataset. A linearized analysis shows that pretraining can improve downstream prediction accuracy by reducing initialization errors that limited labeled data cannot effectively correct. Experiments across diverse PDE benchmarks and neural operator architectures demonstrate improvements in predictive accuracy, out-of-distribution generalization, and label efficiency. Representative results show error reductions of up to 62.7% at the same label budget and comparable or better accuracy with 90% fewer labels, relative to supervised-only training.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Preconditioned Physics-Informed Neural Operator Training

    Sep 28, 2026Shizheng Wen, Siddhartha Mishra, Marius ZeinhoferPhysics-Informed Neural OperatorsPDE Operator Learning

  2. Learning Data-Efficient and Generalizable Neural Operators via Fundamental Physics Knowledge

    Feb 16, 2026Siying Ma, Mehrdad M. Zadeh, Mauricio Soroco +3PDE Surrogate ModelingNeural Operators

  3. Data-Efficient Neural Operator Training via Physics-Based Active Learning

    May 20, 2026Alicja Polanska, Lorenzo Zanisi, Vignesh Gopakumar +1Active LearningPhysics-Informed ML