cs.CENov 9, 2026

Physics-informed neural networks in the small-data regime: A controlled comparison with classical PDE surrogates

Authors: Kirill Katsuba, Oleg Rudenko, Egor Bugaev, Alexander Tarakanov

Organizations: Faculty of Computer Science, HSE University, 11 Pokrovsky Bulvar, Moscow, 109028, Russia · VK, 39 Leningradsky Prospekt, Building 79, Moscow, 125167, Russia

Abstract

Neural surrogates for engineering models are often trained on large collections of simulated solutions. We investigate whether physics-informed neural networks (PINNs) can achieve accurate predictions from scarce labelled observations by incorporating governing equations and prescribed initial and boundary conditions. We introduce hierarchical loss weighting (H-PINN) and its gradient-direction-aware extension (HO-PINN), which adjust the emphasis on physical constraints according to higher-priority losses. Hierarchical PINNs are compared with Vanilla PINN, tuned gradient boosting, support-vector regression, and Gaussian-process regression on a heat equation and three heterogeneous two-phase-flow benchmarks. Experiments use 20--1000 labelled states and ten paired seeds. Each label is one coordinate--state observation, not a complete simulation. At least one PINN variant achieves the highest mean primary-target R2R^2 in each interpolation and equation-assisted forecasting comparison at 20 and 50 labels. The advantage for water saturation persists across all tested budgets. Hierarchical weighting reduces variability across runs in selected settings. These results demonstrate that known physics can support accurate neural surrogate predictions from very few solution observations, at substantially higher fitting cost than the tested classical regressors.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. PINNs Failure Modes are Overfitting

    May 29, 2026Nigel T. Andersen, Takashi MatsubaraNeural Network GeneralizationNeural PDE Solvers

  2. Finite Volume-Informed Neural Network Framework for 2D Shallow Water Equations: Rugged Loss Landscapes and the Importance of Data Guidance

    May 9, 2026Xiaofeng LiuPDE SolvingPDE Surrogate Modeling