cs.LGNov 18, 2026

TangentPDE: Learning Local Operator Responses with Sparse Finite-Difference Supervision

Authors: Xinjian Xie, Ruxuan Chen, Jiashu Li, Tianyu Gao, Ye Wei

Organizations: Sichuan Agricultural University, China · Harbin Engineering University, China · University of Southampton, United Kingdom · Wenzhou-Kean University, China · 

Abstract

Neural PDE operators are often optimized through state reconstruction, which largely constrains operator values at observed inputs but does not fully characterize their sensitivity to local perturbations. A more faithful approximation of operator behavior requires not only accurate state predictions, but also correct variations along local perturbation directions. We present TangentPDE, which uses finite differences to approximate directional derivatives and constructs task-relevant finite-step responses from the state outputs of a reference solver at sparse paired inputs. Its objective jointly constrains state fidelity, response-direction alignment, and response-magnitude calibration, thereby learning both operator values and their local variations. Because the response labels are constructed solely from state outputs at paired inputs, the method requires neither explicit derivative labels, linearized or adjoint PDE solves, nor full Jacobians, and remains applicable to nonlinear solvers without derivative interfaces. Building on this, we additionally propose a selectively executed adaptation mechanism to strengthen local operator representations under finite-difference supervision. Budget-matched and correspondence-perturbed controls isolate the effect of relational supervision from improvements attributable to additional state observations or increased data volume. Designed as a plug-and-play training framework, TangentPDE integrates with diverse neural-operator backbones. Across four PDE systems and 20 task-backbone settings, TangentPDE lowers the three-seed mean state error in 18 settings and the corresponding Rollout@20 error in 18, while intrinsic finite-step response gains are strongest on DiffReact and remain task- and backbone-dependent elsewhere.

Figures & tables

Appendix figures & tables32 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Derivative-Informed Training of Neural Operators On-the-Fly via Sketched Tangent Consistency

    Sep 26, 2026Xinhan Yang, Lu Lu, Shancong MouNeural OperatorsPhysics-Informed Neural Operators

  2. Sensitivity-Constrained Neural Operators for Data-Efficient Forward and Inverse Modeling of Partial Differential Equation Systems

    Aug 30, 2026Abdolmehdi Behroozi, Chaopeng Shen, Daniel Kifer +1PDE Surrogate ModelingJacobian Regularization

  3. Fractional is Better: Learnable Derivative Orders in Neural Operator Learning

    Oct 14, 2026Fares B. Mehouachi, Saif Eddin JabariPDE Operator LearningNeural Operators