cs.LGNov 10, 2026

Metamorphic testing of learned AC optimal power flow surrogates reveals representation dependence

Authors: Stephen Peng, Vineet Jagadeesan Nair

Organizations: AI Science Institute, Boston Consulting Group

Abstract

Evaluating a learned AC optimal power flow (AC-OPF) surrogate on one grid serialization cannot show whether its accuracy depends on that encoding. We test this dependence with thirteen metamorphic relations, each specifying when a transformation is valid and how to compare its outputs. Our audit covers 17 model and pipeline configurations: two released trained checkpoints and 15 random-weight architecture or mechanism controls. Every configuration violates at least six relations, even at reporting tolerances ten times tighter or looser. For GridSFM-Open v1.1, source inspection and intermediate-tensor interventions point to an indexing bug and three noncanonical or numerically unstable preprocessing choices; a repaired checkpoint remains untested. In a separate case500 training experiment, augmentation lowers transformed-view error in three of four models and median discrepancy and constraint-violation P95 in all four. These benefits depend on the training protocol: some relations worsen, and every evaluated prediction remains AC infeasible. A GPU/CPU eigensolver mismatch accounts for most of the large raw-Laplacian-baseline gain. We recommend reporting representation consistency alongside accuracy, feasibility, and cost. These results establish neither deployment readiness nor universal invariance.

Figures & tables

Appendix figures & tables16 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. LUMINA: A Grid Foundation Model for Benchmarking AC Optimal Power Flow Surrogate Learning

    May 4, 2026Hongwei Jin, Keunju Song, Zeeshan Memon +5Neural Surrogate ModelingBenchmark Design

  2. Solver-Admitted Metamorphic Testing of Learned Network Optimization Surrogates

    Nov 6, 2026Vineet Jagadeesan Nair, Stephen Peng, Arun RavindranMetamorphic TestingSurrogate Modeling

  3. Scaling Laws for Physics-Aware ACOPF Surrogate Learning

    Sep 14, 2026Yijiang Li, Emon Dey, Stefano Fenu +3Neural Surrogate ModelingOptimal Power Flow