LUMINA: Foundation Models for Topology Transferable ACOPF
Organizations: Argonne National Laboratory, Lemont, IL 60439, USA · Emory University, Atlanta, GA 30322, USA · Sogang University, Seoul, South Korea
Abstract
Foundation models in general promise to accelerate scientific computation by learning reusable representations across problem instances, yet constrained scientific systems, where predictions must satisfy physical laws and safety limits, pose unique challenges that stress conventional training paradigms. We derive design principles for constrained scientific foundation models through systematic investigation of AC optimal power flow (ACOPF), a representative optimization problem in power grid operations where power balance equations and operational constraints are non-negotiable. Through controlled experiments spanning architectures, training objectives, and system diversity, we extract three empirically grounded principles governing scientific foundation model design. These principles characterize three design trade-offs: learning physics-invariant representations while respecting system-specific constraints, optimizing accuracy while ensuring constraint satisfaction, and ensuring reliability in high-impact operating regimes. We present the LUMINA framework, including data processing and training pipelines to support reproducible research on physics-informed, feasibility-aware foundation models across scientific applications.
Figures & tables
| Trans.+MSE | HGT+MSE | |||
| Training → Eval | OPF Sol. Err. | Viol. | OPF Sol. Err. | Viol. |
| case30 → case57 | 4.743 | 5.053 | 5.299 | 2.060 |
| case30 → case118 | 1.912 | 9.118 | 2.030 | 3.766 |
| case{57,118} → case30 | 1.120 | 4.853 | 0.4693 | 2.286 |
| case{30,118} → case57 | 5.677 | 1.990 | 5.6337 | 1.4781 |
| case{30,57} → case118 | 2.011 | 26.295 | 6.173 | 12.26 |
| Case | Total Violation Norm | Training Steps | ||
|---|---|---|---|---|
| Scratch | Finetuned | Scratch | Finetuned | |
| 118 | 8.986 | 6.732_{{\color[rgb]{0,0,1}(-25.1\%)}} | 3,000,000 | 1{,}535{,}008_{{\color[rgb]{0,0,1}(-48.8\%)}} |
| 500 | 15.387 | 14.910_{{\color[rgb]{0,0,1}(-3.1\%)}} | 1,310,048 | 215{,}008_{{\color[rgb]{0,0,1}(-83.6\%)}} |
| HGT+MSE | HGT+AL | |||
| OPF Sol. Err. | Viol. | OPF Sol. Err. | Viol. | |
| case30 → case57 | 5.299 | 2.060 | 5.311 | 0.230 |
| case30 → case118 | 2.030 | 3.766 | 2.030 | 1.262 |
| case{57,118} → case30 | 0.4693 | 2.286 | 0.547 | 0.239 |
| case{30,118} → case57 | 5.6337 | 1.4781 | 5.225 | 0.018 |
| case{30,57} → case118 | 6.173 | 12.26 | 2.837 | 0.907 |
LUMINA: A Grid Foundation Model for Benchmarking AC Optimal Power Flow Surrogate Learning
Residuals Are Not Enough: Limits of Physics-Informed Pre-Training for Scientific Foundation Models
nice,'' e.g., structured, well-aligned settings: it enhances generalization and reduces data dependence, compared to data-only pre-training. However, these advantages diminish significantly as the downstream tasks become harder,'' e.g., as they involve discontinuities or deviate from the pre-training distribution. In complex or structurally different problems, such as those involving new boundary conditions or PDE operators, physics-informed models may perform only on par with---or even worse---than data-driven baselines. While residual-based pre-training helps in idealized regimes, realizing broadly transferable SciFMs will likely require subtler spatiotemporal inductive biases and more principled integration of physical knowledge into model architectures.