PING: physics informed graph neural network for advection-diffusion processes with applications to solar power forecasting
Authors: Jelena Simeunović, Baptiste Schubnel, Pierre-Jean Alet, Pascal Frossard, Rafael E. Carrillo
Organizations: CSEM, Rue de Jaquet-Droz 1, 2002 Neuchâtel, Switzerland · Department of Electrical Engineering, École Polytechnique Fédérale de Lausanne (EPFL), Rte Cantonale, 1015 Lausanne, Switzerland.
Advection-diffusion plays an essential role in transport phenomena such as atmospheric and cloud dynamics. Improved forecasting of cloud motion, in turn, enhances solar power production forecasts and facilitates the integration of additional photovoltaic (PV) sources into the power grid. However, both classical numerical models and emerging deep learning approaches face challenges when applied to spatially irregular sensor networks such as those formed by weather stations. In this work, we adopt a graph signal processing perspective and model advection-diffusion particles as signals on a graph to capture the dynamics of these processes. We introduce a Physics-Informed Graph Neural Network (PING) for forecasting future advection-diffusion particle concentrations on irregular grids. The model incorporates a discretized advection-diffusion equation as a soft constraint in the loss function to guide learning toward physically consistent solutions. This model is on par with state of the art models on synthetic and real transport phenomena datasets, including sea surface temperature and cloud index datasets. Furthermore, the PING model is successfully coupled with models for forecasting PV power production. This hybrid approach leverages data fusion from ground-based sensors at PV stations and satellite images with cloud concentration to improve the accuracy of intra-day PV power production.
Figures & tables
Figure 1: PING model with three main parts: flow estimation, flow attention (edge estimation) and flow processor (flow aggregation). The flow estimation part has as input past concentration values C and outputs past velocity and acceleration field estimates. The flow attention takes as inputs the estimated past velocity field v and acceleration fields acc as well as the embedded input concentrations Cemb . The Flow processor predicts the future concentration values C^ using the edge values from the second block. When used for PV power prediction, the predicted concentration (cloud concentration in that case) and future clear sky values Y are fed to the decoder of the PV power forecasting model.
Figure 2: The flow estimator block of the PING model.
Figure 3: The spatial distribution of the subsampling patterns. a) Subsampling set S1 . b) Subsampling set S2 . c) Subsampling set S3 . d) Subsampling set S4 .
Steps ahead
1
2
3
4
5
6
dataset
model
Advection- diffusion dataset
GCLSTM
0.44
0.87
1.46
2.19
3.08
4.28
GCLSTMmlp
0.79
1.18
2.02
2.97
3.97
4.86
PING
1.37
1.51
1.85
2.37
2.9
3.4
Advection dataset
GCLSTM
1.51
2.55
3.69
4.87
6.18
7.73
GCLSTMmlp
1.67
2.51
3.67
4.79
6.09
7.28
Table 1: NRMSE of advection and advection-diffusion datasets on regular grid
Steps ahead
1
2
3
4
5
6
dataset
model
Cloud index dataset
GCLSTM
12.83
18.56
22.03
24.27
25.97
27.26
GCLSTMmlp
13.39
19.78
23.24
25.44
26.9
28.07
FlowCNN
13.49
18.55
21.58
23.71
25.3
26.61
PING
12.21
17.42
20.93
23.47
25.29
26.57
SST dataset
GCLSTM
1.67
2.29
2.89
3.47
4.01
4.48
Table 2: NRMSE of cloud concentration index and sea surface temperature datasets on regular grid
Steps ahead
1
2
3
4
5
6
model
Graph instance
GCLSTM
S1
1.96
2.73
4.06
5.62
7.18
8.42
GCLSTMmlp
1.96
3.1
4.19
5.83
7.38
8.64
PING
3.11
3.97
4.65
5.61
6.74
7.76
GCLSTM
S2
1.92
3.22
4.69
5.9
7.23
8.48
GCLSTMmlp
2.58
3.53
4.63
5.44
6.2
7.2
Table 3: NRMSE of advection datasets on graph instances S1,S2,S3,S4
Steps ahead
1
2
3
4
5
6
model
Graph instance
GCLSTM
S1
12.52
18.07
21.29
23.46
25.07
26.34
GCLSTMmlp
13.12
19.1
22.57
24.69
26.22
27.38
PING
12.64
17.56
20.83
23.13
24.9
26.12
GCLSTM
S2
12.55
18.01
21.35
23.58
25.24
26.66
GCLSTMmlp
16.45
19.52
23.12
25.38
26.86
27.9
Table 4: NRMSE of cloud concentration index datasets on irregular grid
Steps ahead
1
2
3
4
5
6
model
Graph instance
GCLSTM
S1
1.67
2.29
2.89
3.45
4.01
4.52
GCLSTMmlp
1.77
2.34
2.94
3.51
4.02
4.54
PING
1.88
2.44
2.92
3.37
3.9
4.31
GCLSTM
S2
1.69
2.29
2.88
3.43
3.98
4.51
GCLSTMmlp
1.95
2.52
3.1
3.66
4.2
4.56
Table 5: NRMSE of sea surface temperature datasets on irregular grid
Steps ahead
1
2
3
4
5
6
λ1=0.15,λ2=0.05
0.0321
0.0389
0.0404
0.0480
0.0548
0.0619
λ1=0.20,λ2=0.05
0.0250
0.0318
0.0360
0.0399
0.0466
0.0548
λ1=0.15,λ2=0.10
0.0299
0.0352
0.0430
0.0478
0.0574
0.0666
Table 6: NRMSE sensitivity analysis of the physics-informed loss weights on the advection–diffusion dataset under irregular sampling.
Dataset
Model
ϕ(rad)
Advection dataset
PING
0.44
Optical flow
1.16
Advection-diffusion dataset
PING
0.92
Optical flow
1.10
Table 7: Accuracy of velocity estimation on regular grid for advection and advection-diffusion datasets (PING vs. Optical flows)
Figure 4: Example of velocities estimation on a regular grid, for the advection only dataset. The similarity between the ground truth velocity direction and the estimated one is color-coded: yellow represents the perfect alignment between the vectors and darker colors indicate larger deviations. The arrows represent the direction of the velocity vector, black being the ground truth and red the estimated one.
Figure 5: Example of velocities estimation on an irregular grid, for the advection only dataset. The similarity between the ground truth velocity direction and the estimated one is color-coded: yellow represents the perfect alignment between the vectors and darker colors indicate larger deviations. The arrows represent the direction of the velocity vector, black being the ground truth and red the estimated one.
Figure 6: Combination of PING and GCLSTM for PV power forecasting. PING takes as inputs past cloud cover index values C . The encoder of GCLSTM takes as inputs cloud cover index C values, historical clear-sky values Y and historical observations from PV power plants P . The output from PING, the encoder state and future clear-sky values are passed to the decoder.
Figure 7: Evolution of the NRMSE between GCLSTM+PING, GCLSTMmlp and GCLSTM models for six hours ahead for PV power generation, with hourly resolution. The solid line shows the median value among all nodes.
Figure 8: NRMSE evolution of GCLSTM, CloudMove, GCLSTM+PING and persistence model over the forecasting horizon of 6 hours ahead in steps of 15 minutes.
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
Figure 9: Examples of historical cloud concentration, ground truth and forecasted signals across six forecasting horizon values for a specific node on irregular grid. The results are shown for PING and GCLSTM models.
Figure 10: Ground truth and prediction for sixth hour ahead forecasts during variable days, where each forecast was initialized always six hour before its verification time.
Figure 11: Examples of six hours ahead forecasts initialized at 13:00 and16:00 for the PV power prediction dataset. The forecasted signals and the past signal values are shown for PING+GCLSTM and GCLSTM alone.
School of Economics and Management, North China Electric Power University, 102206, Beijing, China · School of Electrical and Electronic Engineering, Nanyang Technological University, 639798, 50 Nanyang Avenue, Singapore · Department of Electrical Engineering, Tsinghua University, 100084, Beijing, China