Current solar flare predictions often lack precise quantification of their reliability, resulting in frequent false alarms, particularly when dealing with datasets skewed towards extreme events. To improve the trustworthiness of space weather forecasting, it is crucial to establish confidence intervals for model predictions. Conformal prediction, a machine learning framework, presents a promising avenue for this purpose by constructing prediction intervals that ensure valid coverage in finite samples without making assumptions about the underlying data distribution. In this study, we explore the application of conformal prediction to regression tasks in space weather forecasting. Specifically, we implement full-disk solar flare prediction using images created from magnetic field maps and adapt four pre-trained deep learning models to incorporate three distinct methods for constructing confidence intervals: conformal prediction, quantile regression, and conformalized quantile regression. Our experiments demonstrate that conformalized quantile regression achieves higher coverage rates and more favorable average interval lengths compared to alternative methods, underscoring its effectiveness in enhancing the reliability of solar weather forecasting models.
Figures & tables
Fig. 1 : Distribution of normalized peak X-ray flux values (target values) across different partition.
Fig. 2 : Overview of the process for conformal prediction.
Optimal Parameters
Search Space
Confidence Level
AlexNet
MobileNet
InceptionV3
ResNet50
Learning Rate
10−7 to 10−5
95%
2.5×10−7
10−6
5×10−7
5×10−5
90%
5×10−6
5×10−6
10−6
10−5
85%
10−6
6×10−8
5×10−7
10−5
80%
5×10−6
10−6
10−6
10−5
Weight Decay
0, 10−5 , 10−4
95%
10−5
10−4
0
10−4
TABLE I: Optimal parameters for each model with each confidence level
Model
Average
Standard Deviation
AlexNet
0.473
0.040
MobileNet
0.454
0.037
InceptionV3
0.458
0.028
ResNet50
0.496
0.017
TABLE II : The R-squared results of the models, with each learning algorithm trained using four different significance levels ( α ). Among the models, ResNet50 demonstrates the highest average R-squared score.
Avg. Length
Avg. Coverage
ICC
CP
AlexNet
2.39
87.3
0.530
MobileNet
2.35
86.9
0.516
InceptionV3
2.49
84.6
0.380
ResNet50
2.33
86.1
0.478
QR
AlexNet
2.38
85.8
0.454
MobileNet
2.08
82.6
0.336
TABLE III : The results of average prediction lengths, marginal coverages, and ICC across different models and uncertainty quantification methods are presented. In this table, we report only the results for models with a significance level of 0.1.
Fig. 3 : This figure presents the evaluation of prediction intervals from MobileNet. In this result, a 90% confidence level and four different target bins are used to analyze three uncertainty quantification methods: CP, QR, and CQR. While QR and CQR produce narrower prediction intervals, they exhibit lower marginal coverage compared to CP. However, the prediction interval lengths from CP remain constant across all bins.
Fig. 4 : Comparison of prediction intervals generated by CP and CQR over an eight-year period.
Confidence
80%
85%
90%
95%
CP
1.78
1.92
2.35
2.98
Length
QR
1.36
1.83
2.08
2.34
CQR
1.60
1.87
2.19
2.70
CP
76.5
78.6
86.9
90.9
Coverage
QR
67.1
75.9
82.6
85.4
CQR
74.3
77.2
84.6
89.9
TABLE IV : The result of MobileNet with four different confidence levels.
Reliable uncertainty quantification is essential for integrating solar and wind generation into modern power systems, where operators must weigh risk rather than act on point forecasts alone. Existing probabilistic methods, however, often either lack finite-sample validity or require per-site recalibration, so a single model rarely transfers across the diverse climates of a dispersed generation fleet. This paper proposes a heteroscedastic, asymmetric, group-conditional split-conformal framework built on a bootstrap-diverse XGBoost ensemble, producing prediction intervals that adapt in width to local difficulty while retaining distribution-free coverage guarantees. A single fixed specification, with no per-site or per-horizon tuning, is evaluated across four climatologically distinct sites spanning both hemispheres, at horizons of 1 to 12 hours, for both solar irradiance and wind speed. The framework holds near-nominal coverage on both targets and reduces the Interval Score by up to 35% relative to competitive baselines, with the calibration and sharpness of its intervals shown to be properties of the method rather than of site-specific tuning.
B. R. Ambedkar National Institute of Technology, Jalandhar, India · Department of Computer Science and Engineering, Dr. B.R. Ambedkar National Institute of Technology Jalandhar, India
Recent advances in uncertainty quantification for time series forecasting show that conformal prediction can provide reliable prediction intervals, yet standard conformal methods are often inefficient under temporal dependence, drift, and heterogeneous error behavior. Existing methods typically either update miscoverage rates over time or learn unconstrained calibration weights, without explicitly separating two central sources of nonstationarity: smoothly drifting error distributions and co-existing distinct error regimes. We introduce RareCP, a regime-aware retrieval method for adaptive conformal time series prediction. RareCP learns local calibration representations through a mixture of cosine-attention experts that each capture distinct error regimes, while a compact hypernetwork adapts the kernel parameters to track temporal drift. Given a new forecasting context, RareCP retrieves the top-k most relevant calibration examples, assigns similarity weights, and forms a weighted conformal quantile over their signed residuals, yielding asymmetric prediction intervals. The adaptive kernel is trained using a smooth interval score objective, with a parameter-space anchor to a lightweight teacher kernel to preserve stable local representations. On the GIFT-Eval benchmark, RareCP improves interval efficiency over recent conformal baselines and foundation model uncertainty estimates while maintaining empirical coverage. Ablations confirm that regime-specific experts, drift-adaptive kernels, sparse retrieval, and teacher anchoring each contribute to the final performance.
Manuel Heurich, Maximilian Granz, Tim Landgraf
Institute for Computer Science Freie Universität Berlin Arnimallee 7 14195 Berlin
The quantification of uncertainty in prediction models is crucial for reliable decision-making, yet remains a significant challenge. Interval time series forecasting offers a principled solution to this problem by providing prediction intervals (PIs), which indicates the probability that the true value falls within the predicted range. We consider a recently established point forecasts (PFs) method termed Learning-Based Convolution Nuclear Norm Minimization (LbCNNM), which directly generates multi-step ahead forecasts by leveraging the convolutional low-rankness property derived from training data. While theoretically complete and empirically effective, LbCNNM lacks inherent uncertainty estimation capabilities, a limitation shared by many advanced forecasting methods. To resolve the issue, we modify the well-known Quantile Regression (QR) and integrate it into LbCNNM, resulting in a novel interval forecasting method termed LbCNNM with Modified Quantile Regression (LbCNNM-MQR). In addition, we devise interval calibration techniques to further improve the accuracy of PIs. Extensive experiments on over 100,000 real-world time series demonstrate the superior performance of LbCNNM-MQR.