Uncertainty Quantification of Next Generation Reservoir Computing with Applications to Memory-Driven Dynamical Systems
Organizations: Department of Statistics and Data Science, Cornell University, New York, USA
Abstract
Nonlinear dynamical systems with memory arise across science and engineering, yet uncertainty quantification for efficient forecasting methods such as Next Generation Reservoir Computing (NGRC) remains underdeveloped. We study Bayesian ridge and conformal prediction intervals for NGRC and characterize when their uncertainty estimates agree or differ. In low dimensions, their asymptotic widths are governed by different summaries of the residual distribution, so agreement depends on residual shape rather than dimensionality alone. In high dimensions, regularization introduces a further tradeoff between estimation variance, shrinkage bias, and posterior uncertainty, leading to an explicit transition between regimes where Bayesian intervals are wider or narrower than conformal intervals. We extend these results to quadratic NGRC feature maps and give sufficient conditions for transferring the analysis to temporally dependent forecast windows. Simulations and real-data experiments support the theoretical predictions and illustrate how residual distribution, regularization, dimensionality, and distribution shift affect interval calibration and efficiency. These results provide a principled framework for choosing and interpreting uncertainty quantification methods in reservoir-based forecasting.
Figures & tables
| Method | Constant coverage | Constant width | First-50 high-noise coverage | Full high-noise coverage | High-noise width | Recovery fraction | Observations from noise increase to recovery |
|---|---|---|---|---|---|---|---|
| Bayesian (frozen scale) | – | ||||||
| SCP (frozen quantile) | – | ||||||
| Rolling SCP | |||||||
| Updated Gaussian | |||||||
| Adaptive CP | |||||||
| Time-weighted CP |
| Dataset | ||||||||
|---|---|---|---|---|---|---|---|---|
| LA ozone | 6420 | 0.0394 | 0.0287 | 0.521 | 0.392 | 0.360 | 0.787 | 0.771 |
| Solar | 21009 | 0.0338 | 0.0038 | 0.029 | 0.026 | 0.031 | 0.057 | 1.001 |
| Beijing PM 10 | 14016 | 0.0238 | 0.0116 | 0.231 | 0.248 | 0.182 | 0.388 | 0.858 |
| Exchange returns | 3029 | 0.0396 | 0.0038 | 0.993 | 1.445 | 1.284 | 2.704 | 1.389 |
| Dataset | Shape factor | Scale factor | |
|---|---|---|---|
| LA ozone | 1.024 | 0.752 | 0.771 |
| Solar | 1.119 | 0.897 | 1.001 |
| Beijing PM 10 | 0.798 | 1.074 | 0.858 |
| Exchange returns | 0.955 | 1.455 | 1.389 |
| Dataset | Method | RMSE | Coverage | (pp) | Width | Winkler | UQ time (s) |
|---|---|---|---|---|---|---|---|
| LA ozone | Bayesian ridge | 0.360 | 0.993 | 4.25 | 2.047 | 2.083 | 0.015 |
| SCP | 0.963 | 1.29 | 1.573 | 1.795 | |||
| Asymmetric SCP | 0.963 | 1.29 | 1.574 | 1.791 | 0.001 | ||
| Adaptive CP | 0.954 | 0.36 | 1.485 | 1.784 | 6.523 | ||
| Time-weighted CP | 0.954 | 0.36 | 1.477 | 1.782 | 8.677 | ||
| ResCP | 0.929 | -2.13 | 1.369 | 1.797 | 18.831 |
| Dataset | Forecasting pipeline | RMSE | Coverage | PI width | Winkler | Total runtime (s) |
|---|---|---|---|---|---|---|
| LA ozone | ARIMA + ResCP | 0.359 | 0.941 | 1.439 | 1.834 | 26.190 |
| GRU + ResCP | 0.365 | 0.956 | 1.524 | 1.810 | 60.960 | |
| Transformer + ResCP | 0.364 | 0.935 | 1.391 | 1.841 | 141.942 | |
| NGRC + ResCP | 0.360 | 0.929 | 1.369 | 1.797 | 19.390 | |
| Solar | ARIMA + ResCP | 0.021 | 0.904 | 0.038 | 0.069 | 156.337 |
| GRU + ResCP | 0.020 | 0.894 | 0.041 | 0.070 | 442.007 |
Appendix figures & tables14 assets
Supplementary material from the paper’s appendix.
Appendix
| Signal structure | Residual KS | |||
|---|---|---|---|---|
| 8 | Concentrated | 1.414 | ||
| 8 | Diffuse | 0.500 | ||
| 12 | Concentrated | 1.414 | ||
| 12 | Diffuse | 0.408 | ||
| 16 | Concentrated | 1.414 | ||
| 16 | Diffuse | 0.354 |
| Feature design | Signal | Empirical | Trace | Empirical | Trace | Bayesian cov. | SCP cov. | Residual KS |
|---|---|---|---|---|---|---|---|---|
| Independent Gaussian | Concentrated | |||||||
| Independent Gaussian | Diffuse | |||||||
| Quadratic Gaussian | Concentrated | |||||||
| Quadratic Gaussian | Diffuse | |||||||
| Temporal quadratic | Concentrated | |||||||
| Temporal quadratic | Diffuse |
| Dataset | Observations | |||
|---|---|---|---|---|
| LA ozone | 16,071 | 6420/6420/3210 | 6419/6419/3210 | 6417/6417/3210 |
| Solar | 52,560 | 21009/21009/10506 | 21008/21008/10506 | 21007/21007/10504 |
| Beijing PM 10 | 35,064 | 14016/14016/7008 | 14015/14015/7008 | 14013/14013/7008 |
| Exchange returns | 7,587 | 3029/3029/1515 | 3028/3028/1515 | 3026/3026/1515 |
| Dataset and horizon | Adaptive | TWCP | ResCP | ResCP | |
|---|---|---|---|---|---|
| Beijing PM 10 , | 0.003 | 0.05 | 0.95 | 0.10 | all |
| Beijing PM 10 , | 0.001 | 0.02 | 0.95 | 0.15 | all |
| Beijing PM 10 , | 0.001 | 0.01 | 0.99 | 0.15 | all |
| Exchange returns, | 10 | 0.01 | 0.95 | 0.15 | 1500 |
| Exchange returns, | 10 | 0.02 | 0.95 | 0.25 | 100 |
| Exchange returns, | 10 | 0.01 | 0.95 | 0.15 | 1000 |
| Dataset | Method | RMSE | Coverage | Width | Winkler |
|---|---|---|---|---|---|
| LA ozone | Bayesian ridge | ||||
| SCP | |||||
| Asymmetric SCP | |||||
| Adaptive CP | |||||
| Time-weighted CP | |||||
| ResCP |
| Method | Cov. | Width | Winkler | |
|---|---|---|---|---|
| 1 | Bayesian ridge | 0.993 | 2.047 | 2.083 |
| SCP | 0.963 | 1.573 | 1.795 | |
| Adaptive CP | 0.954 | 1.485 | 1.784 | |
| Time-weighted CP | 0.954 | 1.477 | 1.782 | |
| ResCP | 0.929 | 1.369 | 1.797 | |
| 3 | Bayesian ridge | 0.997 | 2.669 | 2.691 |
| Bayesian ridge | SCP | |||||||
|---|---|---|---|---|---|---|---|---|
| Dataset | Features | RMSE | Coverage | Width | Winkler | Coverage | Width | Winkler |
| LA ozone | Linear lags | 0.357 | 0.993 | 2.098 | 2.132 | 0.964 | 1.583 | 1.806 |
| Quadratic NGRC | 0.360 | 0.993 | 2.047 | 2.083 | 0.963 | 1.573 | 1.795 | |
| Short-memory NGRC | 0.360 | 0.993 | 2.047 | 2.082 | 0.963 | 1.574 | 1.796 | |
| Medium-memory NGRC | 0.360 | 0.993 | 2.047 | 2.082 | 0.963 | 1.572 | 1.795 | |
| Long-memory NGRC | 0.355 | 0.992 | 2.040 | 2.079 | 0.963 | 1.555 | 1.783 | |
| Dataset | Horizon | Coverage | Coverage range | Width | Winkler score |
|---|---|---|---|---|---|
| LA ozone | |||||
| Solar | |||||
| Dataset | Method | ||
|---|---|---|---|
| LA ozone | Bayesian ridge | 0.0125 | 0.0107 |
| SCP | 0.0003 | 0.0007 | |
| Adaptive CP | 6.4812 | 6.4685 | |
| Time-weighted CP | 9.5753 | 9.2434 | |
| ResCP | 22.2484 | 31.4085 | |
| Solar | Bayesian ridge | 0.1008 | 0.0988 |