An Uncertainty-Aware Hybrid Mathematical-Machine-Learning Model for Smart Irrigation Decision Support

Andrea Scariolo

cs.LGSep 12, 2026

An Uncertainty-Aware Hybrid Mathematical-Machine-Learning Model for Smart Irrigation Decision Support

Authors: Andrea Scariolo

Organizations: Independent Researcher

Abstract

Agriculture accounts for roughly 70% of global freshwater withdrawals, yet irrigation is still commonly scheduled reactively, with no forecast of where soil moisture is heading and no statement of confidence in that forecast. Data-driven models are accurate but opaque and point-valued; water-balance models are transparent but carry large structural error. Neither alone supports a defensible irrigation decision under uncertainty. This study coupled the two and carried uncertainty through to the decision: a four-parameter water-balance core, calibrated on training data only, was corrected by a Random Forest that learned nothing but the physical residual, conformal prediction attached 90%-nominal intervals, and a risk-aware rule converted the interval lower bound into an irrigation trigger. It was evaluated on three years of hourly in-situ measurements from a rainfed Mediterranean cropland station under a strict chronological split, scored against persistence, from one hour to one week. At the 24 h horizon the hybrid reached RMSE 0.00925 m^3 m^-3 and +9.4% skill, roughly double the best of nine baselines, of which only the Random Forest beat persistence. Skill did not grow with lead time: it peaked at +27.4% at three hours and fell to +1.2% at one week. Conformalised quantile regression was better calibrated and 11% sharper than constant-width conformal prediction. The risk-aware rule raised management-threshold crossings detected in advance from 0.905 to 1.000, at a precision cost of 0.975 to 0.950 and 3.7% more notional water, and beyond 72 h the point forecast fell below the no-forecast rule while the interval-based rule did not. Uncertainty quantification therefore governs the lead time over which forecast-driven irrigation advice remains trustworthy, and here transparency in the physical layer cost no measurable accuracy.

Figures & tables

Figure 1: (a) The measured hourly streams the model consumes at the Torano station: rainfall, air temperature and volumetric soil moisture at 30, 60 and 90 cm, shown here over one month of the record. (b) The two-stage architecture. A transparent four-parameter water-balance core produces a physically grounded forecast, a tuned Random Forest corrects its residual, and conformal calibration attaches a distribution-free 90 %-nominal interval. (c) Skill relative to persistence at the 24 h horizon for the models actually run; the hybrid leads at +9.4 %. (d) The forecast and its interval turned into a decision for one real issue time in the test partition, 6 April 2010 at 16:00. Measured moisture sits just above the management trigger, and the 90 %-nominal interval of the 24 h forecast already reaches below it, so the risk-aware rule calls for irrigation while the point forecast alone would not.

Figure 2: Processing chain. Cleaned station records were transformed into past-only features. A transparent water-balance core produced a physically grounded forecast whose residual was corrected by a tuned Random Forest. The resulting hybrid forecast received a calibrated conformal interval, which drove the risk-aware irrigation decision.

Model	RMSE ( $\mathrm{m^{3}\,m^{-3}}$ )	Skill vs persistence (%)
Random Forest	0.00972	+4.8
Persistence	0.01021	0
Ridge regression	0.01046	$-$ 2.4
Gated recurrent unit	0.01071	$-$ 4.9
Long short-term memory	0.01073	$-$ 5.1
Gradient boosting (XGBoost)	0.01078	$-$ 5.6

Table 1: Nine-model comparison at the 24 h horizon on the Torano test partition

Model	RMSE ( $\mathrm{m^{3}\,m^{-3}}$ )	$R^{2}$	Skill (%)
Hybrid, perfect forcing (ablation)	0.00680	0.971	+33.4
Physical core, perfect forcing (ablation)	0.00778	0.962	+23.8
Hybrid, tuned corrector	0.00925	0.946	+9.4
Random Forest, tuned	0.00935	0.945	+8.4
Tri-training, three learners plus unlabelled data	0.00957	0.942	+6.3
Random Forest, untuned	0.00972	0.940	+4.8

Table 2: Hybrid and boosting results at the 24 h horizon

Lead time (h)	RMSE persistence	RMSE hybrid	$R^{2}$	Skill (%)
1	0.00178	0.00154	0.998	+13.6
3	0.00356	0.00258	0.996	+27.4
6	0.00524	0.00398	0.990	+24.0
12	0.00746	0.00624	0.975	+16.4
24	0.01021	0.00925	0.946	+9.4
48	0.01347	0.01286	0.896	+4.5

Table 3: Forecast performance versus lead time

Figure 3: Error and skill against lead time. (a) Root-mean-square error of persistence and of the tuned hybrid; both grow monotonically. (b) Skill relative to persistence; the hybrid peaks at three hours and decays towards zero within a week, while the physical core alone remains at the persistence level throughout.

Figure 4: Attribution of the tuned direct-prediction Random Forest. (a) Global mean absolute Shapley values for the ten leading predictors. (b) Shapley dependence for the dominant predictor, coloured by the one-hour lag, showing a near-monotone relationship between current moisture and its contribution to the forecast.

Method	Coverage	Mean width ( $\mathrm{m^{3}\,m^{-3}}$ )	Winkler score
Split conformal	0.826	0.01939	0.05172
Conformalised quantile regression	0.875	0.01725	0.04050

Table 4: Prediction-interval quality at the 24 h horizon, 90 % nominal level

Slice	n	Split coverage	Split width	CQR coverage	CQR width
All	3 713	0.826	0.01939	0.875	0.01725
Wet	1 834	0.744	0.01939	0.864	0.02371
Dry	1 879	0.906	0.01939	0.886	0.01094
December–February	1 543	0.730	0.01939	0.832	0.02030
March–May	2 170	0.894	0.01939	0.905	0.01508

Table 5: Conditional coverage and width by regime and season at the 24 h horizon

Figure 5: Observed and forecast soil moisture with the 90 % conformalised interval over the last 1 600 h of the test partition. The spring drydown crosses the management trigger in early April; the band widens markedly around the rainfall event of mid-May, when the state is least predictable.

Figure 6: Interval quality at the 24 h horizon. (a) Empirical against nominal coverage; the dashed line marks perfect calibration. (b) Mean interval width by regime at issue time; the adaptive method narrows in dry conditions and widens in wet ones, whereas the constant-width method cannot.

Rule	Alarms	Precision	Recall	F1	Notional water (mm)	Missed crossings
Reactive (no forecast)	961	0.975	0.975	0.975	24 397	24
Forecast (point)	969	0.982	0.991	0.987	24 493	9
Risk-aware (interval lower bound)	1 012	0.950	1.000	0.974	25 309	0

Table 6: Decision-rule comparison at the 24 h horizon

Figure 7: Decision performance at the 24 h horizon. (a) Notional water proxy against missed management-threshold crossings for the three rules. (b) Share of crossings detected in advance within the decision-relevant regime, where irrigation timing is genuinely difficult.

Figure 8: Uncertainty and decisions against lead time. (a) Mean interval width; both methods widen as the forecast reaches further ahead, with the adaptive method consistently sharper beyond 24 h. (b) Share of management-threshold crossings detected by each rule; the point forecast falls below the no-forecast rule beyond 72 h whereas the interval-based rule does not.

Lead time (h)	Interval half-width ( $\mathrm{m^{3}\,m^{-3}}$ )	Fires on regime (%)	Precision	Alarm rate
1	0.0009	60.0	0.979	0.263
24	0.0091	71.0	0.950	0.273
72	0.0175	92.7	0.888	0.292
168	0.0357	100.0	0.704	0.371

Table 7: Selectivity of the risk-aware rule across lead times

Decision-Making under Uncertainty

Decision-making under uncertainty studies how to choose actions when outcomes, states, or models are imperfectly known.

See all 203 papers

Sep 13, 2026

Decision-Oriented Uncertainty Quantification for Risk Control in Earth System Spatiotemporal Foundation Models

Earth system modeling is shifting from task-specific predictors toward foundation models with general spatiotemporal representation capabilities. Although these models can jointly encode dynamic Earth fields, external forcings, and static geographic context for multistep forecasting, accurate point predictions or statistically calibrated intervals alone are insufficient for high-impact applications such as extremeweather warning, flood control, renewable-energy dispatch, and emergency resource allocation. What matters in practice is whether predictive uncertainty can be translated into reliable decision risk under specific actions, loss functions, and risk preferences. We propose a decision-oriented uncertainty quantification framework for Earth system spatiotemporal foundation models. The framework produces predictive distributions of future states and uses a decision risk adapter to map forecast samples, decision context, and utility functions into action-conditional risks. A utility-aware calibration module further enforces reliability at the downstream decision-loss level rather than only at the forecast-value level. Calibrated risks are then used to select warning, dispatch, inspection, or resource-allocation actions. Compared with the strongest baseline, the proposed method reduces decision regret by 18.7%, lowers the missed-event rate from 14.2% to 9.1%, and improves expected utility by 11.6%, while maintaining 90.4% predictive coverage and reducing decision calibration error from 0.083 to 0.047. These results suggest that decision-oriented uncertainty quantification can improve the robustness and operational value of Earth system foundation models in risk-sensitive applications.

Ji Lu, Huiran Duan, Bo Zhao +5

Vanderbilt University, United States · City University of New York, United States · Yale University, United States +4

Uncertainty Quantification Geospatial Foundation Models Spatiotemporal Forecasting Decision-Making under Uncertainty

Ask PDF

Oct 5, 2026

Skillful Data-Driven Subseasonal Soil Moisture Forecasting: Prospects and Limits for Flash Drought Prediction

Despite substantial progress in short-to-medium-range weather forecasting, predicting high-impact events such as flash droughts remains a key challenge for both early warning operations and physically-based subseasonal-to-seasonal (S2S) prediction systems. Here we demonstrate that, for S2S soil-moisture forecasting over Europe, forecast skill depends as much on how the prediction problem is formulated as on the forecasting model itself. Using a Vision Transformer-based architecture with dual-pathway temporal and spatial attention, we show that residual learning is essential to outperform persistence. This advantage is realized only when forecasting root-zone soil moisture in physical units rather than standardized anomalies, revealing that the target representation itself constrains predictability. A probabilistic extension via quantile-head fine-tuning further provides well-calibrated predictive distributions. Benchmarked against deep-learning and operational ECMWF S2S baselines over 2021-2022, our model achieves the highest deterministic and probabilistic skill at all lead times and reliably detects anomalously dry root-zone states (below the 20th percentile). Yet flash drought onset, defined by multi-pentad intensification criteria, remains a fundamental challenge shared across all current S2S systems. These findings advance data-driven S2S soil-moisture forecasting while highlighting the remaining challenge of predicting rapid drought development.

Noelia Otero, Atahan Özer, Miguel-Ángel Fernández-Torres +1

Applied Machine Learning Group, Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute, Berlin, Germany · Department of Signal Theory and Communications, Universidad Carlos III de Madrid (UC3M), Madrid, Spain

Spatiotemporal Forecasting Probabilistic Time Series Forecasting

Ask PDF

Mar 9, 2026

Designing probabilistic AI monsoon forecasts to inform agricultural decision-making

Hundreds of millions of farmers make high-stakes decisions under uncertainty about future weather. Forecasts can inform these decisions, but available choices and their risks and benefits vary between farmers. We introduce a decision-theory framework for designing useful forecasts in settings where the forecaster cannot prescribe optimal actions because farmers' circumstances are heterogeneous. We apply this framework to the case of seasonal onset of monsoon rains, a key date for planting decisions and agricultural investments in many tropical countries. We develop a system for tailoring forecasts to the requirements of this framework by blending systematically benchmarked artificial intelligence (AI) weather prediction models with a new "evolving farmer expectations" statistical model. This statistical model applies Bayesian inference to historical observations to predict time-varying probabilities of first-occurrence events throughout a season. The blended system yields more skillful Indian monsoon forecasts at longer lead times than its components or any multi-model average. In 2025, this system was deployed operationally in a government-led program that delivered subseasonal monsoon onset forecasts to 38 million Indian farmers, skillfully predicting that year's early-summer anomalous dry period. This decision-theory framework and blending system offer a pathway for developing climate adaptation tools for large vulnerable populations around the world.

Colin Aitken, Rajat Masiwal, Adam Marchakitus +7

Development Innovation Lab, University of Chicago, IL, 60637 · Department of the Geophysical Sciences, University of Chicago, IL, 60637 · Data Science Institute, University of Chicago, IL, 60637 +5

Weather Forecasting Probabilistic Forecasting AI-Assisted Decision Making

Ask PDF

Abstract

Decision-Making under Uncertainty

Explore similar work

Decision-Oriented Uncertainty Quantification for Risk Control in Earth System Spatiotemporal Foundation Models

Skillful Data-Driven Subseasonal Soil Moisture Forecasting: Prospects and Limits for Flash Drought Prediction

Designing probabilistic AI monsoon forecasts to inform agricultural decision-making