Zero-Shot Forecasting of In-Situ Soil Moisture and Temperature with a Time-Series Foundation Model
Authors: Mohammad Talaei, Mohammad Goudarzi, Maille Todd, Vanessa N. L. Wong, Iadine Chadès
Organizations: Faculty of Information Technology, Monash University, Australia · School of Earth, Atmosphere and Environment, Monash University, Australia · The Environmental Informatics Hub, Data Science and AI, Monash University, Australia
Soil moisture and temperature govern plant-water availability and microbial activity, making them key indicators for evaluating land-restoration efforts on degraded landscapes. However, the physical and data-driven models normally used to forecast them both need information that a newly instrumented restoration site does not yet have: hydraulic parameters for the former and months of per-site training data for the latter. We evaluate TimesFM 1, a 500M-parameter time-series foundation model, zero-shot on 15-minute telemetry from 27 sensor stations across three land-management regimes (Control, Treatment, Scald) at a semi-arid restoration site, forecasting 5 cm and 30 cm soil moisture and enclosure temperature at seven lead times from 1 h to 168 h. Using gap-aware rolling-origin evaluation across sensors, we find that TimesFM beats the best rule-based statistical forecasting baselines (persistence, seasonal-naive, or 7-day climatology) by 21-76% at sub-daily lead times but loses by 6-79% beyond a day, a pattern explained by a diurnal-alignment mechanism that holds for both soil-moisture depths and temperature. A CatBoost baseline trained walk-forward on the same origins with full history and weather covariates never wins overall, and we show that its weakness is partly a cold-start effect specific to short deployments. We additionally quantify the inference cost of zero-shot forecasting on commodity CPU hardware. Our results highlight a practical trade-off between zero-shot forecasting capability, predictive performance, and computational efficiency.
Figures & tables
Figure 1: (a) Sensor–gateway topology, with the farthest sensor pair (2.5 km) marked; (b) a representative zero-shot forecast for a Treatment-regime sensor, showing 7 days of context and TimesFM’s 7-day-ahead forecast against ground truth for enclosure temperature and 30 cm soil moisture.
Figure 2: TimesFM vs. the best baseline (chosen once per target by lowest mean normalized MAE across all lead times, held fixed, not re-chosen per horizon), pooled across sensors.
5 cm moisture (m 3 /m 3 ) ↓
30 cm moisture (m 3 /m 3 ) ↓
Encl. temp. ( ∘ C) ↓
Method
1h
24h
168h
1h
24h
168h
1h
24h
168h
TimesFM (zero-shot)
0.0069
0.0324
0.1176
0.0072
0.0229
0.0786
0.89
4.01
5.04
Persistence
0.0101
0.0244
0.1195
0.0074
0.0154
0.0743
1.73
3.82
5.06
Seasonal naive
0.0290
0.0244
0.1195
0.0192
0.0154
0.0743
2.43
3.82
5.06
7-day climatology
0.0792
0.0669
0.0695
0.0579
0.0473
0.0467
2.84
3.53
2.81
CatBoost
0.0316
0.0815
0.1738
0.0448
0.0921
0.1719
1.40
4.01
5.04
Table 1: MAE by method, target, and lead time ( ↓ the better), pooled across sensors. Bold = the best.
Figure 3: TimesFM MAE by land-management regime. Scald (3 sensors) is descriptive only.
Method
Parameters
Training time
Inference time
Points/call
Peak memory
TimesFM (zero-shot)
498.8M
N/A
6.4 s
672
+2.7 GB
CatBoost
–
5.2 s/refit
0.003 s
1
< 5 MB
Table 2: System performance, measured locally. CatBoost retrains at every 14-day cutoff and per horizon (518 refits total); memory is the incremental cost of one fit/inference call with data already resident. Rule-based baselines are omitted; their cost is negligible by construction.
Despite the success of Time Series Foundation Models (TSFMs) on broad benchmarks, their ability to internalize basic temporal logic, especially in settings supported by exogenous covariates, remains under-examined. We introduce SimpleTimeBench, a diagnostic univariate and multivariate "unit test" suite for primitives such as monotonic trends, periodic signals and leading indicator covariates, scenarios where near-perfect forecasts should be trivial. Surprisingly, prominent multivariate TSFMs (Chronos-2, Moirai and Toto) frequently produce suboptimal zero-shot forecasts for these inputs. While fine-tuning Chronos-2 improves its behaviour on specific tasks, we show that this adaptation degrades performance on other fundamental patterns rather than enhancing its generalizable foundational capabilities. This reveals a gap between pre-training scale and basic temporal reasoning, suggesting that current TSFMs could potentially lack the inductive biases needed to capture simple predictable functions. We further demonstrate that these failures are not merely synthetic curiosities: they persist in real-world sensor forecasting, where TSFMs consistently underutilize leading indicators available in observed covariates. This inability to capture simple relationships limits the practical utility and reliability of current multivariate models.
Despite substantial progress in short-to-medium-range weather forecasting, predicting high-impact events such as flash droughts remains a key challenge for both early warning operations and physically-based subseasonal-to-seasonal (S2S) prediction systems. Here we demonstrate that, for S2S soil-moisture forecasting over Europe, forecast skill depends as much on how the prediction problem is formulated as on the forecasting model itself. Using a Vision Transformer-based architecture with dual-pathway temporal and spatial attention, we show that residual learning is essential to outperform persistence. This advantage is realized only when forecasting root-zone soil moisture in physical units rather than standardized anomalies, revealing that the target representation itself constrains predictability. A probabilistic extension via quantile-head fine-tuning further provides well-calibrated predictive distributions. Benchmarked against deep-learning and operational ECMWF S2S baselines over 2021-2022, our model achieves the highest deterministic and probabilistic skill at all lead times and reliably detects anomalously dry root-zone states (below the 20th percentile). Yet flash drought onset, defined by multi-pentad intensification criteria, remains a fundamental challenge shared across all current S2S systems. These findings advance data-driven S2S soil-moisture forecasting while highlighting the remaining challenge of predicting rapid drought development.
Applied Machine Learning Group, Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute, Berlin, Germany · Department of Signal Theory and Communications, Universidad Carlos III de Madrid (UC3M), Madrid, Spain
Large Time Series Foundation Models (TSFMs) demonstrate strong zero-shot forecasting capabilities across diverse domains. However, their application to regional climate forecasting faces practical challenges: model weights are often proprietary, local training records are limited, and computational budgets are constrained, making traditional fine-tuning approaches infeasible. To address these constraints, we introduce a lightweight, black-box adaptation framework (requiring no access to backbone parameters and no backbone fine-tuning) that enhances frozen TSFMs at inference time through two plug-and-play wrappers: SMR\textsuperscript{2} (Stationarity aware multi-resolution Residual), which decomposes the input into multi-resolution temporal views, learns stride specific residual corrections that capture regional dynamics, then adaptively ensembles them into a single forecast, and MBB (Moving Block Bootstrap), which preserves temporal dependencies through block resampling and ensembles over temporally coherent residual perturbations to stabilize the point forecast. Both wrappers instantiate the same bagging style principle: they build diverse views of the input or its residuals, forecast each with the same frozen backbone, and aggregate, so all adaptation comes from inference time ensembling rather than any weight update. Evaluated on one month ahead Standardized Precipitation Evapotranspiration Index (SPEI) prediction across multiple sites in South Australia, our framework consistently improves forecasting performance across several backbone models, demonstrating up to 26% mean squared error (MSE) reduction over the corresponding frozen backbone while enabling practical deployment in resource constrained regional forecasting systems.
Wentao Gao, Jiuyong Li, Lin Liu +4
Adelaide University · Adelaide, Australia · CSIRO Technology +1