stat.APNov 15, 2026

A plug-in energy-balance freezing module for transformer frost nowcasting without leaf-sensor inputs

Authors: Juyeon Kim, Chaeyeon Yi, Yun Am Seo

Organizations: NAVI Hyper-Tropicalization Research Institute, Jeju National University, 102 Jejudaehak-ro, Jeju-si, Jeju-do 63243, Republic of Korea · Department of Data Science, Jeju National University, 102 Jejudaehak-ro, Jeju-si, Jeju-do 63243, Republic of Korea · Research Center for Atmospheric Environment, Hankuk University of Foreign Studies, 81 Oedae-ro, Mohyeon-eup, Cheoin-gu, Yongin-si, Gyeonggi-do 17035, Republic of Korea

Abstract

Frost protection requires local warnings where leaf-sensor inputs are unavailable. In the frost literature we surveyed, physics entered machine-learning models through inputs, numerical-model coupling, or losses, rather than model structure. We develop a transformer-compatible module that embeds leaf energy-balance physics in freezing-probability forecasts: an energy-balance temperature reference and a learned residual predict leaf temperature, which drives a multiplicative gate imposing a temperature-dependent probability cap. We mathematically prove conditional monotonicity and an alarm boundary, and test whether placing the same information in the output pathway or in attention yields different benefits. We evaluated 12 hourly leads at 19 Korean stations over five frost seasons, with and without leaf-sensor inputs. In the 2025-2026 hold-out season without these inputs, our time-token transformer (PET-E) achieved a lead-mean critical success index (CSI) of 0.516 versus 0.478 for fixed-configuration, joint-lead LightGBM, with significant gains at all 12 leads, and the fraction of alarms at observed leaf temperatures of at least 2 degrees C fell from 0.087 to 0.051 relative to the unmodified backbone. Across the hold-out and a retrospective 2024-2025 evaluation, the module reduced Brier scores and warm-surface alarm fractions in both the time-token transformer and iTransformer, with no significant CSI decrease at any lead. At held-out stations without static or leaf-sensor inputs, both module-equipped backbones exceeded LightGBM at all 12 leads (CSI 0.468 and 0.467 versus 0.437). In the time-token backbone, the temperature pathway reduced this alarm fraction in all four settings, whereas the attention prior increased CSI in three. These findings link an explicit temperature-dependent probability cap to improved forecasts and distinguish output-side from attention-based embedding.

Explore similar work

CardsList
  1. Extreme Low-State Quantized Transformer for Electricity-Load Forecasting

    Oct 20, 2026Muhammad Sabbir Alam, Harindra Sandun Mavikumbure, Victor Cobilean +2Low-Bit QuantizationQuantization-Aware Training

  2. Align-RAG: Alignment Is All You Need for TSFM In-Context Learning

    Aug 6, 2026Mohammad Asadi, Soheil Hor, Bardiya Akhbari +6Zero-Shot Time Series ForecastingRetrieval-Augmented ICL

  3. A Lightweight Plug-in Gate for Transformer-Based Time-Series Forecasters

    Sep 17, 2026Hongkai Zhuang, Tao Huang, Chen HouTime Series ForecastingTime Series Transformers