A Hybrid State Space-Attention Architecture for Forecasting the Trajectories of Battery Degradation
Organizations: College of Computational Mathematical Natural Sciences University of Maryland - College Park College Park, MD, USA
Abstract
Early-life battery degradation trajectory forecasting aims to predict a battery cell's full state-of-health (SOH) trajectory from its initial charge-discharge cycles, potentially reducing cell qualification and evaluation time from months to days. Despite recent advances, accurate forecasting remains challenging for emerging battery chemistries, data-scarce domains, and cells exhibiting degradation behaviors beyond those observed during training. Existing state-of-the-art approaches increasingly rely on model scaling, large language model-derived aging-condition embeddings, and extensive fold-specific hyperparameter tuning, raising concerns about computational efficiency, reproducibility, and generalization. This work introduces DecayFormer, a compact hybrid state-space and attention architecture designed for early-life degradation trajectory forecasting. DecayFormer combines cycle-level selective recurrence, using a single scalar state per channel, with an attention mechanism queried by the recurrent state. It further incorporates state-of-charge (SOC) interval statistics and a master curve head that jointly estimates a scalar lifetime and a monotonically non-increasing SOH profile parameterized by normalized lifetime. We evaluate DecayFormer on the BatteryLife benchmark using all 22 aging-condition-exclusive folds, with a single run per fold and one fixed configuration across all folds, without fold-specific tuning. DecayFormer achieves mean test MAPE values of 2.25% on Li-ion, 2.76% on CALB, 0.95% on Na-ion, and 7.19% on Zn-ion. These results demonstrate the potential of compact sequence models to deliver accurate early-life degradation forecasts across diverse battery chemistries and aging conditions, without relying on extensive model scaling or per-fold optimization.
Figures & tables
| Model | Li-ion (3) | CALB (4) | Na-ion (12) | Zn-ion (3) |
|---|---|---|---|---|
| BatteryMFormer | ||||
| IC2ML | ||||
| CPMLP | ||||
| DecayFormer | ||||
| DecayFormer best of four | 3/3 | 2/4 | 8/12 | 0/3 |
| Domain | w/o side inputs | DecayFormer | w/ LLM embedding |
|---|---|---|---|
| Li-ion | |||
| CALB | |||
| Na-ion | |||
| Zn-ion |
Time Series Forecasting
Time series forecasting predicts future values from ordered observations using statistical, neural, and probabilistic models to support decisions under uncertainty.
See all 941 papers