Mitigating Catastrophic Forgetting in Task-Free Federated Continual Forecasting via Two-Tier Replay under Concept Drift
Organizations: American University in Dubai (AUD), Dubai, United Arab Emirates · CEA LIST, Palaiseau, France
Abstract
Federated time-series forecasting is increasingly important in applications where temporal data are distributed across privacy-sensitive clients, such as environmental monitoring, smart cities, and industrial sensing. A central limitation of current continual-learning protocols is that they usually assume predefined task boundaries, whereas deployed forecasting systems receive an uninterrupted stream and must decide autonomously when adaptation is necessary. This paper addresses catastrophic forgetting in task-free federated forecasting under concept drift. We introduce a drift-aware continual-learning protocol in which each client monitors prediction-window RMSE, calibrates a robust median threshold from the offline base period, and triggers adaptation only after persistent degradation. To mitigate forgetting, we propose a TwoTierReplay mechanism that separates fixed offline representative memory from online memory. The offline tier preserves long-term knowledge learned during the base phase, while the online tier captures recent distributional changes after drift. Experiments on the Beijing Multi-Site Air- Quality dataset with 12 clients, three forecasting targets, and three horizons show that TwoTierReplay achieves the best stability-plasticity score in all nine target-horizon configurations. It improves over the strongest baseline by approximately 11.4%. These results suggest that explicit temporal structuring of replay memory is a practical and effective mechanism for task-free federated continual forecasting.
Figures & tables
| Component | Setting |
|---|---|
| Clients | 12 monitoring stations |
| Targets | TEMP, PM 2.5 , WSPM |
| Horizons | hours |
| Input length | hours |
| Model | LSTM, hidden dimension 64 |
| Base training | FedAvg, 100 rounds, 1 local epoch |
| Method | TEMP-6 | TEMP-12 | TEMP-24 | PM 2.5 -6 | PM 2.5 -12 | PM 2.5 -24 | WSPM-6 | WSPM-12 | WSPM-24 | Avg. |
|---|---|---|---|---|---|---|---|---|---|---|
| Static | 0.2413 | 0.2430 | 0.2503 | 0.1582 | 0.1620 | 0.1660 | 0.1504 | 0.1569 | 0.1637 | 0.1880 |
| Naive | 0.2139 | 0.2292 | 0.2432 | 0.1614 | 0.1642 | 0.1686 | 0.1767 | 0.1678 | 0.1723 | 0.1886 |
| EWC | 0.2043 | 0.2285 | 0.2425 | 0.1532 | 0.1561 | 0.1619 | 0.1512 | 0.1580 | 0.1638 | 0.1799 |
| LwF | 0.2139 | 0.2292 | 0.2434 | 0.1567 | 0.1606 | 0.1631 | 0.1742 | 0.1741 | 0.1801 | 0.1884 |
| SI | 0.2139 | 0.2293 | 0.2430 | 0.1588 | 0.1605 | 0.1639 | 0.1553 | 0.1580 | 0.1632 | 0.1829 |
| NormalReplay | 0.1966 | 0.2099 | 0.2186 | 0.1502 | 0.1562 | 0.1637 | 0.1577 | 0.1627 | 0.1680 | 0.1760 |
Federated Continual Learning
Federated continual learning enables distributed clients to adapt models to changing data while retaining past knowledge and keeping raw data local.
See all 38 papers