FedCMAPSS: A Benchmark for Federated Learning in Remaining Useful Life Estimation
Organizations: University of Catania, Italy
Abstract
Data-driven prognostics and health management has emerged as a key enabler for Industry 4.0, yet the development of robust remaining useful life (RUL) estimation models is often limited by the scarcity of run-to-failure data. While federated learning offers a promising paradigm to collaboratively train predictive models without sharing sensor data, research efforts have operated so far in the absence of a common evaluation framework. To address this gap, this paper introduces FedCMAPSS, a benchmark for federated RUL estimation based on the commonly-used NASA C-MAPSS dataset. We define a set of five standardized tasks designed to simulate real-world industrial challenges, ranging from ideal IID settings to extreme statistical heterogeneity, and conduct a systematic evaluation of state-of-the-art federated optimization algorithms across multiple neural architectures. By establishing reproducible baselines and making the source code and data splits publicly available, this work aims to provide a standard foundation for developing and comparing federated predictive maintenance solutions.
Figures & tables
| Task A | Task B | Task C | Task D | Task E | |
|---|---|---|---|---|---|
| LSTM | 21.53 0.57 | 21.27 0.14 | 28.66 0.20 | 22.58 0.09 | 37.16 0.59 |
| AFT | 40.40 0.14 | 37.26 0.38 | 46.14 0.03 | 39.93 0.03 | 42.08 0.58 |
| AttBiGRU | 25.47 0.88 | 22.37 0.19 | 23.04 0.36 | 33.05 0.07 | 36.94 0.61 |
| RNN | 40.34 0.10 | 43.29 0.04 | 45.27 0.03 | 39.82 0.02 | 41.22 0.51 |
| CNN | 40.88 0.21 | 37.77 0.51 | 46.47 0.04 | 39.37 0.22 | 40.82 0.47 |
| FedAvg | SCAFFOLD | FedDyn | FedCross | |||||
|---|---|---|---|---|---|---|---|---|
| RMSE | NASA | RMSE | NASA | RMSE | NASA | RMSE | NASA | |
| LSTM | 17.66 1.11 | 0.99 0.43 | 17.36 1.11 | 0.81 0.27 | 23.45 0.72 | 2.38 0.63 | 18.81 1.08 | 1.06 0.53 |
| AFT | 17.19 1.09 | 0.81 0.26 | 16.59 1.41 | 0.88 0.49 | 43.71 1.12 | 9.78 1.86 | 18.79 1.30 | 1.47 0.93 |
| AttBiGRU | 17.84 1.01 | 1.14 0.76 | 17.46 1.67 | 0.92 0.45 | 31.32 3.17 | 12.79 6.43 | 22.37 1.59 | 2.95 3.72 |
| RNN | 18.97 0.81 | 1.10 0.28 | 18.96 0.88 | 1.11 0.29 | 41.82 0.31 | 6.89 0.42 | 20.01 0.80 | 1.34 0.41 |
| CNN | 14.79 0.58 | 0.39 0.14 | 14.56 0.55 | 0.40 0.13 | 40.45 0.41 | 6.62 1.33 | 15.48 0.76 | 0.39 0.07 |
| FedAvg | SCAFFOLD | FedDyn | FedCross | |||||
|---|---|---|---|---|---|---|---|---|
| RMSE | NASA | RMSE | NASA | RMSE | NASA | RMSE | NASA | |
| LSTM | 21.14 0.58 | 9.85 2.20 | 18.42 0.38 | 7.06 0.79 | 40.83 1.61 | 16.43 0.31 | 5.35 1.25 | |
| AFT | 29.30 3.22 | 17.30 0.86 | 6.11 1.81 | 47.17 3.19 | 15.85 0.63 | 3.87 0.79 | ||
| AttBiGRU | 27.17 1.35 | 17.84 0.37 | 5.96 0.56 | 38.24 2.32 | 16.90 0.38 | 4.49 0.79 | ||
| RNN | 28.03 2.74 | 20.06 0.37 | 11.99 1.92 | 44.82 0.35 | 67.59 4.09 | 20.27 0.51 | 10.45 2.88 | |
| CNN | 46.78 3.02 | 37.30 1.71 | 42.26 0.34 | 49.42 6.79 | 33.69 1.31 | |||
| FedAvg | SCAFFOLD | FedDyn | FedCross | |||||
|---|---|---|---|---|---|---|---|---|
| RMSE | NASA | RMSE | NASA | RMSE | NASA | RMSE | NASA | |
| LSTM | 29.48 0.34 | 38.26 4.96 | 27.31 1.05 | 31.73 21.26 | 39.92 2.40 | 15.01 4.61 | 17.28 0.92 | 1.44 0.96 |
| AFT | 30.32 0.33 | 41.59 5.97 | 31.22 1.91 | 49.44 1.26 | 48.12 8.59 | 17.75 0.70 | 1.35 0.62 | |
| AttBiGRU | 30.87 0.24 | 27.14 7.59 | 32.15 2.39 | 36.30 2.11 | 20.18 0.68 | 1.89 0.60 | ||
| RNN | 30.52 0.50 | 27.10 5.97 | 34.69 4.51 | 45.24 0.28 | 23.75 1.27 | 18.24 0.33 | 1.32 0.34 | |
| CNN | 35.12 0.38 | 33.10 0.59 | 42.93 0.20 | 17.76 2.79 | 26.22 0.68 | |||
| FedAvg | SCAFFOLD | FedDyn | FedCross | |||||
|---|---|---|---|---|---|---|---|---|
| RMSE | NASA | RMSE | NASA | RMSE | NASA | RMSE | NASA | |
| LSTM | 14.12 0.65 | 4.23 0.61 | 12.58 0.25 | 3.85 0.21 | 24.67 1.05 | 14.51 4.28 | 12.28 0.23 | 3.52 0.31 |
| AFT | 16.30 0.64 | 15.64 0.21 | 39.86 0.38 | 15.44 0.41 | ||||
| AttBiGRU | 15.15 0.25 | 4.89 0.57 | 14.13 0.08 | 5.20 0.50 | 33.84 0.93 | 14.05 0.15 | 4.67 0.40 | |
| RNN | 13.84 0.38 | 5.38 2.11 | 15.63 0.11 | 4.37 0.14 | 40.06 0.33 | 67.82 14.08 | 15.05 0.23 | 4.13 0.21 |
| CNN | 17.15 0.31 | 6.55 1.40 | 17.90 0.38 | 3.90 0.34 | 40.24 0.71 | 73.70 30.43 | 15.40 0.22 | 3.72 0.34 |
| FedAvg | SCAFFOLD | FedDyn | FedCross | |||||
|---|---|---|---|---|---|---|---|---|
| RMSE | NASA | RMSE | NASA | RMSE | NASA | RMSE | NASA | |
| LSTM | 27.30 0.82 | 5.42 1.01 | 28.92 0.99 | 9.63 1.70 | 34.41 1.70 | 32.86 11.42 | 28.15 1.10 | 7.83 1.73 |
| AFT | 34.42 1.26 | 15.70 3.65 | 34.81 1.30 | 20.16 4.52 | 41.00 0.45 | 6.73 0.45 | 36.94 1.41 | 35.02 6.60 |
| AttBiGRU | 32.24 0.80 | 8.79 1.25 | 32.74 0.86 | 12.47 1.68 | 42.29 3.65 | 33.13 0.83 | 13.10 2.80 | |
| RNN | 41.11 0.86 | 5.02 0.34 | 40.01 0.64 | 4.31 0.16 | 41.10 0.90 | 5.02 0.37 | 40.44 0.74 | 4.52 0.26 |
| CNN | 29.69 0.59 | 6.10 1.27 | 30.35 1.01 | 11.53 2.92 | 40.25 0.51 | 5.11 0.29 | 32.69 0.80 | 14.47 3.84 |
Federated Learning
Federated learning trains shared models across data holders without requiring them to pool their raw data.
See all 938 papers