Pneuma: A Large-Scale Real-World Time Series Benchmark for Commercial Aircraft Predictive Maintenance
Organizations: China Southern Airlines, Guangzhou, China · School of Transportation Science and Engineering, Beihang University, Beijing, China
Abstract
Predictive maintenance is vital for commercial aviation, yet progress remains hindered by the lack of public, large-scale real-world datasets. As a result, most methods are developed and evaluated on proprietary data, limiting reproducibility. We introduce Pneuma, the first publicly available large-scale benchmark for predictive maintenance using onboard time series from in-service commercial aircraft. Built around bleed air systems, Pneuma contains over 920 million multivariate time steps across four aircraft types and 9 verified fault scenarios, directly aligned with real maintenance logs. The dataset exhibits key real-world challenges, including substantial class imbalance, subtle fault evolution patterns, and significant variance across aircraft configurations. We structure the benchmark around three tasks: multivariate forecasting, supervised fault classification, and unsupervised anomaly detection, with labels derived from actual maintenance records. Under unified settings, we evaluate over 25 models from four methodological families on 9 carefully curated subsets. The results reveal that even strong contemporary models struggle with subtle fault signatures. Further analyses show consistent gains from additional in-context examples and multivariate inference, while forecasting quality is strongly associated with anomaly detection performance. Together, these findings provide practical insights into effectively modeling complex real-world aviation time series. We hope Pneuma will serve as a rigorous and reproducible foundation for advancing data-driven predictive maintenance toward real-world deployment in commercial aviation.
Figures & tables
| Dataset | Commercial Aircraft | Benchmark | Modeling Task | Real-World Label | Aircraft Types | Variables | Fault Scenarios | Time Steps |
|---|---|---|---|---|---|---|---|---|
| GATS ( LaBella et al., ) | ✗ | ✓ | Classification, Reconstruction | ✗ | 3 | 76 | 0 | 38.3M |
| CAFUC2 ( Jing et al., 2026 ) | ✗ | ✓ | Anomaly Detection | ✗ | 4 | 22 | 4 | 1.0M |
| NGAFID ( Yang and Desell, 2022 ) | ✗ | ✓ | Classification | ✓ | 1 | 23 | 19 | 46.9M |
| DASHlink ( National Aeronautics and Space Administration, 2012 ; Matthews, 2022 ) | ✓ | ✗ | Classification | ✗ | 1 | 20 | 4 | 15.8M |
| Pneuma (Ours) | ✓ | ✓ | Classification, Forecasting, Anomaly Detection | ✓ | 4 | 9 21 | 9 | 921M |
| Subset | Aircraft Type | Target Scenario | Collection Period | Sensors | Flights | Avg. Length | Time Steps |
|---|---|---|---|---|---|---|---|
| 320-DIFF | A320 | 8HA sensing-line fault | 2024-01–2026-05 | 17 | 7,259 | 10.6K | 77.3M |
| 320-HPV | A320 | High-pressure valve fault | 2024-01–2026-05 | 17 | 8,681 | 10.7K | 92.7M |
| 320-PRV | A320 | Pressure-regulating valve fault | 2024-01–2026-05 | 17 | 8,041 | 10.6K | 84.9M |
| 320-WEAV | A320 | Bleed-air duct leakage | 2024-01–2026-05 | 17 | 7,550 | 9.2K | 69.2M |
| 320-LOW | A320 | PRV leakage with low transfer pressure | 2021-12–2026-05 | 17 | 7,417 | 9.2K | 68.2M |
| 321-DIFF | A321 | 8HA sensing-line fault | 2024-01–2026-05 | 17 | 8,894 | 11.1K | 98.8M |
| Model | 320-DIFF | 320-HPV | 320-PRV | 320-WEAV | 320-LOW | 321-DIFF | 321-WEAV | 787-CAC | 777-PRSOV | Score |
|---|---|---|---|---|---|---|---|---|---|---|
| Time Series Forecasting Models (Full-shot) | ||||||||||
| OLinear ( Yue et al., 2026 ) | 0.411 | 0.416 | 0.414 | 0.448 | 0.446 | 0.384 | 0.460 | 0.476 | 0.458 | 69.72 |
| xPatch ( Stitsyuk and Choi, 2025 ) | 0.410 | 0.415 | 0.414 | 0.442 | 0.439 | 0.381 | 0.459 | 0.492 | 0.451 | 69.78 |
| DUET ( Qiu et al., 2025 ) | 0.401 | 0.404 | 0.403 | 0.438 | 0.435 | 0.371 | 0.455 | 0.475 | 0.461 | 70.11 |
| TimeMixer ( Wang et al., 2024a ) | 0.451 | 0.456 | 0.453 | 0.498 | 0.497 | 0.428 | 0.484 | 0.542 | 0.490 | 67.70 |
| TimeXer ( Wang et al., 2024b ) | 0.428 | 0.432 | 0.430 | 0.475 | 0.471 | 0.401 | 0.474 | 0.487 | 0.478 | 68.86 |
| Model | 320-DIFF | 320-HPV | 320-PRV | 320-WEAV | 320-LOW | 321-DIFF | 321-WEAV | 787-CAC | 777-PRSOV | Score |
|---|---|---|---|---|---|---|---|---|---|---|
| Classification Models | ||||||||||
| MambaSL ( Jung and Kim, 2026 ) | 1.000 | 0.303 | 0.275 | 0.576 | 0.163 | 0.113 | 0.233 | 0.287 | 0.444 | 37.71 |
| VSFormer ( Xi et al., 2024 ) | 1.000 | 0.649 | 0.364 | 0.655 | 0.366 | 0.564 | 0.593 | 0.288 | 0.941 | 60.22 |
| LITE ( Ismail-Fawaz et al., 2025 ) | 1.000 | 0.143 | 0.128 | 0.333 | 0.577 | 1.000 | 0.270 | 0.330 | 1.000 | 53.12 |
| TimesNet ( Wu et al., 2022 ) | 0.955 | 0.325 | 0.220 | 0.413 | 0.333 | 1.000 | 0.174 | 0.323 | 0.182 | 43.61 |
| PatchTST ( Nie et al., 2022 ) | 0.949 | 0.202 | 0.220 | 0.625 | 0.283 | 0.231 | 0.234 | 0.587 | 0.435 | 41.84 |
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
| Subset | Normal | Abnormal | Input | Output | Cls./AD Length |
|---|---|---|---|---|---|
| 320-DIFF | 6,186 | 1,073 | 60 | 20 | 2,235 |
| 320-HPV | 6,186 | 2,495 | 60 | 20 | 2,235 |
| 320-PRV | 6,186 | 1,855 | 60 | 20 | 2,235 |
| 320-WEAV | 6,300 | 1,250 | 60 | 20 | 2,235 |
| 320-LOW | 6,300 | 1,117 | 60 | 20 | 2,235 |
| 321-DIFF | 7,797 | 1,097 | 60 | 20 | 2,235 |
| Variable | Physical Meaning |
|---|---|
| N21 | High-pressure rotor speed of Engine 1, representing the operating state of the engine bleed air source. |
| N22 | High-pressure rotor speed of Engine 2. |
| BMPS1 | Bleed manifold pressure associated with Engine 1. |
| BMPS2 | Bleed manifold pressure associated with Engine 2. |
| PRECOOL_PRESS1 | Bleed air pressure measured at the precooler section associated with Engine 1, downstream of the pressure regulating valve. |
| PRECOOL_PRESS2 | Bleed air pressure measured at the precooler section associated with Engine 2. |
| Dataset | PatchTST | TimeXer | xPatch | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 4 | 8 | 16 | 1 | 2 | 4 | 8 | 16 | 1 | 2 | 4 | 8 | 16 | |
| 320-DIFF | 0.429 | 0.420 | 0.418 | 0.417 | 0.419 | 0.402 | 0.397 | 0.397 | 0.408 | 0.411 | 0.409 | 0.407 | 0.407 | 0.404 | 0.403 |
| 320-HPV | 0.434 | 0.428 | 0.424 | 0.424 | 0.429 | 0.409 | 0.410 | 0.408 | 0.416 | 0.417 | 0.416 | 0.413 | 0.413 | 0.415 | 0.410 |
| 320-PRV | 0.430 | 0.426 | 0.424 | 0.421 | 0.424 | 0.406 | 0.402 | 0.402 | 0.413 | 0.413 | 0.413 | 0.409 | 0.412 | 0.409 | 0.408 |
| 320-WEAV | 0.456 | 0.450 | 0.450 | 0.450 | 0.450 | 0.443 | 0.437 | 0.436 | 0.451 | 0.455 | 0.471 | 0.440 | 0.439 | 0.438 | 0.435 |
| 320-LOW | 0.458 | 0.446 | 0.446 | 0.443 | 0.446 | 0.441 | 0.434 | 0.433 | 0.447 | 0.451 | 0.441 | 0.434 | 0.434 | 0.433 | 0.431 |
| Dataset | Stage | Time Series Forecasting Models (Full-shot) | Foundation Models (5-shot) | |||||||||||||
| OLi. | xPa. | DUET | TMix. | TXer | iTr. | DLi. | PTST | TNet | Auto. | TiRex | Chr. | TFM | Toto | Moirai | ||
| 320-DIFF | Taxi TakeOff | 0.130 | 0.104 | 0.130 | 0.154 | 0.142 | 0.123 | 0.124 | 0.136 | 0.114 | 0.177 | 0.107 | 0.101 | 0.131 | 0.105 | 0.239 |
| TakeOff Climb | 0.280 | 0.267 | 0.273 | 0.318 | 0.290 | 0.286 | 0.180 | 0.284 | 0.277 | 0.389 | 0.251 | 0.264 | 0.273 | 0.240 | 0.280 | |
| Climb Cruise | 0.287 | 0.278 | 0.288 | 0.304 | 0.310 | 0.285 | 0.144 | 0.297 | 0.287 | 0.436 | 0.272 | 0.276 | 0.280 | 0.263 | 0.303 | |
| Cruise Descend | 0.381 | 0.378 | 0.367 | 0.400 | 0.393 | 0.384 | 0.220 | 0.382 | 0.378 | 0.491 | 0.353 | 0.349 | 0.348 | 0.341 | 0.366 | |
| Avg | 0.269 | 0.257 | 0.265 | 0.294 | 0.284 | 0.269 | 0.167 | 0.275 | 0.264 | 0.373 | 0.246 | 0.248 | 0.258 | 0.237 | 0.297 | |
| Dataset | Stage | Time Series Forecasting Models (Full-shot) | Foundation Models (5-shot) | |||||||||||||
| OLi. | xPa. | DUET | TMix. | TXer | iTr. | DLi. | PTST | TNet | Auto. | TiRex | Chr. | TFM | Toto | Moirai | ||
| 320-DIFF | Taxi TakeOff | 0.351 | 0.378 | 0.332 | 0.449 | 0.378 | 0.383 | 0.327 | 0.396 | 0.348 | 0.424 | 0.379 | 0.371 | 0.424 | 0.378 | 0.535 |
| TakeOff Climb | 0.534 | 0.533 | 0.518 | 0.583 | 0.541 | 0.546 | 0.347 | 0.546 | 0.527 | 0.657 | 0.523 | 0.534 | 0.540 | 0.511 | 0.536 | |
| Climb Cruise | 0.576 | 0.585 | 0.577 | 0.619 | 0.606 | 0.590 | 0.319 | 0.603 | 0.570 | 0.746 | 0.580 | 0.574 | 0.586 | 0.557 | 0.594 | |
| Cruise Descend | 0.746 | 0.757 | 0.719 | 0.785 | 0.762 | 0.758 | 0.470 | 0.759 | 0.732 | 0.829 | 0.741 | 0.725 | 0.729 | 0.718 | 0.726 | |
| Avg | 0.552 | 0.563 | 0.537 | 0.609 | 0.572 | 0.569 | 0.366 | 0.576 | 0.544 | 0.664 | 0.556 | 0.551 | 0.570 | 0.541 | 0.598 | |
Predictive Maintenance
Predictive maintenance uses data and models to detect equipment faults, estimate degradation and remaining life, and plan timely repairs.
See all 121 papers