EngineAD: A Real-World Vehicle Engine Anomaly Detection Dataset
Organizations: Department of Electrical and Computer Engineering, McGill University, CA · MILA - Quebec AI Institute, CA · Preteckt Inc., Hamilton, ON, Canada
Abstract
The progress of Anomaly Detection (AD) in safety-critical domains, such as transportation, is severely constrained by the lack of large-scale, real-world benchmarks. To address this, we introduce EngineAD, a novel, multivariate dataset comprising high-resolution sensor telemetry collected from a fleet of 25 commercial vehicles over a six-month period. Unlike synthetic datasets, EngineAD features authentic operational data labeled with expert annotations, distinguishing normal states from subtle indicators of incipient engine faults. We preprocess the data into -timestep segments of principal components and establish an initial benchmark using nine diverse one-class anomaly detection models. Our experiments reveal significant performance variability across the vehicle fleet, underscoring the challenge of cross-vehicle generalization. Furthermore, our findings corroborate recent literature, showing that simple classical methods (e.g., K-Means and One-Class SVM) are often highly competitive with, or superior to, deep learning approaches in this segment-based evaluation. By publicly releasing EngineAD, we aim to provide a realistic, challenging resource for developing robust and field-deployable anomaly detection and anomaly prediction solutions for the automotive industry.
Figures & tables
| Truck ID | KMeans | IF | OCSVM | LOF | AE | COPOD | HBOS | SOD | DeepSVDD |
|---|---|---|---|---|---|---|---|---|---|
| 1 | 0.88 | 0.85 | 0.87 | 0.87 | 0.80 | 0.86 | 0.85 | 0.84 | 0.85 |
| 2 | 0.43 | 0.46 | 0.43 | 0.44 | 0.50 | 0.43 | 0.44 | 0.47 | 0.47 |
| 3 | 0.49 | 0.49 | 0.50 | 0.50 | 0.52 | 0.50 | 0.50 | 0.50 | 0.50 |
| 4 | 0.76 | 0.75 | 0.74 | 0.74 | 0.71 | 0.76 | 0.76 | 0.73 | 0.76 |
| 5 | 0.72 | 0.72 | 0.72 | 0.72 | 0.71 | 0.71 | 0.71 | 0.71 | 0.72 |
| 6 | 0.71 | 0.72 | 0.70 | 0.66 | 0.67 | 0.72 | 0.72 | 0.68 | 0.70 |
Anomaly Detection
Anomaly detection finds rare or unexpected patterns in data, from defective products and system faults to fraud and security threats.
See all 652 papers