Polarized Direct Cross-Attention Message Passing in GNNs for Machinery Fault Diagnosis
Authors: Zongyu Shi, Laibin Zhang, Maoyin Chen
Organizations: Department of Automation, College of Artificial Intelligence, China University of Petroleum (Beijing), Beijing 102299, China · Department of Safety Engineering, College of Safety and Ocean Engineering, China University of Petroleum (Beijing), Beijing 102299, China
The reliability of safety-critical industrial systems hinges on accurate and robust fault diagnosis in rotating machinery. Conventional graph neural networks (GNNs) for machinery fault diagnosis face limitations in modeling complex dynamic interactions due to their reliance on predefined static graph structures and homogeneous aggregation schemes. To overcome these challenges, this paper introduces polarized direct cross-attention (PolaDCA), a novel relational learning framework that enables adaptive message passing through data-driven graph construction. Our approach builds upon a direct cross-attention (DCA) mechanism that dynamically infers attention weights from three semantically distinct node features (such as individual characteristics, neighborhood consensus, and neighborhood diversity) without requiring fixed adjacency matrices. Theoretical analysis establishes PolaDCA's superior noise robustness over conventional GNNs. Extensive experiments on industrial datasets (i.e., XJTUSuprgear, CWRUBearing and Three-Phase Flow Facility datasets) demonstrate state-of-the-art diagnostic accuracy and enhanced generalization under varying noise conditions, outperforming seven competitive baseline methods. The proposed framework provides an effective solution for safety-critical industrial applications.
Figures & tables
Fig. 1: Framework of DCA-GNN
Fig. 2: Framework of DCA-based message passing
Fig. 3: Framework of PolaDCA-based message passing
Method
Average (%)
Best (%)
ACC
F1
ACC
F1
GCN
94.97±3.37
93.69±2.97
96.67
96.67
GAT
78.97±6.29
77.70±7.07
89.17
89.06
GraphSAGE
87.57±1.38
87.46±1.48
88.83
88.74
GTF(SCA)
97.99±1.00
98.00±0.99
99.00
99.00
GCL
81.80±2.95
81.48±3.11
85.00
84.82
TABLE I: Experimental Result on XJTUSuprgear Normal Data
Method
0 dB
-2 dB
-4 dB
-6 dB
-8 dB
ACC(%)
F1(%)
ACC(%)
F1(%)
ACC(%)
F1(%)
ACC(%)
F1(%)
ACC(%)
F1(%)
GCN
75.17
74.57
71 83
71.15
71.77
71.06
70.50
69.92
62.17
61.13
GAT
62.17
55.94
60.17
54.39
61.33
57.89
60.67
57.67
46.67
37.37
GraphSAGE
69.33
69.51
67.83
67.70
61.89
61.85
59.17
58.06
60.33
60.70
GTF(SCA)
84.22
84.11
83.83
83.71
78.67
78.45
79.17
78.65
77.06
76.58
GCL
49.56
46.71
47.33
44.44
43.56
39.95
45.00
40.82
43.67
39.53
TABLE II: Average Experimental Result on XJTUSuprgear with Gaussian Noise
Method
Average (%)
Best (%)
ACC
F1
ACC
F1
GNN
95.46±2.18
94.27±2.06
96.91
96.48
GAT
83.33±3.67
82.34±3.07
86.82
86.31
GraphSAGE
97.17±0.97
97.16±0.87
98.12
98.12
GTF(SCA)
96.00±0.57
96.00±0.41
96.85
96.76
GCL
81.17±1.19
79.07±0.96
82.08
80.15
TABLE III: Experimental Result on CWRUBearing Normal Data
Fig. 4: Accuracy comparison on CWRUBering data with gaussian noise
Method
Average (%)
Best (%)
ACC
F1
ACC
F1
GCN
67.67±4.37
65.85±3.97
72.08
71.65
GAT
77.97±2.29
76.70±2.07
81.09
80.84
IAGNN
91.19±1.65
90.67±1.58
93.45
92.17
MA-STGNN
93.80±2.86
92.78±2.57
96.85
95.66
CDGNN
97.58±0.83
96.97±0.71
98.14
97.87
TABLE IV: Experimental Result on TFF Noraml Data
Fig. 5: Accuracy comparison on TFF data with gaussian noise
Appendix figures & tables11 assets
Supplementary material from the paper’s appendix.
Appendix
Fig. H.1: XJTUSuprgear dataset detailed sensors position
No.
Fault type
Training data
Testing data
1
15Hz_Normal
140
60
2
15Hz_Crack02
140
60
3
15Hz_Crack06
140
60
4
15Hz_Crack10
140
60
5
15Hz_Crack14
140
60
6
20Hz_Normal
140
60
Appendix
TABLE H.1: Fault Types in the XJTUSuprGear Dataset
No.
Fault type
Training data
Testing data
1
Normal
140
60
2
Rolling Element Fault (0.007 in)
140
60
3
Rolling Element Fault (0.014 in)
140
60
4
Rolling Element Fault (0.021 in)
140
60
5
Inner Race Fault (0.007 in)
140
60
6
Inner Race Fault (0.014 in)
140
60
Appendix
TABLE H.2: Fault Types in the CWRUBearing Dataset
Variables
Measured magnitude
Unit
1
Air delivery pressure
MPa
2
Pressure in the bottom of the riser
MPa
3
Pressure in top of the riser
MPa
4
Pressure in top separator
MPa
5
Pressure in 3 phase separator
MPa
6
Diff. pressure (PT401-PT408)
MPa
Appendix
TABLE H.3: Variables in Three-Phase Flow Facility Dataset
No.
Fault type
Training data
Testing data
1
Air line blockage
50
21
2
Water line blockage
60
26
3
Top separator input blockage
100
43
4
Open direct bypass
73
32
5
Slugging conditions
35
15
6
Pressurization of the 2” line
52
22
Appendix
TABLE H.4: Fault Types in Three-Phase Flow Facility Dataset
Fault detection and diagnosis are critical for the optimal and safe operation of industrial processes. The correlations among sensors often display non-Euclidean structures where graph neural networks (GNNs) are widely used therein. However, for large-scale systems, local, global, and dynamic relations extensively exist among sensors, and traditional GNNs often overlook such complex and multi-level structures for various problems including the fault diagnosis. To address this issue, we propose a structure-aware multi-level temporal graph network with local-global feature fusion for industrial fault diagnosis. First, a correlation graph is dynamically constructed using Pearson correlation coefficients to capture relationships among process variables. Then, temporal features are extracted through long short-term memory (LSTM)-based encoder, whereas the spatial dependencies among sensors are learned by graph convolution layers. A multi-level pooling mechanism is used to gradually coarsen and learn meaningful graph structures, to capture higher-level patterns while keeping important fault related details. Finally, a fusion step is applied to combine both detailed local features and overall global patterns before the final prediction. Experimental evaluations on the Tennessee Eastman process (TEP) demonstrate that the proposed model achieves superior fault diagnosis performance, particularly for complex fault scenarios, outperforming various baseline methods.
Bibek Aryal, Gift Modekwe, Qiugang Lu
Department of Chemical Engineering, Texas Tech University, Lubbock, TX 79409, USA
Accurate fault diagnosis of rolling element bearings in rotating machinery is considered essential for ensuring industrial safety and enabling predictive maintenance. Conventional statistical feature-based methods rely on predefined descriptors, whose diagnostic sensitivity is constrained by fixed configurations and limited adaptability across varying fault conditions. Although deep learning approaches offer strong representational capacity, their effectiveness is often restricted by high data requirements and reduced interpretability. In this work, a parametric adaptive feature extraction framework is proposed, in which feature characteristics are learned directly from data rather than being manually specified. Multiple complementary representations are extracted from vibration signals, including absolute features capturing signal energy distribution, signed moment features reflecting waveform asymmetry, and AC-coupled moment features emphasizing dynamic fluctuations, while interactions between multiple sensor channels are modeled through a structured fusion mechanism to enhance fault representation. The proposed approach is evaluated on a benchmark gearbox bearing dataset comprising five health conditions, including normal operation and multiple fault types. Improved classification performance is observed compared to conventional methods, with consistent results under cross-validation, indicating strong generalization capability. Additionally, enhanced feature separability is demonstrated through clearer clustering patterns in low-dimensional projections. The learned representations effectively capture a wide range of signal characteristics, supporting both improved diagnostic performance and practical applicability in industrial monitoring systems.
Rajeev Kumar
Department of Mechanical Engineering University of Alberta Edmonton, Canada
Industrial processes are complex systems composed of multiple interacting sensors that generate multivariate time series (MTS). Detecting anomalies in such systems is critical for reliability and safety, yet understanding their origin is equally important. Existing Graph Neural Network (GNN)based methods for anomaly detection primarily focus on sensor-level deviations and either attribute anomalies directly to the deviating sensors. When diagnosis is attempted, generally, the most deviated sensor is identified as a root cause of a system fault. However, in many industrial systems, anomalies do not arise from faulty sensors but from disruptions in the influences governing the system dynamics. We propose an explainable GNN-based anomaly detection framework that shifts the perspective from sensor-level anomalies to component-level diagnosis, hypothesizing that anomalous measurements are symptoms of altered inter-sensor influences. Experiments show that the method effectively identifies and prioritizes the true faulty components, providing interpretable insights into system failures.
Sena Ozgunay, Louise Trav{é}-Massuy{è}s, Jean-Michel Loubes +1
Comue de Toulouse, LAAS-DISCO, IMT · Comue de Toulouse, LAAS-DISCO · REGALIA, IMT +1