High-order Knowledge Based Network Controllability Robustness Prediction: A Hypergraph Neural Network Approach
Organizations: School of Artifcial Intelligence, Xidian University, Xian 710126, China. · School of Computer Science and Technology, Xidian University, Xian 710126, China. · Guangzhou Institute of Technology, Xidian University, Guangzhou 510555, China.
Abstract
In order to evaluate the invulnerability of networks against various types of attacks and provide guidance for potential performance enhancement as well as controllability maintenance, network controllability robustness (NCR) has attracted increasing attention in recent years. Traditionally, controllability robustness is determined by attack simulations, which are computationally time-consuming and only applicable to small-scale networks. Although some machine learning-based methods for predicting network controllability robustness have been proposed, they mainly focus on pairwise interactions in complex networks, and the underlying relationships between high-order structural information and controllability robustness have not been explored. In this paper, a dual hypergraph attention neural network model based on high-order knowledge (NCR-HoK) is proposed to accomplish robustness learning and controllability robustness curve prediction. Through a node feature encoder, hypergraph construction with high-order relations, and a dedicated dual hypergraph attention module, the proposed method can effectively learn three types of network information simultaneously: explicit structural information in the original graph, high-order connection information in local neighborhoods, and hidden features in the embedding space. Notably, we explore for the first time the impact of high-order knowledge on network controllability robustness. Compared with state-of-the-art methods for network robustness learning, the proposed method achieves superior performance on both synthetic and real-world networks with low computational overhead.
Figures & tables
| <k>=2 | <k>=5 | <k>=8 | <k>=10 | Average | |||
|---|---|---|---|---|---|---|---|
| 0.020 | 0.016 | 0.014 | 0.014 | 0.016(#2) | |||
| PCR | 0.015 | 0.019 | 0.020 | 0.022 | 0.019(#2) | ||
| 0.043 | 0.015 | 0.017 | 0.013 | 0.022(#3) | |||
| iPCR | 0.054 | 0.018 | 0.022 | 0.020 | 0.029(#4) | ||
| 0.029 | 0.034 | 0.020 | 0.014 | 0.024(#4) | |||
| CRL-SGNN | 0.016 | 0.043 | 0.021 | 0.022 | 0.026(#3) | ||
| ER | SF | QSN | SW | Average | |||
|---|---|---|---|---|---|---|---|
| 0.019 | 0.030 | 0.018 | 0.021 | 0.022(#2) | |||
| PCR | 0.017 | 0.018 | 0.016 | 0.018 | 0.017(#2) | ||
| 0.030 | 0.109 | 0.029 | 0.030 | 0.050(#4) | |||
| iPCR | 0.021 | 0.140 | 0.018 | 0.024 | 0.051(#4) | ||
| 0.052 | 0.044 | 0.035 | 0.035 | 0.042(#3) | |||
| CRL-SGNN | 0.057 | 0.045 | 0.040 | 0.041 | 0.028(#3) | ||
| ER | SF | QSN | SW | Average | |||
|---|---|---|---|---|---|---|---|
| 0.012 | 0.026 | 0.013 | 0.011 | 0.016(#1) | |||
| PCR | 0.022 | 0.023 | 0.020 | 0.021 | 0.022(#2) | ||
| 0.012 | 0.043 | 0.013 | 0.011 | 0.020(#2) | |||
| iPCR | 0.022 | 0.044 | 0.019 | 0.021 | 0.027(#4) | ||
| 0.012 | 0.026 | 0.016 | 0.011 | 0.016(#1) | |||
| CRL-SGNN | 0.024 | 0.029 | 0.022 | 0.023 | 0.025(#3) | ||
| Real-World Networks | Brief description | Node Number | Edge Number |
|---|---|---|---|
| DDG(DD-g97) | Protein | 1021 | 5778 |
| DEL(delaunay-n10) | DIMACS10 problem | 1024 | 3056 |
| DW5(dwt-1005) | Symmetric connection from Washington | 1005 | 4813 |
| DW7(dwt-1007) | 1007 | 4791 | |
| LSH(lshp1009) | Alan George’s L-shape problem | 1009 | 3937 |
| ORS(orsirr-1) | oil reservoir simulation | 1030 | 6858 |
| Real-World Networks | DDG | DEL | DW5 | DW7 | LSH | ORS | Average | |
|---|---|---|---|---|---|---|---|---|
| PCR | 0.053 | 0.210 | 0.157 | 0.146 | 0.195 | 0.147 | 0.151(#3) | |
| 0.037 | 0.076 | 0.222 | 0.211 | 0.223 | 0.210 | 0.163(#3) | ||
| iPCR | 0.039 | 0.285 | 0.154 | 0.145 | 0.228 | 0.118 | 0.162(#4) | |
| 0.023 | 0.116 | 0.221 | 0.214 | 0.223 | 0.193 | 0.165(#4) | ||
| CRL-SGNN | 0.033 | 0.043 | 0.119 | 0.091 | 0.123 | 0.205 | 0.102(#2) | |
| 0.028 | 0.039 | 0.186 | 0.164 | 0.184 | 0.063 | 0.111(#2) | ||
| <k>=2 | <k>=5 | <k>=8 | <k>=10 | |||
|---|---|---|---|---|---|---|
| 0.037 | 0.027 | 0.017 | 0.017 | |||
| w.o. BC | 0.020 | 0.014 | 0.012 | 0.011 | ||
| 0.214 | 0.098 | 0.061 | 0.047 | |||
| w.o. S-HGNN | 0.018 | 0.018 | 0.012 | 0.011 | ||
| 0.340 | 0.105 | 0.056 | 0.044 | |||
| w.o. Dual HGNN | 0.036 | 0.021 | 0.012 | 0.010 | ||
| Controllability Robustness | Unit: Second |
|---|---|
| RAS | 23.581 |
| PCR | 0.306 |
| iPCR | 0.325 |
| CRL-SGNN | 0.029 |
| NCR-HoK | 0.085 |
| Layer Name | Layer Type | Input Channels | Output Channels | Number of Parameters |
|---|---|---|---|---|
| gat1 | GATConv (4 heads) | 1 | 64 | |
| gat2 | GATConv (1 head) | 64 | ||
| fc | Fully Connected | 64 | 1 |
| RA Attack | <k>=2 | <k>=5 | <k>=8 | <k>=10 | ||
|---|---|---|---|---|---|---|
| 0.019 | 0.015 | 0.016 | 0.012 | |||
| ER | 0.014 | 0.011 | 0.010 | 0.008 | ||
| 0.020 | 0.022 | 0.023 | 0.023 | |||
| SF | 0.016 | 0.016 | 0.017 | 0.017 | ||
| 0.016 | 0.018 | 0.016 | 0.016 | |||
| QSN | 0.012 | 0.012 | 0.011 | 0.011 | ||
| RA Attack | <k>=2 | <k>=5 | <k>=8 | <k>=10 | ||
|---|---|---|---|---|---|---|
| 0.016 | 0.014 | 0.012 | 0.011 | |||
| ER | 0.013 | 0.011 | 0.010 | 0.008 | ||
| 0.016 | 0.019 | 0.021 | 0.021 | |||
| SF | 0.013 | 0.015 | 0.016 | 0.016 | ||
| 0.015 | 0.015 | 0.013 | 0.013 | |||
| QSN | 0.011 | 0.011 | 0.010 | 0.009 | ||
| RA Attack | <k>=2 | <k>=5 | <k>=8 | <k>=10 | ||
|---|---|---|---|---|---|---|
| 0.016 | 0.014 | 0.012 | 0.010 | |||
| ER | 0.012 | 0.011 | 0.009 | 0.008 | ||
| 0.016 | 0.019 | 0.021 | 0.021 | |||
| SF | 0.012 | 0.015 | 0.016 | 0.015 | ||
| 0.015 | 0.014 | 0.013 | 0.012 | |||
| QSN | 0.011 | 0.011 | 0.010 | 0.009 | ||
| <k>=2 | <k>=5 | <k>=8 | <k>=10 | Average | |||
|---|---|---|---|---|---|---|---|
| 0.039 | 0.040 | 0.018 | 0.013 | 0.028(#3) | |||
| PCR | 0.017 | 0.016 | 0.010 | 0.008 | 0.013(#2) | ||
| 0.053 | 0.004 | 0.008 | 0.006 | 0.018(#2) | |||
| iPCR | 0.070 | 0.004 | 0.007 | 0.006 | 0.022(#3) | ||
| 0.013 | 0.070 | 0.019 | 0.049 | 0.038(#4) | |||
| CRL-SGNN | 0.014 | 0.047 | 0.022 | 0.051 | 0.034(#4) | ||
| <k>=2 | <k>=5 | <k>=8 | <k>=10 | Average | |||
|---|---|---|---|---|---|---|---|
| 0.047 | 0.033 | 0.018 | 0.016 | 0.029(#3) | |||
| PCR | 0.017 | 0.015 | 0.012 | 0.010 | 0.014(#2) | ||
| 0.080 | 0.013 | 0.011 | 0.013 | 0.029(#3) | |||
| iPCR | 0.086 | 0.009 | 0.011 | 0.013 | 0.030(#3) | ||
| 0.014 | 0.041 | 0.015 | 0.038 | 0.027(#2) | |||
| CRL-SGNN | 0.015 | 0.052 | 0.014 | 0.038 | 0.030(#3) | ||