Let Prompts Bridge Defense Knowledge: Transferable Graph Purification via Vulnerability-Aware GPL
Organizations: Southeast University Nanjing, China · Nanyang Technological University Singapore, Singapore
Abstract
Graph Neural Networks (GNNs) have emerged as a cornerstone for representing complex relational dependencies in diverse multimedia tasks, particularly in cross-platform user interest modeling and cross-modal semantic alignment. In the real world, a practical defense against graph adversarial perturbations is needed. However, we observe that the prevailing adversarial purification methods are essentially domain-restricted defenses, which leads to the following shortcomings: (1) single-domain data provides insufficient structural and semantic diversity for learning robust purification criteria; (2) training of domain-specific defense strategies from scratch consumes substantial computational cost. To address the above limitations, we propose a transferable graph purification scheme, named ProGAP, to bridge adversarial defense knowledge via vulnerability-aware graph prompt learning. Firstly, to capture universal adversarial patterns, a perturbation-capture edge detector is pretrained on data-rich graphs by jointly modeling topological and semantic information. Subsequently, to achieve more knowledge transfer w.r.t. robustness, vulnerability-aware prompts are designed that inject targeted purification guidance into biased nodes, during which the pretrained detector adapts to distribution shifts in downstream graphs without parameter-laborious updates. Experimental results demonstrate that compared with state-of-the-art baselines, our ProGAP achieves 1%-9% improvement, and reduces the time consumption by up to 2.2x. The code for ProGAP is available at https://github.com/Lieyoufffff/ProGAP.
Figures & tables
| Dataset | Attack Rate | GCN | GCN-SVD | JaccardGCN | GNNGuard | HANG-quad | GADC | GPR-GAE | ProGAP-Pu | ProGAP-C | ProGAP-Ph |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Cora | Clean | 82.48 0.39 | 77.78 0.98 | 80.90 1.26 | 82.52 1.09 | 81.06 2.26 | 79.57 0.42 | 66.14 1.10 | 80.49 1.43 | 79.78 0.66 | 77.53 0.52 |
| M-25 | 58.82 4.39 | 63.86 4.38 | 64.60 0.61 | 57.99 4.08 | 63.18 1.29 | 73.70 1.02 | 65.37 1.03 | 77.41 0.89 | 77.73 0.37 | 74.69 1.37 | |
| M-50 | 35.23 1.16 | 44.13 5.39 | 48.32 0.96 | 35.70 4.45 | 62.29 1.34 | 68.15 0.76 | 65.20 1.18 | 77.31 1.04 | 75.21 1.96 | 73.32 1.10 | |
| H-25 | 71.97 2.27 | 68.95 1.00 | 71.60 2.26 | 71.39 1.90 | 63.46 0.93 | 75.57 0.50 | 65.74 1.82 | 77.13 1.16 | 77.41 0.60 | 74.72 0.98 | |
| H-50 | 63.53 2.63 | 55.91 2.46 | 68.59 2.58 | 64.96 3.01 | 63.76 0.69 | 71.07 1.32 | 66.46 1.53 | 75.63 1.24 | 75.52 1.81 | 72.39 0.19 | |
| G-25 | 53.98 4.02 | 66.22 1.93 | 60.59 2.58 | 53.97 3.07 | 63.08 0.64 | 72.34 0.89 | 66.14 1.25 | 76.94 1.39 | 76.91 0.91 | 73.75 1.03 |
| Defense | Cora | CiteSeer | CoraML | PubMed |
|---|---|---|---|---|
| GCN-SVD | 4.20 | 4.96 | 6.05 | 169.53 |
| HANG-quad | 10.33 | 11.58 | 9.37 | 22.85 |
| GADC | 6.93 | 7.13 | 7.02 | 13.10 |
| GPR-GAE | 29.47 | 25.84 | 35.85 | 53.46 |
| ProGAP | 4.09 | 5.15 | 5.93 | 10.11 |
| Model | Evasion Attack | Poisoned Attack | ||||||
|---|---|---|---|---|---|---|---|---|
| Cora | CiteSeer | PubMed | CoraML | Cora | CiteSeer | PubMed | CoraML | |
| GCN | 59.03 0.64 | 45.35 0.86 | 82.44 0.04 | 64.76 0.20 | 59.67 0.62 | 45.64 0.73 | 82.54 0.09 | 64.77 0.19 |
| GCN-SVD | 56.81 3.41 | 45.71 1.81 | 79.01 0.09 | 65.84 0.27 | 56.73 0.73 | 45.88 1.67 | 79.47 0.08 | 67.41 0.31 |
| GNNGuard | 61.47 0.56 | 48.03 0.60 | OOM | 66.50 0.44 | 62.06 0.34 | 48.84 1.02 | OOM | 66.71 0.33 |
| GRAND | 51.74 1.27 | 47.13 1.96 | 81.05 0.19 | 27.80 0.02 | 45.69 3.01 | 49.45 3.73 | 80.74 1.03 | 27.80 0.02 |
| Soft-Median-GDC | 63.15 6.08 | 52.93 8.31 | OOM | 61.16 4.73 | 63.74 3.03 | 59.82 2.52 | OOM | 70.43 1.85 |
| Variants | Cora | CiteSeer | CoraML | PubMed | ||||
|---|---|---|---|---|---|---|---|---|
| G-25 | M-25 | G-25 | M-25 | G-25 | M-25 | G-25 | M-25 | |
| ProGAP | 76.94 1.39 | 77.41 0.89 | 70.05 1.49 | 70.92 1.22 | 79.12 0.51 | 78.62 1.21 | 82.22 0.70 | 83.64 0.51 |
| w/o | 60.50 3.57 | 62.83 3.30 | 62.86 0.95 | 62.91 0.44 | 59.80 3.44 | 67.74 3.48 | 78.50 0.77 | 78.45 0.73 |
| w/o | 65.66 0.50 | 65.71 1.08 | 64.09 0.73 | 64.72 2.14 | 57.07 2.56 | 65.92 3.75 | 80.70 0.58 | 79.39 0.47 |
| w/o attn. | 75.40 1.27 | 75.57 1.11 | 69.90 0.86 | 70.50 1.30 | 78.59 0.45 | 77.40 1.18 | 82.72 0.75 | 83.77 0.38 |
| w/o pl | 76.13 1.74 | 77.08 1.23 | 70.09 1.09 | 70.23 1.03 | 78.90 0.41 | 78.08 1.35 | 81.95 0.77 | 83.26 0.33 |