PANDA: Prior-guided Attentional Dual-path Architecture
Organizations: University of Cambridge, UK · University of Bergamo, Italy · Independent Researcher
Abstract
Hypergraph Neural Networks (HNNs), designed to model higher-order relations beyond pairwise interactions, typically rely either on fixed structural weights or on normalised attention. Fixed weights can propagate misleading information in heterophilic settings, while normalisation makes attention coefficients competitive, in the sense that, in a message-passing framework, increasing the weight of one sender must reduce the weight of others in the same aggregation set. Our main contribution is the introduction of PANDA (Prior-guided AttentioNal Dual-path Architecture), a plug-in for two-stage message passing HNNs applicable to both undirected and directed settings. The main path interpolates between learned receiver-normalised attention and structural incidence priors, while a non-competitive (not normalised) auxiliary path lets each sender contribute its own transformed information. We also show that, with fixed structural coefficients, PANDA recovers a certain complex-valued convolution operator adopted in previous works. Across four HNNs spanning spatial and spectral methods in both directed and undirected settings, plugging PANDA in yields an average improvement of 5.18 percentage points across eight real-world benchmark datasets. The code is available at https://github.com/jainris/panda.
Figures & tables
| Variant | Telegram | Citeseer | Pubmed | Roman-empire | Cornell | Texas | Squirrel | email-Enron | |
| GeDi | VANILLA | 80.96 4.506 | 76.47 1.315 | 89.80 0.408 | 84.10 0.399 | 74.32 5.019 | 82.97 2.717 | 42.35 2.059 | 53.24 7.649 |
| PANDA w/o Prior,Aux | 73.27 6.631 | 75.89 0.973 | 89.68 0.415 | 88.65 0.753 | 78.65 3.908 | 83.51 4.432 | 38.62 1.851 | 58.11 7.376 | |
| PANDA w/o Aux | 80.00 4.485 | 76.20 0.768 | 90.04 0.316 | 87.98 0.758 | 76.22 3.585 | 84.05 6.216 | 39.62 2.573 | 60.81 9.145 | |
| PANDA | 91.15 3.567 | 76.12 0.921 | 89.32 0.416 | 90.11 0.699 | 77.03 4.230 | 84.05 4.595 | 42.76 1.742 | 60.27 8.466 | |
| (PANDA - Vanilla) | +10.19 | -0.35 | -0.48 | +6.01 | +2.71 | +1.08 | +0.41 | +7.03 | |
| HGNN | VANILLA | 58.08 6.760 | 77.49 1.226 | 90.08 0.318 | 78.84 0.650 | 71.35 4.713 | 81.89 5.135 | 39.08 2.861 | 42.43 4.366 |
| Variant | Telegram | Citeseer | Pubmed | Roman-empire | Cornell | Texas | Squirrel | email-Enron | |
| GCN | VANILLA | 90.38 2.852 | 77.00 1.197 | 89.28 0.272 | 75.18 0.683 | 52.43 9.300 | 67.57 6.396 | 43.70 1.947 | 62.16 5.539 |
| GAT (PANDA w/o Prior,Aux) | 82.88 3.488 | 76.75 0.919 | 89.92 0.247 | 85.90 0.707 | 53.78 10.429 | 68.92 6.648 | 39.73 1.634 | 68.92 6.310 | |
| PANDA | 91.73 3.851 | 76.30 1.070 | 88.97 0.466 | 86.74 0.711 | 73.78 6.049 | 80.54 4.804 | 42.84 1.322 | 64.86 7.151 | |
| (PANDA - Vanilla) | +1.37 | -0.70 | -0.31 | +11.55 | +21.35 | +12.97 | -0.86 | +2.70 |
| Dataset | Acc. | |||||
| Roman-empire | 0.236 | 95.68 | 29.44 / 1.77 | 2.20 | ||
| Telegram | 0.285 | 81.73 | 56.54 / 2.50 | 16.35 | ||
| Cornell | 0.420 | 57.84 | 5.95 / 1.35 | 1.08 | ||
| Texas | 0.505 | 47.03 | 3.24 / 3.24 | 1.35 | ||
| Citeseer | 0.795 | 23.97 | 1.84 / 0.82 | 0.22 |
| Model | Telegram | Citeseer | Pubmed | Roman-empire | Cornell | Texas | Squirrel | email-Enron |
| GeDi + Norm Aux | 75.96 5.319 | 76.56 0.862 | 89.25 0.498 | 89.42 0.466 | 75.14 3.784 | 80.27 6.401 | 40.07 4.317 | 52.16 7.649 |
| GeDi + PANDA | 91.15 3.567 | 76.12 0.921 | 89.32 0.416 | 90.11 0.699 | 77.03 4.230 | 84.05 4.595 | 42.76 1.742 | 60.27 8.466 |
| (PANDA - Norm Aux) | +15.19 | -0.44 | +0.07 | +0.69 | +1.89 | +3.78 | +2.69 | +8.11 |
| HGNN + Norm Aux | 69.62 3.922 | 77.38 0.648 | 89.66 0.379 | 79.83 0.621 | 70.54 4.265 | 80.54 2.911 | 38.78 2.902 | 51.62 3.354 |
| HGNN + PANDA | 72.12 2.885 | 77.17 1.125 | 89.77 0.368 | 82.37 0.511 | 74.59 2.162 | 83.24 5.644 | 40.43 0.999 | 54.59 8.090 |
| (PANDA - Norm Aux) | +2.50 | -0.21 | +0.11 | +2.54 | +4.05 | +2.70 | +1.65 | +2.97 |
Appendix figures & tables17 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | # Nodes | # Features | # Hyperedges | # Classes | avg | avg | CE Hom. | Node Hom. | Hyperedge Hom. |
| Roman-empire | 22,662 | 300 | 22,662 | 18 | 2.73 | 2.73 | 0.2363 | 0.0582 | 0.0582 |
| Squirrel | 2,223 | 2,089 | 2,060 | 5 | 23.81 | 22.07 | 0.2448 | 0.2081 | 0.2152 |
| Telegram | 245 | 1 | 183 | 4 | 49.70 | 37.12 | 0.2854 | 0.3459 | 0.3784 |
| email-Enron | 143 | – | 139 | 7 | 19.58 | 19.03 | 0.3251 | 0.4163 | 0.4314 |
| Cornell | 183 | 1,703 | 96 | 5 | 4.07 | 2.14 | 0.4200 | 0.4674 | 0.4534 |
| Texas | 183 | 1,703 | 110 | 5 | 3.81 | 2.29 | 0.5049 | 0.5076 | 0.3172 |
| Model | Telegram | Citeseer | Pubmed | Roman-empire | Cornell | Texas | Squirrel | email-Enron |
| GeDi (Vanilla) | 8.922 M | 30.864 M | 0.578 M | 5.383 M | 1.461 M | 4.015 M | 11.533 M | 26.884 M |
| GeDi + PANDA | 0.765 M | 35.682 M | 6.714 M | 0.421 M | 8.470 M | 0.638 M | 1.902 M | 5.880 M |
| HGNN (Vanilla) | 0.134 M | 13.734 M | 1.932 M | 1.761 M | 10.861 M | 3.168 M | 3.860 M | 0.035 M |
| HGNN + PANDA | 0.163 M | 15.720 M | 1.400 M | 2.590 M | 12.358 M | 6.638 M | 3.366 M | 0.139 M |
| HyperGCN (Vanilla) | 0.695 M | 3.154 M | 0.059 M | 0.046 M | 0.051 M | 0.026 M | 0.579 M | 0.396 M |
| HyperGCN + PANDA | 0.027 M | 1.933 M | 0.060 M | 0.138 M | 0.225 M | 0.060 M | 0.275 M | 0.052 M |
| Model | Telegram | Citeseer | Pubmed | Roman-empire | Cornell | Texas | Squirrel | email-Enron |
| GeDi (Vanilla) | 20.3 0.1 ms | 50.9 1.9 ms | 24.8 0.2 ms | 203.8 1.1 ms | 7.2 0.0 ms | 5.5 0.1 ms | 41.2 0.9 ms | 12.8 0.1 ms |
| GeDi + PANDA | 10.9 0.0 ms | 122.6 0.7 ms | 171.7 1.0 ms | 115.9 1.9 ms | 9.7 0.0 ms | 8.2 0.1 ms | 28.4 0.1 ms | 33.2 0.1 ms |
| HGNN (Vanilla) | 1.2 0.0 ms | 10.5 0.0 ms | 16.8 0.0 ms | 22.1 0.0 ms | 1.9 0.0 ms | 1.3 0.0 ms | 5.9 0.0 ms | 1.4 0.0 ms |
| HGNN + PANDA | 5.7 0.2 ms | 22.5 1.4 ms | 42.1 0.4 ms | 120.7 0.5 ms | 5.5 0.0 ms | 3.9 0.0 ms | 23.6 1.1 ms | 20.2 0.0 ms |
| HyperGCN (Vanilla) | 360.9 69.2 ms | 74.3 1.8 ms | 2.5 0.0 ms | 1.3 0.0 ms | 2.8 0.2 ms | 2.7 0.1 ms | 3.5 0.0 ms | 5.9 0.0 ms |
| HyperGCN + PANDA | 239.0 5.2 ms | 50.8 0.7 ms | 20.4 0.0 ms | 31.1 0.2 ms | 6.8 0.0 ms | 3.6 0.1 ms | 8.5 0.0 ms | 17.1 0.0 ms |
| Variant | Wisconsin | email-EU | Questions | |
| GeDi | Vanilla | 87.45 5.203 | 53.48 4.53 | 78.29 1.026 |
| PANDA | 87.84 4.454 | 52.87 5.60 | 79.69 1.21 | |
| (PANDA - Vanilla) | +0.39 | -0.61 | +1.40 | |
| HGNN | Vanilla | 85.88 5.173 | 52.88 1.83 | 78.25 1.122 |
| PANDA | 85.88 5.462 | 52.83 6.80 | 79.16 1.126 | |
| (PANDA - Vanilla) | +0.00 | -0.05 | +0.91 |
| Model | Parameter Count | Inference Time |
| GeDi (Vanilla) | 0.511 M | 195.7 0.8 ms |
| GeDi + PANDA | 0.427 M | 72.8 0.2 ms |
| HGNN (Vanilla) | 1.463 M | 53.4 1.3 ms |
| HGNN + PANDA | 0.108 M | 22.2 0.0 ms |
| HyperGCN (Vanilla) | 0.213 M | 9.3 0.0 ms |
| HyperGCN + PANDA | 0.032 M | 13.1 0.0 ms |
| Model | Telegram | Citeseer | Pubmed | Roman-empire | Cornell | Texas | Squirrel | email-Enron |
| GeDi (Vanilla) | 29.6782 | 1.0956 | 0.1784 | 1.2821 | 1.1428 | 1.0881 | 11.038 | 1.1938 |
| GeDi + PANDA | 61.9474 | 0.8936 | 0.9324 | 1.4452 | 1.5472 | 0.4988 | 1.8974 | 6.2111 |
| Model | Telegram | Citeseer | Pubmed | Roman-empire | Cornell | Texas | Squirrel | email-Enron |
| GeDi (Vanilla) | 1.711 | 1.848 | 1.430 | 1.124 | 1.143 | 1.462 | 1.174 | 1.178 |
| GeDi + PANDA | 1.226 | 1.956 | 1.663 | 0.990 | 1.236 | 2.324 | 1.761 | 0.961 |
| Routing variables | |
| Main and auxiliary incidence coefficients ( in , in ). | |
| Learned GAT component of the main coefficient. | |
| Per-incidence prior gate; large value structural prior dominates main path. | |
| Post-sigmoid auxiliary gate. | |
| Fraction of non-singleton receiver groups with effectively uniform . | |
| Aux-to-main norm ratio and aux share of total norm, in stage , role . | |
| Dataset | Test acc. mean std | Stage | Role | ||||||||||
| Citeseer | 3312 | 1951 | 3.35 | 1.98 | H | ||||||||
| T | |||||||||||||
| H | |||||||||||||
| T | |||||||||||||
| Cornell | 183 | 96 | 4.07 | 2.14 | H | ||||||||
| T |
| Stage | norm( ) | norm( ) |
| 0.00272 0.00436 | 0.07674 0.14079 | |
| 0.54175 0.32409 | 0.41068 0.23789 |
| Dataset | Test acc. mean std | Intervention | Acc. after gate shut-off |
| Citeseer | {\color[rgb]{1,0,0}\hat{g}^{(\ell)}_{e,v}}=0 | ||
| {\color[rgb]{0,0,1}\check{g}^{(\ell)}_{u,e}}=0 | |||
| both gates | |||
| Cornell | {\color[rgb]{1,0,0}\hat{g}^{(\ell)}_{e,v}}=0 | ||
| {\color[rgb]{0,0,1}\check{g}^{(\ell)}_{u,e}}=0 | |||
| both gates |
| Intervention | Layer(s) off | Test acc. (%) | Acc. (pp) |
| LOO | |||
| LOO | |||
| LOO | |||
| LOO | |||
| Cumulative | |||
| Cumulative |
| Dataset | Acc. | ||||||
| Citeseer | 0.795 | 23.97 | 1.84 | 0.82 | 0.22 | ||
| Cornell | 0.420 | 57.84 | 5.95 | 1.35 | 1.08 | ||
| Roman-empire | 0.236 | 95.68 | 29.44 | 1.77 | 2.20 | ||
| Telegram | 0.285 | 81.73 | 56.54 | 2.50 | 16.35 | ||
| Texas | 0.505 | 47.03 | 3.24 | 3.24 | 1.35 |
| (aux-off correct) | (aux-off wrong) | |||||||
| Dataset | ||||||||
| Citeseer | 618 | 210 | ||||||
| Cornell | 26 | 11 | ||||||
| Roman-empire | 3484 | 2182 | ||||||
| Telegram | 18 | 34 | ||||||
| Texas | 31 | 6 | ||||||
| Dataset | Layer | (std) | (std) | (std) | (std) |
| Citeseer | 0 | ||||
| Cornell | 0 | ||||
| Texas | 0 | ||||
| Telegram | 0 | ||||
| Roman-empire | 0 | ||||
Hypergraph Neural Networks
Hypergraph neural networks learn from relationships that connect groups of nodes, capturing interactions beyond ordinary pairwise graphs.
See all 58 papers