HyperFuse: Fast Self-Supervised Node Embeddings for Attributed Hypergraphs
Organizations: School of Data Science, Indian Institute of Science Education and Research Thiruvananthapuram, Thiruvananthapuram, 695551, Kerala, India. · Department of Mathematics and Statistics, Indian Institute of Science Education and Research Kolkata, Mohanpur, 741246, West Bengal, India. · Institute of Computer Science, University of Rostock, Rostock, 18051, Germany. · Stellenbosch Institute for Advanced Study (STIAS), Stellenbosch, South Africa.
Abstract
Self-supervised hypergraph representation learning can produce informative node embeddings, but existing methods often require deep encoders trained for hundreds of epochs, making embedding generation costly even for hypergraphs with a few thousand nodes. This limits applications requiring embeddings for many or evolving hypergraphs. We present HyperFuse, a label-free pipeline for fast hypergraph representation learning. HyperFuse (i) computes structural node coordinates by maximizing a spectral relaxation of hypergraph modularity using Banerjee's hypergraph adjacency and a matrix-free operator with cost linear in node-hyperedge incidences; (ii) constructs multi-scale feature summaries and assigns bounded utility weights to hyperedges based on member stability under feature and membership masking; and (iii) trains a lightweight utility-weighted hypergraph encoder for 100 epochs using an invariance-decorrelation objective. We compare HyperFuse with TriCL, SE-HSSL, VilLain, and HypeBoy on nine public hypergraphs using six downstream classifiers and k-means clustering. On the eight datasets where all methods completed, HyperFuse required 8.7 s per dataset on average, achieving 13-179x geometric-mean speed-ups over the baselines. It achieved the highest average accuracy with five of six classifiers, while classification and clustering performance was not significantly different from TriCL and SE-HSSL. Compared with HypeBoy, HyperFuse was 13x faster and 2.1-4.1 percentage points more accurate across all classifiers. HyperFuse provides a practical approach for fast, repeated hypergraph embedding generation.
Figures & tables
| Symbol | Meaning |
|---|---|
| , , , | numbers of nodes, hyperedges, input features; embedding width |
| , , | widths of the structural, feature and incidence summaries ( , , ) |
| , , | incidence matrix, node-degree and hyperedge-size matrices |
| , , | Banerjee adjacency, strength vector, modularity matrix |
| , , | structural, feature and incidence summaries (Stages A, B) |
| , , | normalised incidence, lazy propagation, propagation at scale |
| Dataset | Classes | Feat. | ||||||
|---|---|---|---|---|---|---|---|---|
| 20News | 16,242 | 100 | 65,451 | 2,241 | 53,268,400 | 100 | 4 | B |
| Citeseer | 1,458 | 1,079 | 3,453 | 26 | 8,614 | 3,703 | 6 | B |
| Cora-CA | 2,388 | 1,072 | 4,585 | 43 | 29,884 | 1,433 | 7 | B |
| Cora-CC | 1,434 | 1,579 | 4,786 | 5 | 8,512 | 1,433 | 7 | B |
| DBLP | 41,302 | 22,363 | 99,561 | 202 | 865,262 | 1,425 | 6 | B |
| ModelNet40 | 12,311 | 12,311 | 61,555 | 5 | 137,888 | 100 | 40 | R |
| HyperFuse | TriCL | SE-HSSL | VilLain | HypeBoy | ||
| Embedding time | ||||||
| Mean time (s) | 8.7 | 6242.8 | 2516.8 | 1693.0 | 1184.4 | |
| Geo.-mean time (s) | 6.4 | 912.3 | 611.5 | 1145.5 | 86.2 | |
| Total time (min) | 1.2 | 832.4 | 335.6 | 225.7 | 157.9 | |
| Speed-up (geo. mean) | – | 143 | 96 | 179 | 13 | |
| Speed-up (range) | – | 5.4–4520 | 9.2–1720 | 82–675 | 1.7–461 | |
| Accuracy | Macro-F1 | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Classifier | Raw | HF | TC | SH | VL | HB | Raw | HF | TC | SH | VL | HB |
| LogReg | 70.63 | 80.37 | 80.08 | 79.18 | 64.69 | 77.88 | 63.29 | 73.19 | 74.08 | 73.03 | 58.59 | 71.41 |
| MLP | 64.46 | 78.61 | 79.49 | 79.22 | 61.57 | 74.54 | 57.40 | 70.47 | 73.06 | 72.52 | 55.47 | 66.39 |
| HGNN | 77.26 | 79.01 | 78.49 | 78.21 | 68.22 | 75.32 | 69.31 | 70.90 | 70.68 | 70.22 | 59.08 | 65.71 |
| HNHN | 73.45 | 78.85 | 78.59 | 78.31 | 70.97 | 75.91 | 65.70 | 71.12 | 70.61 | 70.60 | 61.99 | 67.92 |
| UniGCNII | 78.98 | 79.84 | 79.08 | 78.73 | 71.53 | 76.19 | 71.93 | 72.26 | 71.42 | 71.34 | 62.38 | 68.28 |
| Accuracy | Macro-F1 | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Classifier | HF | TC | SH | VL | HB | HF | TC | SH | VL | HB | ||
| LogReg | 1.75 | 2.00 | 3.12 | 4.75 | 3.38 | 0.001 | 2.00 | 2.00 | 3.00 | 4.75 | 3.25 | 0.003 |
| MLP | 2.50 | 1.75 | 2.25 | 4.88 | 3.62 | 0.001 | 2.88 | 1.75 | 2.00 | 4.88 | 3.50 | 0.001 |
| HGNN | 2.25 | 1.62 | 2.12 | 4.75 | 4.25 | 0.001 | 2.50 | 1.50 | 2.12 | 4.75 | 4.12 | 0.001 |
| HNHN | 1.88 | 1.75 | 2.62 | 4.62 | 4.12 | 0.001 | 2.25 | 1.88 | 2.25 | 4.62 | 4.00 | 0.001 |
| UniGCNII | 1.50 | 1.88 | 2.62 | 4.75 | 4.25 | 0.001 | 1.62 | 2.00 | 2.38 | 4.88 | 4.12 | 0.001 |
| HyperFuse | TriCL | VilLain | HypeBoy | ||
| Time (s) | 110.4 20.9 | 22322.3 3053.9 | 12170.2 193.0 | 5572.0 99.7 | |
| Accuracy (%) | LogReg | 89.39 0.06 | 89.99 0.12 | 75.08 0.16 | 90.27 0.02 |
| MLP | 88.88 0.15 | 91.10 0.06 | 78.23 0.65 | 89.57 0.20 | |
| HGNN | 86.80 0.16 | 90.50 0.02 | 77.27 0.12 | 88.78 0.01 | |
| HNHN | 89.23 0.18 | 91.22 0.05 | 79.06 0.16 | 89.61 0.09 | |
| UniGCNII | 88.26 0.09 | 91.02 0.07 | 79.63 0.08 | 89.34 0.04 |
Appendix figures & tables15 assets
Supplementary material from the paper’s appendix.
Appendix
| Stage | Setting | Value |
|---|---|---|
| A | structural width | |
| step-size factor ; maximum iterations | ; | |
| stopping rule | rel. change , checked every 5 iterations, patience 5, min. 20 | |
| B | feature and incidence widths , | , |
| residualisation ; masking rate | ; | |
| laziness ; hops | ; |
| TriCL | SE-HSSL | |||
| Dataset | Epochs | Width | Epochs | Width |
| 20News | 500 | 256 | 50 | 512 |
| Citeseer | 500 | 512 | 265 | 256 |
| Cora-CA | 800 | 512 | 160 | 512 |
| Cora-CC | 300 | 512 | 305 | 512 |
| DBLP | 500 | 256 | 60 | 512 |
| Dataset | HyperFuse | TriCL | SE-HSSL | VilLain | HypeBoy |
|---|---|---|---|---|---|
| 20News | 17.7 2.9 | 10010.4 14.4 | 2751.3 0.3 | 2021.5 4.1 | 8157.0 1105.0 |
| Citeseer | 7.8 1.8 | 253.3 0.1 | 71.8 0.2 | 634.8 21.5 | 64.1 2.7 |
| Cora-CA | 6.6 0.2 | 1182.6 30.6 | 1380.0 1.2 | 624.5 2.1 | 27.2 0.4 |
| Cora-CC | 5.2 0.1 | 205.3 2.1 | 1114.5 0.8 | 1228.9 89.9 | 19.7 1.4 |
| DBLP | 110.4 20.9 | 22322.3 3053.9 | OOT | 12170.2 193.0 | 5572.0 99.7 |
| ModelNet40 | 17.2 0.7 | 3872.1 102.1 | 2107.1 20.9 | 2975.7 62.7 | 1120.7 111.6 |
| Dataset | HyperFuse | TriCL | SE-HSSL | VilLain | HypeBoy |
|---|---|---|---|---|---|
| 20News | 43.59 0.70 | 31.36 3.68 | 38.17 0.22 | 38.91 0.12 | 31.61 1.48 |
| Citeseer | 42.19 1.16 | 44.12 0.23 | 42.80 2.27 | 24.93 0.31 | 39.01 0.51 |
| Cora-CA | 49.04 3.02 | 50.03 1.28 | 46.53 0.67 | 9.43 0.87 | 44.76 0.80 |
| Cora-CC | 55.68 0.66 | 55.20 0.87 | 54.35 1.66 | 36.56 1.55 | 42.68 0.47 |
| DBLP | 55.21 0.89 | 62.33 1.45 | OOT | 37.99 0.50 | 59.42 1.33 |
| ModelNet40 | 93.75 0.27 | 95.54 0.15 | 95.51 0.27 | 75.23 0.28 | 79.32 0.17 |
| Dataset | HyperFuse | TriCL | SE-HSSL | VilLain | HypeBoy |
|---|---|---|---|---|---|
| 20News | 47.42 1.45 | 20.43 5.46 | 39.98 0.52 | 38.86 0.12 | 15.98 2.18 |
| Citeseer | 41.66 0.64 | 45.02 0.31 | 42.02 1.74 | 17.78 0.70 | 38.63 1.51 |
| Cora-CA | 44.30 5.56 | 45.96 3.13 | 38.52 3.29 | 2.29 0.76 | 37.15 2.63 |
| Cora-CC | 50.05 0.67 | 49.04 0.12 | 45.55 3.60 | 23.99 2.26 | 27.75 1.86 |
| DBLP | 42.52 1.52 | 48.88 2.33 | OOT | 30.14 0.70 | 49.34 1.23 |
| ModelNet40 | 87.10 0.78 | 94.33 0.86 | 94.52 0.77 | 55.61 0.65 | 56.59 0.79 |
| Dataset | Classifier | Raw | HyperFuse | TriCL | SE-HSSL | VilLain | HypeBoy |
|---|---|---|---|---|---|---|---|
| 20News | LogReg | 78.65 0.00 | 79.71 0.17 | 77.22 0.04 | 76.31 0.27 | 79.20 0.07 | 79.84 0.09 |
| MLP | 79.10 0.18 | 79.48 0.25 | 79.55 0.20 | 78.76 0.12 | 78.38 0.33 | 79.80 0.02 | |
| HGNN | 80.00 0.08 | 79.12 0.05 | 79.83 0.11 | 79.62 0.13 | 74.82 0.09 | 77.76 0.37 | |
| HNHN | 79.60 0.05 | 79.78 0.17 | 80.07 0.06 | 79.65 0.08 | 79.33 0.28 | 79.74 0.34 | |
| UniGCNII | 80.10 0.08 | 79.73 0.05 | 80.19 0.07 | 79.84 0.06 | 78.14 0.08 | 78.64 0.18 | |
| AllSetTr. | 79.62 0.21 | 79.94 0.20 | 80.31 0.15 | 79.81 0.36 | 80.23 0.08 | 80.05 0.18 |
| Dataset | Classifier | Raw | HyperFuse | TriCL | SE-HSSL | VilLain | HypeBoy |
|---|---|---|---|---|---|---|---|
| ModelNet40 | LogReg | 95.63 0.00 | 97.18 0.03 | 96.96 0.08 | 96.95 0.05 | 86.54 0.10 | 93.75 0.06 |
| MLP | 94.53 0.13 | 96.02 0.23 | 96.79 0.19 | 96.83 0.22 | 85.97 0.49 | 91.83 0.43 | |
| HGNN | 94.06 0.02 | 93.61 0.10 | 92.56 0.06 | 92.46 0.06 | 87.04 0.16 | 88.93 0.10 | |
| HNHN | 96.18 0.20 | 96.73 0.16 | 94.99 0.17 | 94.63 0.31 | 86.71 0.06 | 90.90 0.15 | |
| UniGCNII | 96.59 0.01 | 95.80 0.05 | 93.76 0.09 | 93.71 0.06 | 87.00 0.03 | 90.00 0.17 | |
| AllSetTr. | 97.04 0.18 | 97.15 0.07 | 95.55 0.13 | 95.51 0.11 | 87.05 0.02 | 92.69 0.31 |
| Dataset | Classifier | Raw | HyperFuse | TriCL | SE-HSSL | VilLain | HypeBoy |
|---|---|---|---|---|---|---|---|
| 20News | LogReg | 76.25 0.00 | 77.37 0.22 | 74.84 0.07 | 74.03 0.29 | 76.52 0.05 | 77.40 0.06 |
| MLP | 76.57 0.13 | 76.85 0.48 | 76.91 0.25 | 76.36 0.17 | 75.73 0.50 | 77.23 0.05 | |
| HGNN | 77.28 0.14 | 75.98 0.12 | 76.81 0.23 | 76.67 0.17 | 67.39 0.29 | 73.61 0.83 | |
| HNHN | 77.18 0.05 | 77.26 0.21 | 77.47 0.14 | 77.19 0.12 | 76.39 0.37 | 76.96 0.48 | |
| UniGCNII | 77.67 0.03 | 76.96 0.03 | 77.53 0.04 | 77.32 0.24 | 74.11 0.13 | 75.28 0.26 | |
| AllSetTr. | 77.24 0.39 | 77.44 0.24 | 78.01 0.24 | 77.46 0.37 | 77.70 0.14 | 77.47 0.15 |
| Dataset | Classifier | Raw | HyperFuse | TriCL | SE-HSSL | VilLain | HypeBoy |
|---|---|---|---|---|---|---|---|
| ModelNet40 | LogReg | 94.19 0.00 | 96.00 0.07 | 95.97 0.10 | 95.96 0.03 | 83.27 0.12 | 91.58 0.07 |
| MLP | 91.78 0.22 | 93.21 0.46 | 95.53 0.37 | 95.51 0.60 | 81.60 0.80 | 87.62 1.35 | |
| HGNN | 91.88 0.09 | 91.19 0.15 | 89.86 0.18 | 89.59 0.25 | 82.90 0.36 | 82.18 0.15 | |
| HNHN | 94.45 0.34 | 95.10 0.23 | 92.92 0.29 | 92.55 0.48 | 82.37 0.21 | 86.93 0.38 | |
| UniGCNII | 95.31 0.04 | 94.21 0.02 | 91.63 0.07 | 91.60 0.05 | 82.89 0.17 | 85.30 0.32 | |
| AllSetTr. | 95.79 0.25 | 95.85 0.13 | 93.94 0.27 | 93.91 0.21 | 82.95 0.18 | 90.04 0.46 |
| Variant | Raw features | Feature summary | Incidence summary |
|---|---|---|---|
| HyperFuse | ✓ | ✓ | ✓ |
| No side input | ✓ | – | – |
| Side F | ✓ | ✓ | – |
| Side G | ✓ | – | ✓ |
| Side only | – | ✓ | ✓ |
| Dataset | HyperFuse | No side input | Side F | Side G | Side only |
|---|---|---|---|---|---|
| 20News | 79.71 0.17 | 79.45 0.01 | 79.50 0.05 | 79.59 0.07 | 79.09 0.13 |
| Citeseer | 70.23 0.55 | 70.74 0.41 | 70.42 0.60 | 68.25 0.19 | 64.16 0.19 |
| Cora-CA | 81.11 0.41 | 81.07 0.38 | 80.91 0.39 | 79.65 0.13 | 73.72 0.70 |
| Cora-CC | 80.18 0.36 | 80.14 0.43 | 80.81 0.28 | 80.09 0.65 | 72.02 1.11 |
| ModelNet40 | 97.18 0.03 | 96.83 0.13 | 97.08 0.08 | 96.97 0.10 | 97.08 0.02 |
| NTU2012 | 74.91 0.36 | 74.41 0.14 | 74.37 0.45 | 74.15 0.17 | 73.67 0.19 |
| Dataset | HyperFuse | No side input | Side F | Side G | Side only |
|---|---|---|---|---|---|
| 20News | 77.37 0.22 | 77.02 0.06 | 77.06 0.04 | 77.20 0.04 | 76.74 0.13 |
| Citeseer | 64.57 0.50 | 65.23 0.26 | 64.65 0.97 | 62.34 0.20 | 58.37 0.18 |
| Cora-CA | 79.47 0.64 | 79.36 0.51 | 79.11 0.37 | 77.80 0.09 | 71.64 0.74 |
| Cora-CC | 78.35 0.54 | 78.10 0.73 | 78.85 0.40 | 77.90 0.86 | 69.47 1.05 |
| ModelNet40 | 96.00 0.07 | 95.62 0.18 | 95.93 0.06 | 95.77 0.12 | 96.18 0.08 |
| NTU2012 | 62.21 0.44 | 62.17 0.35 | 61.96 0.64 | 61.39 0.22 | 61.28 0.12 |
| Dataset | Model | 100% | 50% | 20% | 5% | Noise | Noise ∗ |
|---|---|---|---|---|---|---|---|
| 20News | HyperFuse | 79.71 0.17 | 77.46 0.66 | 77.82 0.33 | 78.39 0.01 | 29.57 0.84 | 75.35 0.78 |
| Encoder | 79.49 0.16 | 77.56 0.21 | 78.02 0.29 | 78.12 0.37 | 28.20 0.47 | 43.73 0.77 | |
| Citeseer | HyperFuse | 70.23 0.55 | 67.00 2.03 | 59.40 1.61 | 42.14 2.62 | 18.95 0.63 | 23.41 0.53 |
| Encoder | 70.75 0.53 | 66.76 1.69 | 60.85 0.94 | 47.68 1.48 | 19.45 0.73 | 24.13 1.08 | |
| Cora-CA | HyperFuse | 81.11 0.41 | 73.44 3.58 | 61.39 3.83 | 43.22 0.99 | 17.96 0.55 | 23.55 0.96 |
| Encoder | 81.23 0.47 | 74.26 2.78 | 64.14 2.70 | 46.03 1.87 | 18.60 0.42 | 21.78 0.28 |
| Dataset | Model | 100% | 50% | 20% | 5% | Noise | Noise ∗ |
|---|---|---|---|---|---|---|---|
| 20News | HyperFuse | 77.37 0.22 | 74.92 0.54 | 75.13 0.36 | 75.79 0.16 | 26.30 0.92 | 72.16 0.92 |
| Encoder | 77.06 0.16 | 74.99 0.15 | 75.28 0.27 | 75.23 0.39 | 24.85 0.45 | 39.29 1.31 | |
| Citeseer | HyperFuse | 64.57 0.50 | 61.75 2.54 | 54.28 1.90 | 37.49 2.95 | 17.26 0.79 | 21.44 0.51 |
| Encoder | 65.31 0.24 | 61.64 1.59 | 55.59 0.91 | 42.22 1.20 | 17.46 0.61 | 21.84 0.88 | |
| Cora-CA | HyperFuse | 79.47 0.64 | 71.10 3.93 | 58.81 2.41 | 38.22 0.72 | 14.62 0.71 | 19.32 0.92 |
| Encoder | 79.58 0.67 | 72.28 2.86 | 61.60 1.64 | 41.07 3.17 | 15.21 0.55 | 17.62 0.24 |
Hypergraph Learning
Hypergraph learning models relationships among groups of entities to capture interactions that pairwise graphs cannot represent.
See all 54 papers