Fractional Heat Kernel for Semi-Supervised Graph Learning with Small Training Sample Size
Abstract
We develop a source-driven fractional heat-kernel framework for semi-super-vised graph learning that combines nonlocal propagation with sustained label information. A fixed nonzero label source compatible with the Laplacian null space prevents asymptotic collapse into that space, providing a mechanism for mitigating oversmoothing at long diffusion times. The fractional order controls the relative modal attenuation and the spectral weighting of the sustained response, while the diffusion time sets the propagation horizon. We characterize conservation laws and equilibria on normalized and disconnected graphs, develop a null-space deflation, and analyze the approximation of the propagators. On Two-Moon, fractional orders improve source-free propagation, while compatible source-driven diffusion exceeds mean accuracy with one training label per class at orders and . On Cora and CiteSeer, the source-driven pipeline improves mean accuracy over GAT by and percentage points at one training label per class, with model selection on labeled validation nodes and closely comparable classical and fractional pipeline configurations; it matches GAT on PubMed and trails it at ten and twenty labels per class on Cora. Within GraphHeat, validation-based exponent selection at a common diffusion time yields a paired gain of percentage points at one label per class.
Figures & tables
| 0.30 | 0.089 | 0.0067 | 0.0040 |
|---|---|---|---|
| 0.50 | 0.226 | 0.0067 | 0.0027 |
| 0.75 | 0.444 | 0.0067 | 0.0016 |
| 1.00 | 0.642 | 0.0067 | 0.0009 |
| 1.50 | 0.876 | 0.0067 | 0.0003 |
| 4 | |||
|---|---|---|---|
| 8 | |||
| 12 | |||
| 16 | |||
| 20 | |||
| 24 |
| Symbol | Definition |
|---|---|
| Set of currently labeled nodes at iteration | |
| Set of unlabeled nodes at iteration , | |
| Fixed pool of nodes eligible for pseudo-label promotion | |
| Remaining eligible nodes, | |
| Set of high-confidence nodes selected for pseudo-labeling at iteration | |
| Current label matrix, including original and pseudo-labels |
| Labels per class | Scheme 1 | Scheme 2 | Scheme 3 | |
|---|---|---|---|---|
| 0.2 | 1 | 0.886 0.016 | 0.928 0.014 | 0.928 0.014 |
| 0.2 | 2 | 0.938 0.009 | 0.966 0.004 | 0.966 0.004 |
| 0.2 | 3 | 0.960 0.008 | 0.971 0.004 | 0.971 0.004 |
| 0.2 | 4 | 0.965 0.006 | 0.977 0.003 | 0.977 0.003 |
| 0.2 | 5 | 0.978 0.002 | 0.979 0.002 | 0.979 0.002 |
| 0.2 | 6 | 0.982 0.003 | 0.982 0.002 | 0.982 0.002 |
| Setting | Values | Status |
|---|---|---|
| Random splits | ; labels per class, validation, test nodes | fixed |
| Laplacian | of ; componentwise source , | fixed |
| Fractional order | (Tables 6 , 7 ); grid (Table 14 , Section 6.3 ) | fixed / selected |
| Diffusion time | with the exact eigendecomposition (Cora, CiteSeer); with the Chebyshev expansion (PubMed) | selected per split and order |
| Chebyshev degree | ; relative error below at , | fixed |
| Refined graph | cosine -NN of the GAT embeddings, clipped at , symmetrized by the maximum; | fixed |
| Labels | GraphHeat | Pipeline | |||||
|---|---|---|---|---|---|---|---|
| per class | GAT | tuned | Holm | vs. | |||
| 1 | |||||||
| 2 | |||||||
| 3 | |||||||
| 4 | |||||||
| 5 | |||||||
| Dataset | Labels/class | GAT | Classical ( ) | Fractional ( ) | vs. |
|---|---|---|---|---|---|
| CiteSeer | 1 | ||||
| CiteSeer | 2 | ||||
| CiteSeer | 3 | ||||
| CiteSeer | 4 | ||||
| CiteSeer | 5 | ||||
| PubMed | 1 |
| Dataset | Published | Our reproduction | Difference | ||
|---|---|---|---|---|---|
| Cora | |||||
| CiteSeer |
| Retained fraction of | Mean neighbours | Median | Maximum | |
|---|---|---|---|---|
| Labels/class | GraphHeat ( ) | Tuned exponent | (95% CI) | Holm |
|---|---|---|---|---|
| 1 | ||||
| 2 | ||||
| 3 | ||||
| 4 | ||||
| 5 |
| Tuned on validation |
|---|
| Dataset | Convention | ||||||
|---|---|---|---|---|---|---|---|
| Cora | |||||||
| Cora | |||||||
| CiteSeer | |||||||
| CiteSeer | |||||||
| PubMed | |||||||
| PubMed |
| Single pass | vs. | Self- training | vs. single pass | Splits with promotion | Promoted nodes | / share | |
|---|---|---|---|---|---|---|---|
| / | |||||||
| / | |||||||
| / | |||||||
| / | |||||||
| / |
| Dataset | Homophily | GAT | Fractional ( ) | |
|---|---|---|---|---|
| Chameleon | ||||
| Squirrel | ||||
| Texas | ||||
| Wisconsin |
| Method | 0% | 5% | 10% | 20% | 40% |
|---|---|---|---|---|---|
| GAT baseline | 70.6 2.7 | 66.9 3.1 | 66.9 2.0 | 58.1 2.9 | 48.3 4.5 |
| Label-FHK, original graph | 60.0 3.2 | 53.0 3.2 | 46.9 2.7 | 37.5 3.4 | 25.5 3.0 |
| Label-FHK, GAT-refined graph | 68.3 2.8 | 65.4 2.7 | 64.1 2.5 | 57.2 2.5 | 47.2 3.2 |
| Neural FHK++, original graph | 70.1 1.7 | 66.1 3.5 | 65.1 2.3 | 58.1 2.4 | 47.9 3.5 |
| Neural FHK++, GAT-refined graph | 69.0 2.2 | 67.5 2.2 | 65.3 1.9 | 58.1 2.8 | 49.1 3.3 |
| Neural FHK++, refined + residual | 68.0 2.5 | 64.9 2.8 | 64.5 2.0 | 56.2 3.2 | 47.0 3.8 |
| Method | Type | Total labels | Reported test accuracy |
|---|---|---|---|
| Classical graph-based methods | |||
| Label Propagation [ 3 ] | Classical | ||
| DeepWalk [ 48 ] | Classical | ||
| Manifold Regularization [ 29 ] | Classical | ||
| Graph neural networks | |||
| GCN [ 26 ] | GNN | ||
| Dataset | label/class | labels/class | labels/class | labels/class | labels/class |
|---|---|---|---|---|---|
| Cora | |||||
| CiteSeer | |||||
| PubMed |