Bridging the Topological Divide: Dual-Branch Graph Distillation with Semantic Priors for Robust Cold-Start Recommendation
Organizations: The Hong Kong University of Science and Technology (Guangzhou)
Abstract
Graph Collaborative Filtering models have achieved remarkable success in recommendation systems. However, they inherently suffer from a catastrophic representation collapse in strict cold-start scenarios due to the topological isolation of unobserved items. While integrating multi-modal semantic features offers a potential remedy, directly mapping isolated semantic attributes into a globally topology-driven collaborative space frequently precipitates representation degradation and optimization conflicts. To bridge this fundamental structural divide, we propose DualGCN, an innovative Dual-Branch Graph Knowledge Distillation Framework. Operating under a decoupled two-stage training paradigm, DualGCN first constructs a robust collaborative teacher network where item representations are anchored by a topology-smoothed semantic prior, effectively reshaping the latent manifold. Subsequently, a semantic student branch employs a residual mapping mechanism and a magnitude-agnostic cosine distillation objective to achieve high-fidelity cross-modal alignment without disrupting established collaborative signals. Furthermore, we introduce a dynamic norm reconstruction mechanism to rigorously calibrate the physical scales of novel and warm items during global retrieval. Extensive experiments across three real-world benchmark datasets demonstrate that DualGCN significantly outperforms state-of-the-art baselines in strict cold-start scenarios while comprehensively preserving recommendation accuracy for highly active items.
Figures & tables
| Method | Recall@20 | NDCG@20 | ||||
|---|---|---|---|---|---|---|
| Warm | Cold | Warm | Cold | |||
| NGCF | 0.0736 | 0.0021 | -97.1% | 0.0463 | 0.0009 | -98.1% |
| LightGCN | 0.1244 | 0.0027 | -97.8% | 0.0791 | 0.0013 | -98.4% |
| NGCF-Semantic | 0.0753 | 0.0948 | +25.9% | 0.0459 | 0.0515 | +12.2% |
| LightGCN-Semantic | 0.1141 | 0.0515 | -54.9% | 0.0717 | 0.0270 | -62.3% |
| Dataset | #Users | #Items | #Interactions | Density |
|---|---|---|---|---|
| Amazon-Books | 144,032 | 116,665 | 2,754,236 | 0.00016 |
| Amazon-Electronics | 358,354 | 125,761 | 4,883,752 | 0.00011 |
| Amazon-Sports | 25,640 | 17,543 | 313,993 | 0.00070 |
| Method | Books | Electronics | Sports | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| R@20 | R@50 | N@20 | N@50 | R@20 | R@50 | N@20 | N@50 | R@20 | R@50 | N@20 | N@50 | |
| Warm-Start | ||||||||||||
| MetaEmbedding | 0.0631 | 0.1028 | 0.0402 | 0.0521 | 0.0098 | 0.0180 | 0.0051 | 0.0075 | 0.0187 | 0.0380 | 0.0097 | 0.0151 |
| DropoutNet | 0.0459 | 0.0819 | 0.0275 | 0.0382 | 0.0157 | 0.0292 | 0.0090 | 0.0128 | 0.0361 | 0.0707 | 0.0196 | 0.0291 |
| DeepMusic | 0.0275 | 0.0484 | 0.0158 | 0.0217 | 0.0108 | 0.0190 | 0.0063 | 0.0087 | 0.0210 | 0.0409 | 0.0111 | 0.0166 |
| MF | 0.0063 | 0.0132 | 0.0035 | 0.0056 | 0.0103 | 0.0186 | 0.0059 | 0.0084 | 0.0058 | 0.0105 | 0.0029 | 0.0042 |
| Architecture | Books | Electronics | Sports | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| R@20 | R@50 | N@20 | N@50 | R@20 | R@50 | N@20 | N@50 | R@20 | R@50 | N@20 | N@50 | |
| Part 1: Variants of Distillation Optimization | ||||||||||||
| Warm-Start | ||||||||||||
| DualGCN-MSE | 0.1264 | 0.2021 | 0.0795 | 0.1020 | 0.0456 | 0.0744 | 0.0279 | 0.0360 | 0.0716 | 0.1219 | 0.0424 | 0.0563 |
| DualGCN-InfoNCE | 0.1262 | 0.2051 | 0.0796 | 0.1022 | 0.0380 | 0.0622 | 0.0235 | 0.0304 | 0.0717 | 0.1232 | 0.0430 | 0.0571 |
| DualGCN (Default) | 0.1262 | 0.2016 | 0.0794 | 0.1018 | 0.0456 | 0.0743 | 0.0279 | 0.0360 | 0.0717 | 0.1210 | 0.0429 | 0.0565 |
Cold-Start Recommendation
Cold-start recommendation uses content, metadata, and transferred signals to recommend items or users with little interaction history.
See all 27 papers