Low-pass Personalized Subgraph Federated Recommendation
Organizations: Department of Artificial Intelligence, Sungkyunkwan University, Suwon, Republic of Korea
Abstract
Federated Recommender Systems (FRS) preserve privacy by training decentralized models on client-specific user-item subgraphs without sharing raw data. However, FRS faces a unique challenge: subgraph structural imbalance, where drastic variations in subgraph scale (user/item counts) and connectivity (item degree) misalign client representations, making it challenging to train a robust model that respects each client's unique structural characteristics. To address this, we propose a Low-pass Personalized Subgraph Federated recommender system (LPSFed). LPSFed leverages graph Fourier transforms and low-pass spectral filtering to extract low-frequency structural signals that remain stable across subgraphs of varying size and degree, allowing robust personalized parameter updates guided by similarity to a neutral structural anchor. Additionally, we leverage a localized popularity bias-aware margin that captures item-degree imbalance within each subgraph and incorporates it into a personalized bias correction term to mitigate recommendation bias. Supported by theoretical analysis and validated on five real-world datasets, LPSFed achieves superior recommendation accuracy and enhances model robustness.
Figures & tables
| Dataset | Amazon-Book | Gowalla | Movielens-1M | Yelp2018 | Tmall-Buy | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| Model | Recall | NDCG | Recall | NDCG | Recall | NDCG | Recall | NDCG | Recall | NDCG |
| FedAvg | 0.0642 | 0.0312 | 0.1425 | 0.0660 | 0.2454 | 0.1240 | 0.0721 | 0.0292 | 0.0317 | 0.0164 |
| FedPUB | 0.0633 | 0.0322 | 0.1433 | 0.0667 | 0.2558 | 0.1209 | 0.0684 | 0.0296 | 0.0333 | 0.0180 |
| FedMF | 0.0153 | 0.0072 | 0.0765 | 0.0409 | 0.1679 | 0.0906 | 0.0318 | 0.0150 | 0.0122 | 0.0063 |
| F2MF | 0.0451 | 0.0225 | 0.0961 | 0.0565 | 0.1788 | 0.1120 | 0.0510 | 0.0247 | 0.0207 | 0.0132 |
| PFedRec | 0.0713 | 0.0242 | 0.1371 | 0.0478 | 0.1508 | 0.0997 | 0.0750 | 0.0225 | 0.0323 | 0.0170 |
| Group | Large-Dense | Medium-Balanced | Small-Sparse | Overall | ||||
|---|---|---|---|---|---|---|---|---|
| Model | Recall | NDCG | Recall | NDCG | Recall | NDCG | Recall | NDCG |
| FedAvg | 0.0620 | 0.0280 | 0.0411 | 0.0208 | 0.0275 | 0.0117 | 0.0334 | 0.0152 |
| FedPUB | 0.0605 | 0.0355 | 0.0528 | 0.0267 | 0.0300 | 0.0123 | 0.0381 | 0.0177 |
| FedMF | 0.0176 | 0.0094 | 0.0127 | 0.0056 | 0.0058 | 0.0027 | 0.0084 | 0.0039 |
| F2MF | 0.0402 | 0.0231 | 0.0341 | 0.0174 | 0.0225 | 0.0085 | 0.0268 | 0.0118 |
| PFedRec | 0.0619 | 0.0250 | 0.0525 | 0.0185 | 0.0310 | 0.0131 | 0.0388 | 0.0153 |
| Data Setting | Balanced Dataset [NDCG@20] | Imbalanced Dataset [NDCG@20] | ||||||
|---|---|---|---|---|---|---|---|---|
| Model | Tail | Mid | Head | Overall | Tail | Mid | Head | Overall |
| FedAvg | 0.0017 | 0.0077 | 0.0570 | 0.0264 | 0.0040 | 0.0108 | 0.0924 | 0.0312 |
| FedPUB | 0.0024 41 | 0.008 16 | 0.0620 9 | 0.0279 6 | 0.0064 60 | 0.0130 20 | 0.0998 8 | 0.0322 3 |
| FedMF | 0.0002 88 | 0.0009 88 | 0.0130 77 | 0.0074 72 | 0.0003 92 | 0.0013 88 | 0.0140 85 | 0.0072 77 |
| F2MF | 0.0037 118 | 0.0112 45 | 0.0438 23 | 0.0225 15 | 0.0050 25 | 0.0119 10 | 0.0436 53 | 0.0225 28 |
| PFedRec | 0.0055 224 | 0.0125 62 | 0.0277 51 | 0.0244 8 | 0.0068 70 | 0.0145 34 | 0.0262 72 | 0.0242 22 |
| Dataset | Amazon-Book | Gowalla | Movielens-1M | Yelp2018 | Tmall-Buy | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| Model | Recall | NDCG | Recall | NDCG | Recall | NDCG | Recall | NDCG | Recall | NDCG |
| w/o LGCN | 0.0388 | 0.0216 | 0.0965 | 0.0427 | 0.1622 | 0.0893 | 0.0471 | 0.0207 | 0.0256 | 0.0121 |
| w/o bias-aware | 0.0643 | 0.0322 | 0.1529 | 0.0711 | 0.2604 | 0.1281 | 0.0769 | 0.0301 | 0.0362 | 0.0186 |
| w/o per | 0.0652 | 0.0368 | 0.1576 | 0.0788 | 0.2625 | 0.1299 | 0.0775 | 0.0315 | 0.0370 | 0.0190 |
| w/o per & bias-aware | 0.0642 | 0.0312 | 0.1425 | 0.0660 | 0.2454 | 0.1240 | 0.0712 | 0.0292 | 0.0317 | 0.0164 |
| w/o statistics for | 0.0714 | 0.0403 | 0.1581 | 0.0856 | 0.2625 | 0.1330 | 0.0764 | 0.0372 | 0.0393 | 0.0199 |
| Symbol | Description |
|---|---|
| General Notations | |
| The total number of clients | |
| An index for a specific client, | |
| A user and an item, respectively | |
| The sets of all users and items in a given graph | |
| The number of users and items in a given graph | |
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Movielens-1M | Gowalla | Yelp2018 | Amazon-Book | Tmall-Buy |
|---|---|---|---|---|---|
| Number of Users | 6,040 | 29,858 | 31,668 | 52,643 | 885,759 |
| Number of Items | 3,900 | 40,981 | 38,048 | 91,599 | 1,144,124 |
| Number of Interactions | 1,000,290 | 1,027,370 | 1,561,406 | 2,984,108 | 7,592,214 |
| Density | 5.431% | 0.084% | 0.130% | 0.062% | 0.010% |
| Method | Ego-graph | Random-Const. | Interconnected-Const. | Spectral-Clust. |
|---|---|---|---|---|
| Avg. Subgraph Size | ||||
| Size variance | ||||
| Avg. Degree | ||||
| Degree Variance | ||||
| Avg. Density | ||||
| Spectral Entropy |
| Anchor Design | Amazon-Book | Gowalla | ML-1M | Yelp2018 | Tmall-Buy |
|---|---|---|---|---|---|
| ER | 0.0734 | 0.1599 | 0.2631 | 0.0767 | 0.0410 |
| GNMK | 0.0738 | 0.1621 | 0.2646 | 0.0783 | 0.0419 |
| w/o statistics for (GNMK) | 0.0714 | 0.1581 | 0.2625 | 0.0764 | 0.0393 |
| Model | Time/Epoch | #Epoch | Training Time | Memory Usage |
| FedAvg | 20s | 90 | 30m | 6.2GB |
| FedPUB | 25s | 90 | 37m | 10.2GB |
| FedMF | 23m 48s | 150 | 59h 30m | 6.2GB |
| F2MF | 39m 12s | 100 | 65h 20m | 6.4GB |
| PFedRec | 38m 47s | 135 | 87h 16m | 1.4GB |
| FedRAP | 73m 29s | 160 | 195h 56m | 1.6GB |
| Iteration | 20 | 40 | 60 | 80 | 100 |
|---|---|---|---|---|---|
| = 0.0 | 0.0482 | 0.0497 | 0.0536 | 0.0568 | 0.0600 |
| = 0.3 | 0.0478 | 0.0490 | 0.0529 | 0.0554 | 0.0592 |
| = 0.5 | 0.0477 | 0.0489 | 0.0522 | 0.0544 | 0.0576 |
| = 0.7 | 0.0476 | 0.0486 | 0.0512 | 0.0541 | 0.0570 |
| = 1.0 | 0.0474 | 0.0478 | 0.0501 | 0.0522 | 0.0553 |
| Cut-off Frequency | 2 | 4 | 6 | 8 |
|---|---|---|---|---|
| Recall@20 | 0.2556 | 0.2614 | 0.2615 | 0.2622 |
| Eigengap | ||||
| Pearson Correlation (Recall ) | 0.5004 | |||
| # of Clients | 4 | 10 | 20 | |||
|---|---|---|---|---|---|---|
| Model | Recall | NDCG | Recall | NDCG | Recall | NDCG |
| FedAvg | 0.0642 | 0.0312 | 0.0395 | 0.0186 | 0.0220 | 0.0098 |
| FedPUB | 0.0633 | 0.0322 | 0.0417 | 0.0180 | 0.0232 | 0.0102 |
| FedMF | 0.0153 | 0.0072 | 0.0091 | 0.0058 | 0.0033 | 0.0035 |
| F2MF | 0.0451 | 0.0225 | 0.0325 | 0.0182 | 0.0158 | 0.0078 |
| PFedRec | 0 .0713 | 0.0242 | 0.0406 | 0.0169 | 0.0236 | 0.0100 |