Federated Community Detection in Bipartite Networks
Organizations: Department of Statistics and Data Science, National University of Singapore
Abstract
We study federated spectral estimation when a large matrix is horizontally partitioned across servers that cannot share raw data. We propose FLICKER, a target-specific gradient-based power iteration that recovers a singular direction associated with a prescribed spectral target using only matrix-vector products on local blocks. Different target directions can be recovered independently and in parallel. We establish non-asymptotic convergence guarantees and provide a recursive grid-search procedure for spectral target selection. Building on FLICKER, we develop BiFLICKER for federated community detection in bipartite networks, together with a sequential projected variant for nearby or repeated singular directions. Under a sparse bipartite stochastic block model, we show that properly rescaled leading singular values from a reference server provide valid global targets, and that Sequential BiFLICKER achieves a vanishing misclustering rate and exact recovery under stronger sparsity conditions. Simulations show that BiFLICKER remains close to centralized spectral clustering and is more robust than existing federated spectral baselines when local sample sizes are small. On a LastFM user-artist network naturally partitioned by country, Sequential BiFLICKER attains an overall ARI of 0.94 against centralized clustering while revealing cross-country communities with distinct listening profiles.
Figures & tables
| US | UK | Poland | Germany | Finland | Norway | Canada | |
| Users | 216 | 121 | 46 | 36 | 31 | 31 | 30 |
| Mean user degree | 575 | 636 | 487 | 560 | 405 | 493 | 569 |
| Density | 6.7% | 7.4% | 5.6% | 6.5% | 4.7% | 5.7% | 6.6% |
| Community | Users | Main countries | Representative artists |
|---|---|---|---|
| C1 | 224 | US 43.8%; UK 21.4% | Architecture in Helsinki; Rilo Kiley; Aerosmith |
| C2 | 73 | US 43.8%; UK 30.1% | The Rakes; The Futureheads; Art Brut |
| C3 | 68 | US 29.4%; Finland 25.0% | Pantera; Disturbed; Rammstein |
| C4 | 62 | US 67.7%; Norway 8.1% | T.I.; Ludacris; Usher |
| C5 | 35 | UK 51.4%; US 28.6% | Dexys Midnight Runners; Dusty Springfield; Rod Stewart |
| C6 | 33 | UK 36.4%; Poland 30.3% | The Cinematic Orchestra; Nightmares on Wax; Bonobo |
| Component | Target | Centralized | Sequential BiFLICKER | Relative difference |
|---|---|---|---|---|
| 1 | 269.875 | 250.991 | 250.991 | |
| 2 | 102.865 | 96.448 | 96.311 | |
| 3 | 92.053 | 82.502 | 81.894 | |
| 4 | 77.837 | 76.594 | 74.262 | |
| 5 | 75.150 | 70.858 | 72.939 | |
| 6 | 71.256 | 62.878 | 63.706 |
| Community | Users | Representative artists | Coverage |
|---|---|---|---|
| C1 | 224 | Architecture In Helsinki; Rilo Kiley; Aerosmith; Incubus; Mgmt | 71.9% |
| C2 | 73 | The Rakes; The Futureheads; Art Brut; The Go! Team; Maxïmo Park | 97.3% |
| C3 | 68 | Pantera; Disturbed; Type O Negative; Rammstein; Megadeth | 98.5% |
| C4 | 62 | T.I.; Ludacris; Usher; Jay-Z; Gym Class Heroes | 98.4% |
| C5 | 35 | Dexys Midnight Runners; Dusty Springfield; Rod Stewart; The Pretenders; Squeeze | 100.0% |
| C6 | 33 | The Cinematic Orchestra; Nightmares On Wax; Tosca; Bonobo; Kosheen | 100.0% |
| Dataset | 1 | 2 | 3 | 4 | 5 |
|---|---|---|---|---|---|
| 75 | 101 | 494 | 1275 | 249 | |
| 3129 | 3129 | 3129 | 3129 | 3129 | |
| Average # of Movies Rated | 774 | 364 | 204 | 95 | 37 |
| User Community | 1 | 2 | 3 | 4 | 5 | 6 | Total |
| Dataset 1 | 25 (33.3%) | 6 (8.0%) | 10 (13.3%) | 6 (8.0%) | 17 (22.7%) | 10 (13.3%) | 75 |
| Dataset 2 | 35 (34.7%) | 14 (13.9%) | 18 (17.8%) | 8 (7.9%) | 14 (13.9%) | 11 (10.9%) | 101 |
| Dataset 3 | 179 (36.2%) | 77 (15.6%) | 85 (17.2%) | 62 (12.6%) | 52 (10.5%) | 38 (7.7%) | 494 |
| Dataset 4 | 681 (53.4%) | 182 (14.3%) | 116 (9.1%) | 114 (8.9%) | 100 (7.8%) | 81 (6.4%) | 1275 |
| Dataset 5 | 217 (87.1%) | 11 (4.4%) | 4 (1.6%) | 5 (2.0%) | 2 (0.8%) | 9 (3.6%) | 249 |
| Community Size | 1142 (52.1%) | 290 (13.2%) | 233 (10.6%) | 195 (8.9%) | 185 (8.4%) | 149 (6.8%) | 2194 |
Graph Clustering
Graph clustering groups network nodes by connectivity, attributes, or shared roles to reveal communities and other mesoscale structure.
See all 78 papers