Federated learning over graph-structured data exposes a fundamental mismatch between standard aggregation mechanisms and the operator nature of graph neural networks (GNNs). While federated optimization treats model parameters as elements of a shared Euclidean space, GNN parameters induce graph-dependent message-passing operators whose semantics depend on underlying topology. Under structurally and distributionally heterogeneous client graph distributions, local updates correspond to perturbations of distinct operator manifolds. Linear aggregation of such updates mixes geometrically incompatible directions, producing global models that converge numerically yet exhibit degraded relational behavior. We formalize this phenomenon as a geometric failure of global aggregation in cross-domain federated GNNs, characterized by destructive interference between operator perturbations and loss of coherence in message-passing dynamics. This degradation is not captured by conventional metrics such as loss or accuracy, as models may retain predictive performance while losing structural sensitivity. To address this, we propose GGRS (Global Geometric Reference Structure), a server-side aggregation framework operating on a data-free proxy of operator perturbations. GGRS enforces geometric admissibility via directional alignment, subspace compatibility, and sensitivity control, preserving the structure of the induced message-passing operator.
Figures & tables
Figure 1: Geometric failure modes in federated GNN aggregation. Federated aggregation can degrade the graph-structured geometry of the learned message-passing operator θ through five interconnected failure mechanisms, from parameter misinterpretation to numerical convergence masking operator-level incoherence.
Dataset
Domain
∣V∣
d
C
dˉ
Cora
Citation
2,708
1,433
7
3.9
CiteSeer
Citation
3,327
3,703
6
2.7
PubMed
Citation
19,717
500
3
4.5
Amazon-Comp.
CoPurchase
13,752
767
10
71.5
Amazon-Photo
CoPurchase
7,650
745
8
62.3
Coauthor-CS
CoAuthor
18,333
6,805
15
8.9
Table 1: Dataset statistics.
Arch
Method
Acc ↑
Γ↑
PA ↑
CDA ↑
σacc↓
Conv 70
GCN-2
FedAvg
0.7584
0.1798
− 0.0128
− 0.0002
0.041
126
FedSGD
0.7485
0.1969
− 0.0026
− 0.0001
0.046
135
FedProx
0.7596
0.1805
− 0.0134
− 0.0003
0.039
124
SCAFFOLD
0.7638
0.2297
+ 0.0771
− 0.0001
0.036
119
FedAvg+GGRS †
0.7776
0.2138
+ 0.0093
+ 0.0010
0.034
110
FedSGD+GGRS †
0.7941
0.2479
+ 0.0244
+ 0.0019
0.032
104
Table 2: Main benchmark results ( α=0.3 , K=12 , T=200 , 5 seeds). Steady-state metrics, rounds 181–200. † : GGRS server wrapper. GCN-2 GGRS rows and all GraphSAGE rows are simulation-based estimates ( Est. ) pending full experimental runs.
Federated graph learning (FGL) is a natural paradigm for social-media user graphs, where language communities, regional markets, and service boundaries can prevent raw graph pooling. We use the Twitch Gamers networks as the primary live-streaming social-media benchmark, and study a question that is often hidden by representation-level evaluation: after local message passing, what update signals are actually exposed to server aggregation? Through update-space measurements, we identify an aggregation-level failure in which graph-domain clients gradually place salient update signals on less shared parameter coordinates, while message-passing backbones show weaker cross-domain directional compatibility than an MLP control. This update-support fragmentation means that standard averaging can dilute locally important coordinates even when no raw graph data are exchanged. Across five backbones, homophily remains relevant but is not the dominant correlate of support retention; feature, label, and degree discrepancies show stronger associations. These findings indicate that graph-domain shifts damage not only local representations, but also the coordinate support on which aggregation operates. Motivated by this diagnosis, we propose FedIA, a plug-and-play server-side importance-aware aggregation method. Importance Masking selects a shared high-magnitude coordinate support, and Contribution-Aware Momentum Weighting smooths client contributions within that support. FedIA requires no raw graph sharing, no graph-statistics upload, and no auxiliary communication payload, while adding only O(D+N) persistent server state for D model coordinates and N clients.
Zhanting Zhou, Zeyu Ma, Ziqiang Zheng +1
University of Electronic Science and Technology of China, No. 2006, Xiyuan Ave, West Hi-Tech Zone, Chengdu, Sichuan 611731, China
Federated learning lets multiple participants train a shared model without pooling raw data, by exchanging locally trained model updates instead. Federated averaging assumes that averaging local models is a reasonable way to solve one shared problem when participants' data are broadly similar. Work on non-IID federated learning has shown that this assumption can withstand differences in label and feature distributions. We ask whether it survives a different strain specific to graph neural networks, where client graphs differ not in label or feature distribution but in structure itself, requiring the same shared weights to operate over fundamentally different topologies. We call the resulting harm structural negative transfer. In a federation of real citation networks and synthetic structural proxies, a structurally atypical client lost more than half its achievable accuracy simply by joining. In an initial six-client federation, two label-free structural statistics computable before training were strongly associated with this harm. Expanding to twenty clients showed that degree divergence remained associated with harm, although more weakly, and survived removal of domain contrast. Spectral divergence did not replicate, which we trace to a confound caused by the composition of the reference pool used for leave-one-out statistics. A causal intervention isolating topology found no significant effect. A degree-normalization mechanism held across twenty-four seeds but did not explain the harm when corrected. The best of five candidate fixes beat a tuned baseline only until a matched, structurally blind control was applied, after which the gain disappeared. What survives is a modest, partially replicated, degree-specific signal that is not yet a validated predictor at scale.
Graph Federated Learning (GFL) enables collaborative representation learning across distributed subgraphs while preserving privacy. However, heterogeneity remains a critical challenge, as subgraphs across clients typically differ significantly in both semantics and structures. Existing methods address heterogeneity by enforcing the rigid alignment of model parameters or prototypes between clients and the server. However, these alignments implicitly rely on a restrictive global linearity assumption that summarizes local data distributions using a single and globally consistent representation space. This severely compresses the personalized representation space of clients and fails to preserve diverse local graph distributions. To overcome these limitations, we propose Federated Graph Manifold Calibration (FedGMC), a novel paradigm that tackles semantic heterogeneity and structural heterogeneity from a unified manifold perspective. Instead of enforcing rigid alignment, FedGMC introduces a dual manifold calibration mechanism that preserves global commonalities while maximizing the personalized representation space of local clients. Specifically, for semantic heterogeneity, the server constructs a geometrically optimal semantic manifold via equidistant semantic anchors, so as to guide the calibration of local semantic manifolds. For structural heterogeneity, the server constructs a global structural manifold by building global structural templates, so as to guide the calibration of local structural manifolds. Finally, the server dynamically refines both global semantic manifolds and structural manifolds by aggregating local manifolds. Extensive experiments on eleven homophilic and heterophilic graphs demonstrate that FedGMC effectively balances global commonality and local personalization, thereby significantly outperforming state-of-the-art baseline methods.
Wentao Yu, Bo Han, Jie Yang +1
School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing, China · Department of Computer Science Hong Kong Baptist University Hong Kong, China · School of Automation and Intelligent Sensing Shanghai Jiao Tong University Shanghai, China