Temporal Memory-Aware Online Test-Time Adaptation on Dynamic Graphs
Organizations: Griffith University, Gold Coast, Australia · RMIT University, Melbourne, Australia
Abstract
Test-time adaptation (TTA) on graphs aims to adapt a graph neural network (GNN) that is well-trained on the training graph to the test graph, which involves potential distribution shifts that may harm model generalization and test-time inference. While recent efforts have investigated TTA on static graphs, there is still a research gap on dynamic graphs learned with dynamic GNN (DGNN) models, where both structural connectivity and node semantics evolve continuously over time. This makes adapting a DGNN model for reliable test-time performance substantially challenging. To fill this gap, in this work, we propose a novel framework of temporal memory-aware Online Test-Time Adaptation on Dynamic Graphs, named DGOTTA, to effectively adapt well-trained DGNNs during test time. Specifically, the proposed DGOTTA contains three modules: (1) temporal-aware augmentation, to extend the diversity of test dynamic graphs for addressing complex temporal and spatial shifts; (2) memory-aware model prediction, to alleviate catastrophic forgetting; (3) consistency-guided online adaptation, to enforce temporal alignment and memory smoothness. Extensive experiments on three real-world datasets and four DGNN backbones demonstrate that DGOTTA significantly improves generalization under diverse distribution shifts and multiple model architectures.
Figures & tables
| Dataset | Domain | # Nodes | Total Edges | Unique Edges | Unique Steps | Time Granularity | Duration |
|---|---|---|---|---|---|---|---|
| Wikipedia | Social | 9,227 | 157,474 | 18,257 | 152,757 | Unix timestamp | 1 month |
| Social | 10,984 | 672,447 | 78,516 | 669,065 | Unix timestamp | 1 month | |
| MOOC | Interaction | 7,144 | 411,749 | 178,443 | 345,600 | Unix timestamp | 17 months |
| Methods | Wikipedia | MOOC | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GMixer | DyGF | TGN | TGAT | GMixer | DyGF | TGN | TGAT | GMixer | DyGF | TGN | TGAT | |
| ERM | 0.5018 | 0.7311 | 0.5855 | 0.5397 | 0.5037 | 0.5254 | 0.5272 | 0.5566 | 0.5064 | 0.5224 | 0.5666 | 0.5824 |
| DDGCL [ 50 ] | 0.4646 | 0.4168 | 0.5181 | 0.4677 | 0.4833 | 0.5043 | 0.5048 | 0.4913 | 0.5708 | 0.5250 | 0.5354 | 0.5166 |
| IDOL [ 51 ] | 0.5335 | 0.5016 | 0.4379 | 0.5306 | 0.5112 | 0.5083 | 0.5420 | 0.5133 | 0.5738 | 0.4930 | 0.4932 | 0.4973 |
| TENT [ 17 ] | 0.5140 | 0.5055 | 0.5175 | 0.4999 | 0.5014 | 0.4999 | 0.5002 | 0.5011 | 0.4999 | 0.5002 | 0.5032 | 0.4999 |
| GTrans [ 31 ] | 0.5175 | 0.7731 | 0.5005 | 0.4986 | OOM | 0.4560 | OOM | OOM | OOM | 0.4884 | 0.5140 | OOM |
| Variants | Wikipedia | MOOC | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GMixer | DyGF | TGN | TGAT | GMixer | DyGF | TGN | TGAT | GMixer | DyGF | TGN | TGAT | |
| DGOTTA -base | 0.5009 | 0.6008 | 0.5009 | 0.5197 | 0.5012 | 0.5302 | 0.5212 | 0.5499 | 0.5005 | 0.5008 | 0.5003 | 0.5233 |
| +TC Loss | 0.5043 | 0.5976 | 0.5239 | 0.5105 | 0.5025 | 0.5289 | 0.5267 | 0.5149 | 0.5018 | 0.5185 | 0.5021 | 0.5338 |
| +MBPL | 0.4943 | 0.7658 | 0.5232 | 0.5097 | 0.5031 | 0.5287 | 0.5267 | 0.5350 | 0.5030 | 0.5069 | 0.5099 | 0.5384 |
| +TAA | 0.5442 | 0.7471 | 0.5950 | 0.5362 | 0.5520 | 0.5308 | 0.5565 | 0.5535 | 0.5472 | 0.5077 | 0.5131 | 0.5158 |
| +DAEMA | 0.5708 | 0.6998 | 0.6186 | 0.5507 | 0.5730 | 0.5339 | 0.5729 | 0.5518 | 0.5651 | 0.5081 | 0.5083 | 0.5445 |