From Subtle to Significant: Prompt-Driven Self-Improving Optimization in Test-Time Graph OOD Detection
Organizations: College of Artificial Intelligence, Dalian Maritime University · Computer Vision Center, Universitat Aut`onoma de Barcelona · School of Computing Technologies, RMIT University · College of Intelligence and Computing, Tianjin University
Abstract
Graph Out-of-Distribution (OOD) detection aims to identify whether a test graph deviates from the distribution of graphs observed during training, which is critical for ensuring the reliability of Graph Neural Networks (GNNs) when deployed in open-world scenarios. Recent advances in graph OOD detection have focused on test-time training techniques that facilitate OOD detection without accessing potential supervisory information (e.g., training data). However, most of these methods employ a one-pass inference paradigm, which prevents them from progressively correcting erroneous predictions to amplify OOD signals. To this end, we propose a Self-Improving Graph Out-of-Distribution detector (SIGOOD), which is an unsupervised framework that integrates continuous self-learning with test-time training for effective graph OOD detection. Specifically, SIGOOD generates a prompt to construct a prompt-enhanced graph that amplifies potential OOD signals. To optimize prompts, SIGOOD introduces an Energy Preference Optimization (EPO) loss, which leverages energy variations between the original test graph and the prompt-enhanced graph. By iteratively optimizing the prompt by involving it into the detection model in a self-improving loop, the resulting optimal prompt-enhanced graph is ultimately used for OOD detection. Comprehensive evaluations on 21 real-world datasets confirm the effectiveness and outperformance of our SIGOOD method. The code is at https://github.com/Ee1s/SIGOOD.
Figures & tables
| ID dataset | BZR | PTC-MR | AIDS | ENZYMES | Tox21 | FreeSolv | ClinTox | Esol | Avg. |
|---|---|---|---|---|---|---|---|---|---|
| OOD dataset | COX2 | MUTAG | DHFR | PROTEIN | SIDER | ToxCast | LIPO | MUV | Rank |
| PK-LOF | |||||||||
| PK-OCSVM | |||||||||
| PK-iF | |||||||||
| WL-LOF | |||||||||
| WL-OCSVM |
| Method | PK-OCSVM | PK-iF | WL-OCSVM | WL-iF | InfoGraph-iF | GraphCL-iF | GTrans | GOODAT | Ours | Improve |
|---|---|---|---|---|---|---|---|---|---|---|
| PROTEINS-full | ||||||||||
| ENZYMES | ||||||||||
| DHFR | ||||||||||
| BZR | ||||||||||
| COX2 | ||||||||||
| DD |