cs.CLFeb 28, 2026

Evaluating Progress in Graph Foundation Models: A Comprehensive Benchmark and New Insights

Authors: Xingtong Yu, Shenghua Ye, Ruijuan Liang, Chang Zhou, Hong Cheng, Xinming Zhang, Yuan Fang

Organizations: The Chinese University of Hong Kong* China · Singapore Management University Singapore · University of Science and Technology of China China

Abstract

Graph foundation models (GFM) aim to acquire transferable knowledge by pre-training on diverse graphs, which can be adapted to various downstream tasks. However, domain shift in graphs is inherently two-dimensional: graphs differ not only in what they describe (topic domains) but also in how they are represented (format domains). Most existing GFM benchmarks vary only topic domains, thereby obscuring how knowledge transfers across both dimensions. We present a new benchmark that jointly evaluates topic and format gaps across the full GFM pipeline, including multi-domain self-supervised pre-training and few-shot downstream adaptation, and provides a timely evaluation of recent GFMs in the rapidly evolving landscape. Our protocol enables controlled assessment in four settings: (i) pre-training on diverse topics and formats, while adapting to unseen downstream datasets; (ii) same pre-training as in (i), while adapting to seen datasets; (iii) pre-training on a single topic domain, while adapting to other topics; (iv) pre-training on a base format, while adapting to other formats. This two-axis evaluation disentangles semantic generalization from robustness to representational shifts. We conduct extensive evaluations of eight state-of-the-art GFMs on 33 datasets spanning seven topic domains and six format domains, surfacing new empirical observations and practical insights for future research. Codes/data are available at https://github.com/smufang/GFMBenchmark.

Figures & tables

Appendix figures & tables26 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. GFMate: Empowering Graph Foundation Models with Test-time Prompt Tuning

    May 14, 2026Yan Jiang, Ruihong Qiu, Zi HuangDomain AdaptationPrompt Tuning

  2. When Do Graph Foundation Models Transfer? A Data-Centric Theory

    May 28, 2026Jiajun Zhu, Ying Chen, Peihao Wang +4Graph Representation LearningCross-Domain Transfer Learning

  3. Surprisingly Simple and Effective Multi-Domain Graph Foundation Model through Graph-to-Table Alignment

    Jul 13, 2026Chunyu Hu, Tianyin Liao, Ge Lan +4Tabular Foundation ModelsGraph Representation Learning