Evaluating Progress in Graph Foundation Models: A Comprehensive Benchmark and New Insights
Organizations: The Chinese University of Hong Kong* China · Singapore Management University Singapore · University of Science and Technology of China China
Abstract
Graph foundation models (GFM) aim to acquire transferable knowledge by pre-training on diverse graphs, which can be adapted to various downstream tasks. However, domain shift in graphs is inherently two-dimensional: graphs differ not only in what they describe (topic domains) but also in how they are represented (format domains). Most existing GFM benchmarks vary only topic domains, thereby obscuring how knowledge transfers across both dimensions. We present a new benchmark that jointly evaluates topic and format gaps across the full GFM pipeline, including multi-domain self-supervised pre-training and few-shot downstream adaptation, and provides a timely evaluation of recent GFMs in the rapidly evolving landscape. Our protocol enables controlled assessment in four settings: (i) pre-training on diverse topics and formats, while adapting to unseen downstream datasets; (ii) same pre-training as in (i), while adapting to seen datasets; (iii) pre-training on a single topic domain, while adapting to other topics; (iv) pre-training on a base format, while adapting to other formats. This two-axis evaluation disentangles semantic generalization from robustness to representational shifts. We conduct extensive evaluations of eight state-of-the-art GFMs on 33 datasets spanning seven topic domains and six format domains, surfacing new empirical observations and practical insights for future research. Codes/data are available at https://github.com/smufang/GFMBenchmark.
Figures & tables
| Methods | Labeled source | Alignment | PLM/LLM | Adaptation | |||||
| Structure | Feature | Codebook | Graph mod. | Feature mod. | Textual | ||||
| Benchmarked graph foundation models | |||||||||
| GCOPE ( Zhao et al., 2024a ) | F, P | ||||||||
| MDGPT ( Yu et al., 2024b ) | P | ||||||||
| MDGFM ( Wang et al., 2025 ) | P | ||||||||
| SAMGPT ( Yu et al., 2025a ) | P | ||||||||
| Topic | Datasets | # Graphs | Avg. # nodes | Avg. # edges | Format | Used for pre-train | Task | ||||||
| Heterogeneous | Homophily ratio | Relational | Dynamic | Textual | NC | EC | GC | ||||||
| Citation | Cora ( Liu et al., 2024a ) | 1 | 2,708 | 10,556 | 0.81 | ||||||||
| Pubmed ( Liu et al., 2024a ) | 1 | 19,717 | 44,338 | 0.80 | |||||||||
| ogbn-arxiv ( Hu et al., 2020b ) | 1 | 169,343 | 1,166,243 | 0.66 | |||||||||
| ogbn-mag ( Hu et al., 2020b ) | 1 | 1,939,743 | 21,111,007 | 0.30 | |||||||||
| ACM ( Tang et al., 2024b ) | 1 | 10,942 | 547,872 | 0.88 | |||||||||
| Methods | Pubmed | ogbn-mag | Wikipedia | Actor | Chameleon | Products | T-Finance | DGraph | ogbn-proteins |
| GCN | 48.62 8.40 | 5.83 0.70 | 48.02 39.11 | 26.50 11.82 | 26.71 4.33 | 21.12 5.67 | 42.16 39.45 | 32.88 15.35 | 51.54 13.11 |
| GAT | 45.50 9.29 | 4.86 0.60 | 45.32 24.72 | 23.90 11.13 | 26.24 4.27 | 22.11 6.28 | 53.86 38.15 | 33.46 16.12 | 47.93 14.10 |
| GCOPE | 41.85 8.34 | 0.27 0.09 | 43.23 25.98 | 24.16 6.83 | 21.66 3.41 | OOT | 45.42 22.22 | OOT | 45.01 12.73 |
| MDGPT | 40.50 7.33 | 5.94 0.63 | 51.02 25.40 | 31.72 8.93 | 28.36 5.04 | 15.99 3.48 | 58.95 23.03 | 37.52 12.02 | 50.72 10.78 |
| MDGFM | 39.50 7.20 | 2.93 1.05 | 44.25 28.21 | 19.80 7.00 | 25.95 3.75 | 8.11 2.17 | 57.07 19.12 | 36.08 24.19 | 50.28 8.80 |
| SAMGPT | 49.23 8.07 | 5.32 0.68 | 56.50 27.26 | 27.09 7.73 | 28.65 5.12 | 22.68 4.03 | 58.28 15.86 | 39.42 13.36 | 52.25 11.97 |
| Methods | Edge classification | Graph classification | ||||||||
| DGraph | Wiki | WN18RR | PCBA | BZR | ||||||
| Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | |
| GCN | 10.13 3.16 | 6.50 0.99 | 9.35 3.01 | 3.21 0.19 | 15.45 11.60 | 10.85 4.39 | 55.09 31.92 | 32.54 15.72 | 52.73 16.49 | 44.72 10.30 |
| GAT | 9.55 3.56 | 6.16 1.05 | 2.65 0.62 | 1.71 0.15 | 10.60 14.10 | 7.91 3.93 | 56.65 28.70 | 33.97 13.34 | 52.36 17.69 | 43.63 10.93 |
| GCOPE | OOT | OOT | OOT | OOT | 16.59 7.25 | 11.42 3.29 | 48.99 38.52 | 28.19 19.08 | 54.31 19.35 | 45.89 12.33 |
| MDGPT | 9.92 2.38 | 6.85 0.95 | 10.72 3.67 | 2.79 0.21 | 13.16 4.71 | 10.08 2.01 | 55.54 21.39 | 34.57 9.90 | 53.88 13.74 | 47.26 9.46 |
| Methods | Cora | ACM | Wisconsin | Photo | Elliptic | |||||||
| Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | |
| GCN | 41.76 10.38 | 37.85 9.98 | 38.31 8.08 | 24.12 10.36 | 50.90 33.56 | 32.75 16.73 | 34.20 7.94 | 22.49 4.55 | 53.87 12.35 | 52.05 11.90 | 41.74 18.55 | 32.74 11.50 |
| GAT | 43.48 9.64 | 39.92 8.96 | 35.82 5.75 | 22.37 8.94 | 48.68 30.94 | 32.30 15.74 | 34.18 8.57 | 23.06 5.94 | 46.38 11.11 | 45.49 9.65 | 38.73 20.26 | 29.95 11.87 |
| DGI | 43.82 9.33 | 40.78 8.06 | 36.01 7.24 | 28.11 9.48 | 46.92 20.14 | 33.27 9.98 | 27.29 8.32 | 21.34 5.51 | 47.26 7.47 | 45.23 6.57 | 44.56 15.54 | 34.25 10.64 |
| GraphPrompt | 55.51 10.51 | 52.53 9.76 | 42.18 9.78 | 35.12 12.51 | 48.32 14.02 | 35.11 6.97 | 32.73 4.80 | 26.41 3.88 | 57.06 9.09 | 55.81 7.99 | 50.55 17.03 | 39.50 13.23 |
| HeCo | / | / | 80.85 12.79 | 80.25 13.63 | / | / | / | / | / | / | / | / |
| Methods | Edge classification | Graph classification | ||||||
| FB15K-237 | HIV | COX2 | PROTEINS | |||||
| Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | |
| GCN | 14.63 1.4 | 13.35 0.8 | 45.79 27.1 | 31.22 13.8 | 48.09 14.2 | 42.15 9.5 | 58.67 9.2 | 52.33 8.6 |
| GAT | 11.05 1.2 | 10.90 0.8 | 46.00 27.4 | 31.50 14.4 | 50.71 14.9 | 43.67 9.1 | 57.79 9.4 | 51.44 8.7 |
| DGI | 4.84 1.4 | 1.61 0.3 | 48.47 13.2 | 34.93 6.4 | 46.99 12.8 | 41.99 8.3 | 54.28 8.7 | 51.56 8.1 |
| GraphPrompt | 5.52 1.6 | 1.42 0.3 | 50.50 9.3 | 36.15 4.2 | 49.30 10.9 | 44.18 7.1 | 56.83 7.0 | 54.32 6.3 |
| Methods | Citation | Social & Web | E-commerce | Finance | Proteins | ||||
| Pubmed | ogbn-mag | Wikipedia | Actor | Chameleon | Products | T-Finance | DGraph | ogbn-proteins | |
| GCOPE | 37.93 5.54 | 0.26 0.03 | 52.79 27.79 | 23.16 7.74 | 21.82 3.43 | OOT | 33.94 20.92 | OOT | 47.70 13.36 |
| MDGPT | 47.93 10.33 | 4.64 0.58 | 51.80 29.13 | 27.84 10.71 | 27.26 4.97 | 18.98 5.42 | 59.88 23.85 | 36.79 12.12 | 51.07 10.98 |
| MDGFM | 35.62 6.59 | 1.21 1.24 | 50.67 28.53 | 18.19 5.80 | 23.24 3.59 | 3.07 0.90 | 49.22 21.44 | 41.96 28.01 | 49.78 8.57 |
| SAMGPT | 48.11 6.83 | 6.57 0.68 | 59.19 30.30 | 25.77 7.33 | 28.07 4.76 | 24.32 4.42 | 48.87 17.22 | 38.37 14.55 | 51.66 10.73 |
| G2P2 | 43.30 8.57 | - | 44.27 7.80 | 28.85 9.66 | - | - | 59.72 16.22 | 38.25 10.39 | - |
| Methods | Finance (Edge Classification) | Common sense (Edge Classification) | Molecule (Graph Classification) | |||||||
| DGraph | Wiki | WN18RR | PCBA | BZR | ||||||
| Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | |
| GCOPE | OOT | OOT | OOT | OOT | 16.05 6.72 | 11.76 3.33 | 61.25 24.71 | 36.57 10.62 | 57.37 19.40 | 47.43 11.66 |
| MDGPT | 9.10 2.59 | 6.42 0.94 | 7.90 3.14 | 1.57 0.23 | 14.48 4.91 | 10.84 2.25 | 62.51 24.39 | 37.11 11.11 | 57.01 14.30 | 49.79 9.77 |
| MDGFM | 9.35 3.31 | 5.79 1.16 | 4.34 2.91 | 0.50 0.09 | 14.14 5.30 | 9.60 2.52 | 58.16 42.55 | 31.39 21.02 | 52.12 24.02 | 35.20 9.12 |
| SAMGPT | 10.82 3.14 | 6.97 1.04 | 11.59 3.03 | 3.52 0.16 | 13.64 5.11 | 10.03 1.91 | 59.51 24.76 | 35.91 10.89 | 59.29 15.52 | 50.81 10.13 |
| Methods | Heterogeneous | Heterophilic | Dynamic | Textual | ||||||||
| ogbn-mag | Chameleon | Actor | Wikipedia | Pubmed | Products | |||||||
| Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | |
| GCOPE | 0.32 0.04 | 0.11 0.01 | 22.46 2.93 | 19.99 3.38 | 20.66 8.01 | 16.05 4.58 | 58.69 29.29 | 36.89 14.91 | 39.06 7.55 | 35.09 8.07 | OOT | OOT |
| MDGPT | 6.01 0.81 | 4.42 0.37 | 27.90 5.13 | 25.06 5.03 | 27.23 8.64 | 22.22 5.09 | 54.17 22.13 | 35.72 10.71 | 45.80 10.14 | 45.10 10.47 | 21.23 4.96 | 11.50 1.88 |
| MDGFM | 0.92 0.54 | 0.56 0.41 | 21.50 3.12 | 17.54 4.00 | 20.20 7.73 | 13.83 3.12 | 50.66 29.90 | 32.51 14.61 | 34.51 5.84 | 28.24 4.55 | 3.92 2.17 | 1.78 0.47 |
| SAMGPT | 7.35 0.73 | 5.49 0.27 | 28.14 4.77 | 24.48 4.66 | 24.58 6.49 | 19.21 4.17 | 55.95 31.62 | 34.51 15.82 | 50.00 7.93 | 48.68 8.50 | 26.10 5.55 | 13.38 1.52 |
| Methods | Relational (Edge Classification) | Textual (Graph Classif.) | ||||
| Wiki | WN18RR | PCBA | ||||
| Acc | MacroF | Acc | MacroF | Acc | MacroF | |
| GCOPE | OOT | OOT | 17.76 6.44 | 12.87 3.03 | 50.93 34.41 | 30.23 16.26 |
| MDGPT | 10.07 3.05 | 2.75 0.18 | 14.71 6.07 | 10.55 2.46 | 55.25 24.41 | 34.04 11.43 |
| MDGFM | 3.85 2.53 | 0.37 0.09 | 13.77 5.17 | 9.93 2.07 | 51.68 48.73 | 26.37 24.37 |
| SAMGPT | 12.33 3.59 | 3.69 0.18 | 13.53 4.88 | 9.97 2.11 | 56.06 22.56 | 34.63 10.44 |
Appendix figures & tables26 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | raw_texts | relation_texts |
| Cora, ogbn-arxiv | Title: "Further facts…" Abstract: "Previous results…" / Title: "Spring embedders…" Abstract: "Force-directed…" | cites |
| ACM | author, term, subject, paper | cites, mentions, writes, belongs_to, … |
| DBLP | venue, author, term, paper | published_in, mentions, writes, … |
| user, post | interacts, rev_interacts | |
| Texas, Cornell, Wisconsin | Content: Automated Theorem Proving Group… / Content: Steve Seitz’s View Interpolations… | links_to |
| IMDB | movie, director, actor, keyword | directed_by, stars, described_by, … |
| Method | GNN Architecture | Pretraining | Downstream Adaptation | ||||||||
| Backbone | Unified Input | Hidden Dim | Output Dim | Layers | LR | Epochs | Patience | LR | Epochs | Patience | |
| GCOPE | FAGCN | 100 | 128 | 128 | 2 | 100 | 100 | 100 | 100 | ||
| MDGPT | GCN | 50 | 256 | 256 | 3 | 200 | 20 | 400 | 10 | ||
| MDGFM | GCN | 50 | 256 | 256 | 3 | 200 | 20 | 400 | 20 | ||
| SAMGPT | GCN | 50 | 256 | 256 | 3 | 200 | 20 | 400 | 10 | ||
| G2P2 | GCN | 128 | 128 | 128 | 2 | 10 | 3 | 50 | 50 | ||
| Methods | Pubmed | ogbn-mag | Wikipedia | Actor | Chameleon | Products | T-Finance | DGraph | ogbn-proteins |
| GCN | 43.39 11.32 | 4.49 0.27 | 28.72 19.65 | 20.24 7.38 | 21.59 4.32 | 12.17 1.70 | 26.94 21.92 | 23.42 7.91 | 37.96 9.95 |
| GAT | 39.05 10.94 | 3.39 0.25 | 31.13 12.89 | 18.38 7.29 | 21.96 4.18 | 12.13 1.85 | 33.67 20.34 | 23.95 8.20 | 31.99 6.60 |
| GCOPE | 39.94 8.76 | 0.06 0.01 | 29.82 13.47 | 19.02 3.97 | 19.51 3.61 | OOT | 32.62 11.35 | OOT | 32.43 7.98 |
| MDGPT | 38.80 7.39 | 4.41 0.32 | 33.70 12.85 | 24.58 5.67 | 25.98 5.12 | 9.99 1.54 | 42.96 14.41 | 27.06 6.17 | 47.88 9.99 |
| MDGFM | 35.37 6.65 | 2.06 0.75 | 29.67 14.59 | 14.80 3.49 | 23.04 3.75 | 5.09 1.07 | 41.65 11.32 | 21.77 12.54 | 44.52 6.79 |
| SAMGPT | 47.82 8.75 | 3.77 0.23 | 35.88 12.86 | 21.59 5.80 | 25.05 5.33 | 12.53 1.58 | 43.41 10.06 | 27.45 6.83 | 47.83 10.66 |
| Methods | Pubmed | ogbn-mag | Wikipedia | Actor | Chameleon | Products | T-Finance | DGraph | ogbn-proteins |
| GCN | 64.30 6.69 | 11.32 0.55 | 46.14 28.17 | 40.51 8.57 | 35.71 3.48 | 34.95 8.44 | 48.03 39.90 | 40.84 9.77 | 51.75 12.54 |
| GAT | 65.71 6.16 | 10.05 0.66 | 48.14 19.91 | 39.72 9.00 | 35.33 3.28 | 43.66 5.16 | 59.05 33.99 | 41.20 9.92 | 49.96 13.96 |
| GCOPE | 59.13 5.40 | 0.25 0.06 | 51.77 18.38 | 29.71 8.06 | 25.41 2.19 | OOT | 35.86 13.81 | OOT | 42.44 11.57 |
| MDGPT | 53.58 6.27 | 11.93 0.64 | 54.48 18.49 | 41.33 5.26 | 36.33 3.26 | 25.61 5.47 | 58.90 17.82 | 38.17 7.42 | 54.00 9.61 |
| MDGFM | 51.71 7.34 | OOM | 49.81 19.18 | 23.56 5.66 | 31.70 3.50 | 8.97 3.85 | 54.14 12.99 | 39.44 13.73 | 50.98 5.72 |
| SAMGPT | 62.21 4.90 | 11.41 0.81 | 58.08 14.24 | 38.94 5.48 | 37.86 3.59 | 31.24 6.93 | 60.00 10.20 | 40.57 10.19 | 54.51 11.51 |
| Methods | Pubmed | ogbn-mag | Wikipedia | Actor | Chameleon | Products | T-Finance | DGraph | ogbn-proteins |
| GCN | 63.59 7.28 | 10.51 0.29 | 31.07 13.99 | 32.90 5.64 | 34.91 3.53 | 17.84 3.39 | 31.14 23.50 | 29.72 4.80 | 41.13 11.52 |
| GAT | 65.14 6.32 | 9.08 0.29 | 33.42 9.54 | 30.96 6.43 | 34.68 3.40 | 24.08 1.39 | 40.97 22.11 | 30.11 4.85 | 33.54 6.99 |
| GCOPE | 59.15 5.35 | 0.06 0.01 | 35.54 8.85 | 24.29 4.88 | 23.83 1.96 | OOT | 28.58 8.11 | OOT | 30.93 7.43 |
| MDGPT | 52.84 6.44 | 9.39 0.29 | 36.50 8.66 | 33.60 3.56 | 35.19 3.19 | 13.15 1.92 | 43.33 10.49 | 28.41 3.62 | 52.04 9.65 |
| MDGFM | 50.99 7.71 | OOM | 34.26 9.04 | 18.46 3.87 | 30.51 4.16 | 4.77 1.51 | 41.47 7.71 | 28.49 6.78 | 47.66 4.13 |
| SAMGPT | 62.16 4.87 | 8.91 0.64 | 38.56 5.89 | 31.67 3.65 | 37.22 3.77 | 15.60 1.94 | 44.89 5.95 | 29.47 4.99 | 51.52 10.31 |
| Methods | Edge classification | Graph classification | ||||||||
| DGraph | Wiki | WN18RR | PCBA | BZR | ||||||
| Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | |
| GCN | 10.31 1.77 | 7.68 0.78 | 21.49 3.38 | 7.40 0.19 | 20.18 13.60 | 20.14 4.81 | 55.24 30.77 | 32.74 15.69 | 60.22 13.99 | 49.94 9.70 |
| GAT | 10.47 1.75 | 7.77 0.80 | 10.96 1.28 | 4.93 0.18 | 12.54 10.60 | 16.66 3.19 | 57.48 24.48 | 34.82 12.64 | 56.33 13.48 | 49.00 9.42 |
| GCOPE | OOT | OOT | OOT | OOT | 18.25 4.67 | 14.35 2.53 | 47.70 32.64 | 28.97 16.13 | 41.41 16.23 | 38.46 13.22 |
| MDGPT | 10.85 1.90 | 8.02 0.97 | 14.00 2.58 | 5.34 0.23 | 18.43 3.62 | 16.03 2.66 | 58.31 16.94 | 36.25 7.37 | 53.97 11.76 | 50.35 9.68 |
| Methods | Pubmed | ogbn-mag | Wikipedia | Actor | Chameleon | Products | T-Finance | DGraph | ogbn-proteins |
| GCOPE | 4982.84 | 145726.60 | 3609.70 | 2399.45 | 2040.97 | OOT | 10597.74 | OOT | 30164.69 |
| MDGPT | 996.96 | 21295.45 | 578.18 | 559.66 | 621.26 | 41059.80 | 1677.46 | 6052.41 | 2246.63 |
| MDGFM | 4276.28 | 68365.23 | 520.57 | 571.15 | 977.57 | 206484.25 | 5429.48 | 4385.13 | 9203.33 |
| SAMGPT | 3100.42 | 37458.71 | 1302.22 | 1395.42 | 1413.17 | 101031.49 | 4254.17 | 7890.00 | 2561.89 |
| G2P2 | 268.5 | - | 284.01 | 284.77 | - | - | 3150.19 | 1928.43 | - |
| GraphCLIP | 1143.31 | - | 549.77 | 603.42 | - | - | 1578.20 | 10320.75 | - |
| Methods | Pubmed | ogbn-mag | Wikipedia | Actor | Chameleon | Products | T-Finance | DGraph | ogbn-proteins |
| GCOPE | 0.9966 | 29.1453 | 0.7219 | 0.4799 | 0.4082 | OOT | 2.1195 | OOT | 6.0329 |
| MDGPT | 0.0499 | 2.3057 | 0.0289 | 0.0280 | 0.0311 | 5.4761 | 1.1796 | 0.3600 | 2.2443 |
| MDGFM | 0.2952 | 4.5010 | 0.1541 | 0.0990 | 0.0744 | 12.7894 | 1.3986 | 0.6626 | 2.5256 |
| SAMGPT | 0.1554 | 2.7046 | 0.0721 | 0.0707 | 0.0711 | 6.5106 | 1.2225 | 0.4005 | 2.4340 |
| G2P2 | 0.1074 | - | 0.1136 | 0.1139 | - | - | 1.2601 | 0.7714 | - |
| GraphCLIP | 0.2287 | - | 0.1100 | 0.1207 | - | - | 0.3156 | 2.0642 | - |
| Methods | Pubmed | ogbn-mag | Wikipedia | Actor | Chameleon | Products | T-Finance | DGraph | ogbn-proteins |
| GCOPE | 4967.40 | 145716.29 | 3583.13 | 2419.86 | 2036.05 | OOT | 10599.70 | OOT | 30412.11 |
| MDGPT | 91.60 | 30592.08 | 573.91 | 559.37 | 620.14 | 29485.19 | 1983.93 | 6030.87 | 2309.75 |
| MDGFM | 4103.18 | OOM | 549.41 | 582.99 | 998.64 | 195360.13 | 4520.15 | 5207.33 | 11524.04 |
| SAMGPT | 3107.38 | 97086.74 | 1462.31 | 1375.35 | 1276.83 | 105312.52 | 4113.18 | 7786.37 | 2616.61 |
| G2P2 | 279.28 | - | 284.19 | 278.05 | - | - | 3365.97 | 1920.82 | - |
| GraphCLIP | 1234.62 | - | 597.31 | 675.31 | - | - | 1624.89 | 10517.09 | - |
| Methods | Pubmed | ogbn-mag | Wikipedia | Actor | Chameleon | Products | T-Finance | DGraph | ogbn-proteins |
| GCOPE | 0.9935 | 29.1433 | 0.7166 | 0.4840 | 0.4072 | OOT | 2.1199 | OOT | 6.0824 |
| MDGPT | 0.0503 | 4.0784 | 0.0287 | 0.0280 | 0.0311 | 6.6558 | 1.2596 | 0.3580 | 2.3765 |
| MDGFM | 0.2977 | OOM | 0.1592 | 0.0988 | 0.0819 | 16.6476 | 1.4073 | 0.5761 | 3.0493 |
| SAMGPT | 0.1554 | 5.5339 | 0.0731 | 0.0688 | 0.0638 | 9.0304 | 1.3162 | 0.3964 | 2.6281 |
| G2P2 | 0.1117 | - | 0.1137 | 0.1112 | - | - | 1.3464 | 0.7683 | - |
| GraphCLIP | 0.2469 | - | 0.1195 | 0.1351 | - | - | 0.3250 | 2.1034 | - |
| Methods | Edge classification | Graph classification | ||||||||
| DGraph | Wiki | WN18RR | PCBA | BZR | ||||||
| Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | |
| GCOPE | OOT | OOT | OOT | OOT | 5366.42 | 1.0733 | 7849.48 | 1.5689 | 1999.33 | 0.3999 |
| MDGPT | 6691.48 | 0.6109 | 27480.67 | 2.1883 | 1482.20 | 0.0741 | 1171.83 | 0.0777 | 373.24 | 0.0254 |
| MDGFM | 16287.70 | 1.1188 | 79650.24 | 4.0031 | 12818.37 | 0.7522 | 9000.25 | 1.8664 | 194.41 | 0.0515 |
| SAMGPT | 14194.53 | 0.8092 | 52318.30 | 2.6658 | 5529.34 | 0.2765 | 2046.01 | 0.1056 | 413.24 | 0.0242 |
| Methods | Edge classification | Graph classification | ||||||||
| DGraph | Wiki | WN18RR | PCBA | BZR | ||||||
| Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | |
| GCOPE | OOT | OOT | OOT | OOT | 5377.28 | 1.0755 | 7869.82 | 1.5740 | 1990.91 | 0.3982 |
| MDGPT | 3239.32 | 0.5356 | 33128.83 | 3.1503 | 1467.97 | 0.0744 | 1159.48 | 0.0925 | 421.82 | 0.0232 |
| MDGFM | 14083.09 | 1.1941 | 78096.08 | 3.9079 | 12869.09 | 0.7497 | 9296.78 | 1.0705 | 233.65 | 0.0366 |
| SAMGPT | 17314.93 | 0.9869 | 53692.22 | 2.8210 | 5531.02 | 0.2766 | 1943.27 | 0.1037 | 297.63 | 0.0152 |
| Methods | Cora | ACM | Wisconsin | Photo | Elliptic | |||||||
| Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | |
| GCN | 69.86 4.93 | 68.39 4.21 | 52.49 12.80 | 44.46 16.02 | 51.02 20.66 | 35.75 10.64 | 42.85 4.74 | 31.75 3.62 | 76.09 7.03 | 74.45 6.73 | 51.90 12.45 | 42.21 7.92 |
| GAT | 68.57 4.38 | 67.55 4.03 | 39.28 7.90 | 26.88 11.74 | 49.74 15.65 | 35.81 7.48 | 40.35 4.80 | 30.58 4.14 | 76.11 4.54 | 75.25 3.57 | 50.43 14.12 | 40.17 8.47 |
| Simple-HGN | - | - | 66.31 20.71 | 62.29 26.23 | - | - | - | - | - | - | - | - |
| FAGCN | - | - | - | - | - | - | 59.42 9.09 | 47.42 6.96 | - | - | - | - |
| DGI | 58.70 6.05 | 55.59 5.33 | 42.48 10.45 | 38.31 11.38 | 50.85 9.54 | 36.41 4.31 | 31.93 7.41 | 25.35 5.89 | 56.69 7.18 | 55.48 6.59 | 44.95 14.57 | 35.26 10.62 |
| Methods | Edge classification | Graph classification | ||||||
| FB15K-237 | HIV | COX2 | PROTEINS | |||||
| Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | |
| GCN | 26.85 1.55 | 25.90 0.97 | 46.39 28.97 | 30.91 15.60 | 58.73 11.32 | 50.45 7.36 | 57.79 8.91 | 55.05 8.51 |
| GAT | 24.62 1.33 | 24.57 0.81 | 48.22 20.26 | 34.07 10.62 | 57.52 10.63 | 50.90 7.38 | 58.40 8.52 | 56.20 8.28 |
| DGI | 8.54 1.23 | 9.40 0.58 | 57.22 17.97 | 38.35 7.93 | 51.93 10.63 | 45.77 6.65 | 56.77 8.38 | 52.55 7.95 |
| GraphPrompt | 12.47 1.16 | 10.42 0.55 | 51.07 9.62 | 36.41 4.35 | 53.11 7.82 | 47.14 4.53 | 54.35 8.31 | 52.96 7.86 |
| Methods | Cora | ACM | Wisconsin | Photo | Elliptic | |||||||
| Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | |
| GCN | 31.31 | 0.0140 | 122.84 | 0.0636 | 127.02 | 0.1119 | 129.34 | 0.0255 | 828.39 | 0.0698 | 131.64 | 0.1707 |
| GAT | 50.53 | 0.0298 | 184.55 | 0.0955 | 159.57 | 0.1886 | 104.03 | 0.0406 | 410.57 | 0.0788 | 174.17 | 0.2399 |
| Simple-HGN | - | - | 3764.31 | 0.2510 | - | - | - | - | - | - | - | - |
| TGN | - | - | - | - | 1660.39 | 0.1660 | - | - | - | - | - | - |
| FAGFN | - | - | - | - | - | - | 217.31 | 0.0232 | - | - | - | - |
| Methods | Cora | ACM | Wisconsin | Photo | Elliptic | |||||||
| Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | |
| GCN | 257.61 | 0.0297 | 246.73 | 0.0681 | 318.01 | 0.1295 | 560.74 | 0.0310 | 196.12 | 0.0269 | 171.76 | 0.1286 |
| GAT | 296.70 | 0.0464 | 228.42 | 0.1224 | 220.35 | 0.1805 | 195.15 | 0.0213 | 500.67 | 0.0357 | 245.24 | 0.1822 |
| Simple-HGN | - | - | 3765.52 | 0.2510 | - | - | - | - | - | - | - | - |
| TGN | - | - | - | - | 1664.02 | 0.1664 | - | - | - | - | - | - |
| FAGFN | - | - | - | - | - | - | 282.46 | 0.0303 | - | - | - | - |
| Methods | Edge classification | Graph classification | ||||||
| FB15K-237 | HIV | COX2 | PROTEINS | |||||
| Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | |
| GCN | 1220.51 | 0.0639 | 166.80 | 0.0414 | 47.53 | 0.0250 | 44.65 | 0.0346 |
| GAT | 923.32 | 0.0782 | 145.08 | 0.0715 | 42.43 | 0.0280 | 39.23 | 0.0346 |
| DGI | 4468.84 | 3.4212 | 3769.68 | 2.8540 | 43.64 | 0.0248 | 119.66 | 0.2176 |
| GraphPrompt | 2239.06 | 0.2528 | 2495.85 | 2.5379 | 35.17 | 0.0640 | 181.10 | 0.3293 |
| Methods | Edge classification | Graph classification | ||||||
| FB15K-237 | HIV | COX2 | PROTEINS | |||||
| Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | Time | Avg. T. | |
| GCN | 1002.11 | 0.0796 | 332.07 | 0.0303 | 375.00 | 0.0277 | 127.64 | 0.0163 |
| GAT | 779.50 | 0.0876 | 290.26 | 0.0269 | 95.51 | 0.0110 | 119.32 | 0.0121 |
| DGI | 4640.11 | 3.6991 | 3807.46 | 2.9227 | 56.63 | 0.0302 | 131.69 | 0.2394 |
| GraphPrompt | 2599.97 | 0.2667 | 2651.73 | 2.8213 | 44.45 | 0.0808 | 181.88 | 0.3307 |
| Methods | Citation | Social & Web | E-commerce | Finance | Proteins | ||||
| Pubmed | ogbn-mag | Wikipedia | Actor | Chameleon | Products | T-Finance | DGraph | ogbn-proteins | |
| GCOPE | 36.09 6.14 | 0.14 0.01 | 34.55 14.27 | 17.67 4.50 | 19.46 3.48 | OOT | 26.43 12.11 | OOT | 34.16 7.92 |
| MDGPT | 45.38 11.09 | 3.41 0.39 | 33.40 14.27 | 21.76 5.68 | 24.47 4.99 | 9.81 1.54 | 43.76 16.18 | 26.27 6.42 | 44.41 9.33 |
| MDGFM | 29.01 5.05 | 0.83 0.85 | 32.82 14.06 | 13.97 3.09 | 21.24 4.12 | 1.63 0.34 | 36.51 12.34 | 21.65 12.89 | 43.64 6.17 |
| SAMGPT | 46.20 7.43 | 4.98 0.27 | 36.27 14.67 | 19.74 4.39 | 25.21 4.37 | 13.33 1.35 | 37.19 9.70 | 27.00 7.55 | 49.89 10.20 |
| G2P2 | 42.16 8.28 | - | 21.80 2.66 | 22.98 6.09 | - | - | 44.30 10.97 | 22.99 3.99 | - |
| Methods | Citation | Social & Web | E-commerce | Finance | Proteins | ||||
| Pubmed | ogbn-mag | Wikipedia | Actor | Chameleon | Products | T-Finance | DGraph | ogbn-proteins | |
| GCOPE | 55.76 5.66 | 0.26 0.02 | 53.74 20.62 | 30.36 8.68 | 25.42 2.32 | OOT | 29.14 16.34 | OOT | 41.77 9.42 |
| MDGPT | 62.51 6.95 | 9.55 0.90 | 58.41 17.83 | 37.83 7.13 | 33.79 2.88 | 21.28 9.81 | 61.10 12.17 | 39.44 9.47 | 53.75 10.80 |
| MDGFM | 42.34 7.76 | OOM | 49.89 19.61 | 19.70 4.81 | 27.50 4.17 | 6.47 2.25 | 49.76 17.06 | 43.37 17.01 | 50.50 6.30 |
| SAMGPT | 61.36 5.91 | 11.23 0.66 | 54.74 14.32 | 38.92 5.53 | 37.75 3.44 | 31.11 6.32 | 49.73 9.53 | 40.75 8.97 | 55.17 9.88 |
| G2P2 | 61.21 6.44 | - | 47.93 8.18 | 38.05 5.40 | - | - | 64.46 11.21 | 44.04 8.22 | - |
| Methods | Citation | Social & Web | E-commerce | Finance | Proteins | ||||
| Pubmed | ogbn-mag | Wikipedia | Actor | Chameleon | Products | T-Finance | DGraph | ogbn-proteins | |
| GCOPE | 55.38 5.62 | 0.14 0.01 | 36.23 10.58 | 24.36 5.49 | 24.39 2.11 | OOT | 24.05 9.55 | OOT | 31.69 7.16 |
| MDGPT | 62.55 6.89 | 7.20 0.51 | 38.30 8.14 | 30.31 4.24 | 31.96 3.40 | 8.18 2.32 | 45.30 7.33 | 29.07 4.80 | 47.79 9.92 |
| MDGFM | 39.55 7.68 | OOM | 34.33 9.29 | 15.39 2.36 | 26.50 4.72 | 3.45 0.80 | 38.26 10.09 | 28.54 6.77 | 47.36 4.75 |
| SAMGPT | 61.06 5.94 | 9.24 0.32 | 37.08 6.25 | 30.88 3.47 | 37.01 3.46 | 15.53 1.90 | 39.05 5.66 | 29.91 4.46 | 53.46 9.39 |
| G2P2 | 60.53 6.56 | - | 22.97 2.58 | 32.22 3.73 | - | - | 47.66 6.83 | 25.55 2.96 | - |
| Methods | Finance | Common sense | Molecule | |||||||
| DGraph | Wiki | WN18RR | PCBA | BZR | ||||||
| Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | |
| GCOPE | OOT | OOT | OOT | OOT | 18.15 4.25 | 13.59 2.37 | 51.25 15.99 | 33.35 7.09 | 55.69 12.07 | 50.56 8.51 |
| MDGPT | 10.13 2.59 | 10.13 2.59 | 8.79 1.63 | 2.24 0.26 | 19.27 3.32 | 15.54 2.12 | 61.39 15.70 | 37.73 6.11 | 57.21 9.53 | 53.11 7.66 |
| MDGFM | 9.42 2.35 | 6.47 0.81 | 4.78 2.52 | 1.07 0.15 | 15.15 3.33 | 10.90 1.64 | 54.32 30.48 | 32.64 14.65 | 39.62 19.77 | 31.45 8.42 |
| SAMGPT | 10.41 1.48 | 7.71 0.57 | 15.11 2.72 | 5.90 0.24 | 18.06 3.49 | 14.70 1.84 | 57.40 11.87 | 36.38 4.76 | 66.34 9.90 | 58.03 6.84 |
| Methods | Heterogeneous | Heterophilic | Dynamic | Textual | ||||||||
| ogbn-mag | Chameleon | Actor | Wikipedia | Pubmed | Products | |||||||
| Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | Acc | MacroF | |
| GCOPE | 0.34 0.05 | 0.11 0.01 | 26.77 1.82 | 25.24 1.90 | 27.24 7.28 | 23.32 4.79 | 57.89 16.82 | 38.58 7.89 | 56.56 5.41 | 55.48 5.32 | OOT | OOT |
| MDGPT | 11.33 0.64 | 8.63 0.37 | 34.58 3.58 | 32.84 4.24 | 38.14 7.42 | 30.52 4.47 | 49.72 15.67 | 34.65 7.57 | 59.52 5.76 | 59.83 6.03 | 26.69 7.85 | 12.29 2.04 |
| MDGFM | OOM | OOM | 25.50 3.38 | 23.78 3.82 | 19.75 5.24 | 14.87 2.27 | 49.71 23.54 | 33.45 11.56 | 37.95 5.56 | 34.91 5.16 | 5.39 3.62 | 2.42 0.71 |
| SAMGPT | 12.33 0.71 | 9.86 0.33 | 37.27 3.48 | 36.35 3.50 | 38.52 5.37 | 30.69 3.36 | 52.67 12.71 | 36.30 5.89 | 63.88 5.30 | 63.78 5.29 | 32.07 8.02 | 15.53 1.98 |
| Methods | Relational | Textual | ||||
| Wiki | WN18RR | PCBA | ||||
| Acc | MacroF | Acc | MacroF | Acc | MacroF | |
| GCOPE | OOT | OOT | 18.91 4.13 | 14.92 2.17 | 56.03 26.67 | 33.97 12.64 |
| MDGPT | 12.24 2.74 | 4.14 0.65 | 19.02 3.24 | 15.73 2.10 | 56.56 18.54 | 35.36 8.28 |
| MDGFM | 8.42 3.77 | 1.49 0.30 | 19.09 5.56 | 13.34 2.32 | 53.99 44.41 | 28.92 22.20 |
| SAMGPT | 15.15 2.81 | 6.10 0.22 | 17.06 3.39 | 14.08 1.74 | 56.29 14.33 | 35.66 6.18 |