MM-DyGraph: A Dataset, Benchmark, and Model for Multimodal Dynamic Graphs
Organizations: DCST, Tsinghua University, Beijing, China · Zhili College, Tsinghua University, Beijing, China
Abstract
Multimodal dynamic graphs are pervasive in real-world applications, where nodes and edges are accompanied by multimodal signals, including text and images. Despite their practical importance, benchmarks and methods that explicitly study multimodal learning in dynamic graphs remain scarce, hindering the full understanding and effective utilization of multimodal information for downstream tasks. To address this gap, we introduce MM-DyGraph, to the best of our knowledge, the first benchmark for multimodal dynamic graph learning, consisting of diverse real-world datasets with fine-grained temporal graph evolution and rich multimodal attributes. MM-DyGraph provides three evaluation tasks to comprehensively assess model performance in dynamic settings. We benchmark representative state-of-the-art dynamic graph methods and reveal that naive feature concatenation yields target-level inconsistencies: multimodal inputs benefit certain prediction targets while harming others. This observation indicates that the modality informativeness depends on the specific prediction target over time. Building on these observations, we propose a Target-aware Spatial-Temporal Multimodal Fusion (TST-MF) framework, which jointly conditions multimodal fusion on the prediction target and spatial-temporal relations, enabling context-adaptive cross-modal interplay for target-specific representations. Extensive experiments over diverse datasets and tasks show that TST-MF delivers robust and competitive performance, achieving clear gains in multimodal settings.
Figures & tables
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | FreeDyG | TPNet | SALoM | DyGFormer | TST-MF | |
| tr. | GDELT | Random | 89.15 1.99 | 92.68 0.36 | 91.73 0.02 | 90.83 0.30 | 90.63 0.33 | 91.89 0.58 | 91.21 1.66 | 92.21 0.12 | 92.83 0.18 |
| Text | 89.54 1.37 | 92.94 0.11 | 91.67 0.16 | 91.65 0.45 | 91.95 0.06 | 92.23 0.19 | 91.64 0.55 | 92.48 0.21 | 94.03 0.13 | ||
| Text+Image | 90.76 0.34 | 93.08 0.25 | 91.47 0.19 | 91.38 0.20 | 91.73 0.10 | 92.57 0.36 | 91.89 0.12 | 92.46 0.26 | 93.98 0.05 | ||
| GMCT | Random | 74.28 3.36 | 78.19 0.05 | 78.07 0.17 | 78.26 0.05 | 78.28 0.11 | 79.53 0.43 | 62.47 1.35 | 94.47 0.78 | 80.79 3.27 | |
| Text | 82.04 3.67 | 79.49 0.09 | 78.55 0.34 | 79.26 0.30 | 78.88 0.29 | 79.81 0.29 | 60.96 1.25 | 95.73 0.30 | 89.77 0.65 | ||
| Text+Image | 81.62 2.33 | 79.65 0.05 | 78.50 0.22 | 79.62 0.48 | 78.93 0.19 | 79.83 0.26 | 60.04 3.08 | 95.54 0.10 | 89.08 0.72 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | FreeDyG | TPNet | SALoM | DyGFormer | TST-MF | |
| tr. | GDELT | Random | 67.77 3.43 | 77.54 0.69 | 75.42 0.43 | 70.03 0.99 | 69.38 1.71 | 74.73 1.55 | 73.62 5.37 | 52.96 4.82 | 77.72 0.36 |
| Text | 67.28 3.85 | 78.81 0.43 | 74.99 0.42 | 72.45 1.71 | 76.47 0.66 | 75.57 0.61 | 73.99 2.02 | 69.78 8.64 | 81.21 0.78 | ||
| Text+Image | 70.79 1.04 | 79.08 0.35 | 74.66 0.43 | 72.41 1.16 | 74.09 1.77 | 76.21 0.61 | 75.02 0.21 | 71.34 7.82 | 81.62 0.33 | ||
| GMCT | Random | 42.35 5.98 | 50.29 0.20 | 50.13 0.30 | 50.22 0.12 | 50.90 0.19 | 50.79 0.51 | 20.74 0.06 | 100.00 0.00 | 78.77 24.87 | |
| Text | 54.01 5.80 | 50.57 0.11 | 50.34 0.08 | 50.14 0.41 | 51.21 0.30 | 51.19 0.24 | 20.89 0.18 | 100.00 0.00 | 100.00 0.00 | ||
| Text+Image | 53.02 2.88 | 50.73 0.02 | 50.27 0.24 | 50.72 0.69 | 51.18 0.11 | 51.24 0.23 | 20.69 0.22 | 100.00 0.00 | 100.00 0.00 |
| Task | Metric | Datasets | DyGFormer | Gated fusion | Modality attention | MoE fusion | TST-MF | |
| LP | AP | tr. | GDELT | 92.46 0.26 | 92.74 0.28 | 93.08 0.10 | 92.92 0.26 | 93.98 0.05 |
| GMCT | 95.54 0.10 | 96.41 0.17 | 96.30 0.20 | 96.59 0.16 | 89.08 0.72 | |||
| Amazon - Industrial | 92.56 0.24 | 92.63 0.26 | 92.61 0.61 | 90.89 2.25 | 94.10 0.12 | |||
| Amazon - Office | 89.00 0.23 | 90.26 1.41 | 90.73 1.02 | 89.59 0.94 | 92.67 0.10 | |||
| Yelp | 88.55 5.51 | 91.25 0.38 | 92.29 0.17 | 88.56 5.75 | 92.65 0.04 | |||
| in. | GDELT | 83.05 0.28 | 83.29 0.34 | 84.07 0.31 | 84.14 0.35 | 85.44 0.14 |
Appendix figures & tables27 assets
Supplementary material from the paper’s appendix.
Appendix
| Datasets | # Nodes | # Edges | # Timestamps | Node Figures | Edge Figures | Domain | Bipartite | |
| Previous Dynamic Graph | tgbn-trade | 255 | 468,245 | 32 | ✗ | ✗ | Trade | ✗ |
| tgbl-wiki | 9,227 | 157,474 | 152,757 | ✗ | ✗ | Interaction | ✗ | |
| tgbl-review | 352,637 | 4,873,540 | 6,865 | ✗ | ✗ | E-commerce | ✓ | |
| MOOC | 7,144 | 411,749 | 345,600 | ✗ | ✗ | Interaction | ✓ | |
| Enron | 42,711 | 797,907 | 1,006 | ✗ | ✗ | Business | ✗ | |
| ICEWS1819 | 31,796 | 1,100,071 | 730 | ✗ | ✗ | Knowledge graph | ✗ |
| Hyperparameter | Value |
| Batch size | 256 |
| Optimizer | Adam |
| Learning rate | |
| Weight decay | 0.0 |
| Dropout | 0.1 |
| Max epochs | 200 |
| Model | #Neighbors | #Layers | #Heads | Sampling | #Params |
| TGAT | 20 | 2 | 2 | recent | 50.7M |
| CAWN | 32 | 1 | 8 | interval | 161.3M |
| TCL | 20 | 2 | 2 | recent | 9.3M |
| GraphMixer | 20 | 2 | – | recent | 7.1M |
| FreeDyG | 32 | 2 | – | recent | 57.0M |
| TPNet | 20 | 2 | – | recent | 57.4M |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | FreeDyG | TPNet | SALoM | DyGFormer | TST-MF | |
| tr. | GDELT | Random | 88.30 1.96 | 92.22 0.46 | 91.07 0.03 | 90.70 0.12 | 90.73 0.31 | 91.61 0.54 | 90.26 1.93 | 91.56 0.08 | 92.23 0.25 |
| Text | 88.82 1.21 | 92.60 0.08 | 91.08 0.22 | 91.36 0.35 | 91.54 0.34 | 91.76 0.21 | 90.92 0.60 | 92.05 0.21 | 93.70 0.11 | ||
| Text+Image | 90.16 0.27 | 92.73 0.26 | 90.84 0.32 | 91.15 0.14 | 91.47 0.18 | 92.22 0.22 | 91.18 0.15 | 91.93 0.24 | 93.71 0.08 | ||
| GMCT | Random | 73.63 2.25 | 76.69 0.02 | 76.54 0.14 | 76.72 0.01 | 76.77 0.01 | 78.46 0.61 | 61.68 2.90 | 94.36 0.54 | 81.17 4.79 | |
| Text | 81.96 3.60 | 79.40 0.15 | 77.34 0.85 | 79.28 0.35 | 78.11 0.31 | 79.08 0.46 | 58.75 2.88 | 95.35 0.66 | 91.89 0.76 | ||
| Text+Image | 81.60 2.33 | 79.56 0.05 | 77.42 0.60 | 79.48 0.66 | 78.29 0.25 | 78.78 0.19 | 57.47 6.18 | 95.08 0.27 | 92.49 0.66 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | FreeDyG | TPNet | SALoM | DyGFormer | TST-MF |
| GDELT | Random | 48.22 0.33 | 50.02 3.28 | 42.98 3.83 | 48.67 1.10 | 45.38 1.53 | 47.34 2.56 | 40.69 0.00 | 47.59 0.17 | 49.23 1.43 |
| Text | 47.96 0.39 | 49.62 2.52 | 40.77 0.00 | 48.22 0.15 | 44.34 3.19 | 47.29 1.25 | 46.33 1.78 | 47.62 0.06 | 52.56 1.28 | |
| Text+Image | 48.15 0.09 | 51.62 5.99 | 40.77 0.00 | 48.08 0.31 | 46.60 0.21 | 48.89 2.63 | 47.78 0.17 | 47.54 0.10 | 53.56 1.70 | |
| GMCT | Random | 55.26 0.56 | 55.42 0.02 | 54.36 0.20 | 58.09 0.10 | 50.46 1.80 | 50.34 0.66 | 45.13 0.00 | 59.44 0.13 | 51.60 0.31 |
| Text | 54.68 0.04 | 56.46 1.92 | 54.56 0.20 | 58.81 1.13 | 47.12 3.45 | 52.66 0.31 | 45.13 0.00 | 59.32 0.32 | 47.90 4.80 | |
| Text+Image | 55.45 0.29 | 56.64 2.07 | 54.40 0.19 | 58.58 0.76 | 47.88 4.75 | 49.49 3.77 | 47.71 4.46 | 56.77 1.72 | 53.45 1.57 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | FreeDyG | TPNet | SALoM | DyGFormer | TST-MF |
| GDELT | Random | 64.07 0.04 | 64.20 0.08 | 63.85 0.00 | 64.32 0.22 | 63.32 0.51 | 62.55 1.04 | 63.79 0.00 | 63.91 0.15 | 62.50 1.35 |
| Text | 63.98 0.08 | 64.23 0.12 | 63.85 0.00 | 64.25 0.05 | 63.58 0.27 | 63.82 0.03 | 63.88 0.11 | 63.94 0.09 | 63.70 0.04 | |
| Text+Image | 64.05 0.03 | 64.24 0.12 | 63.85 0.00 | 64.26 0.11 | 63.36 0.60 | 63.30 0.88 | 63.96 0.09 | 63.93 0.08 | 63.77 0.07 | |
| GMCT | Random | 67.10 0.39 | 67.45 0.09 | 67.01 0.27 | 67.36 0.31 | 66.91 0.22 | 61.93 3.65 | 67.18 0.00 | 67.86 0.03 | 53.66 1.57 |
| Text | 67.16 0.06 | 67.60 0.30 | 66.39 0.92 | 67.46 0.25 | 67.16 0.03 | 66.39 0.65 | 67.18 0.00 | 67.39 0.21 | 65.65 2.66 | |
| Text+Image | 67.36 0.15 | 67.60 0.23 | 66.61 0.54 | 67.48 0.35 | 66.64 0.94 | 66.53 1.01 | 67.18 0.00 | 67.47 0.14 | 67.18 0.00 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | FreeDyG | TPNet | SALoM | DyGFormer | TST-MF |
| GDELT | Random | 50.95 0.23 | 53.45 0.06 | 49.78 0.02 | 52.54 0.75 | 49.82 0.18 | 50.39 0.40 | 49.69 0.00 | 52.96 0.05 | 53.32 0.04 |
| Text | 50.48 0.35 | 53.50 0.06 | 49.77 0.00 | 52.10 0.29 | 50.83 1.01 | 50.11 0.25 | 50.04 0.45 | 52.93 0.12 | 53.38 0.04 | |
| Text+Image | 50.81 0.16 | 53.45 0.10 | 49.77 0.00 | 52.66 0.86 | 51.78 0.85 | 51.19 1.39 | 50.72 0.88 | 52.81 0.07 | 53.64 0.03 | |
| GMCT | Random | 59.20 1.08 | 59.35 0.11 | 56.99 2.53 | 59.93 0.17 | 54.18 0.22 | 54.48 0.12 | 53.99 0.00 | 58.40 0.06 | 52.12 0.08 |
| Text | 58.24 0.21 | 59.27 0.02 | 58.73 0.45 | 59.98 0.16 | 53.99 0.00 | 55.32 0.84 | 53.99 0.00 | 59.68 0.35 | 54.72 1.27 | |
| Text+Image | 59.41 0.31 | 59.33 0.05 | 58.48 0.65 | 59.88 0.17 | 54.57 1.00 | 54.83 1.15 | 54.04 0.08 | 59.89 0.06 | 56.32 0.21 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | FreeDyG | TPNet | SALoM | DyGFormer | TST-MF | |
| tr. | GDELT | Random | 28.12 5.67 | 34.88 0.69 | 31.63 0.23 | 30.04 1.52 | 28.29 0.28 | 33.58 2.69 | 32.54 1.34 | 24.67 5.01 | 36.72 0.29 |
| Text | 28.79 3.26 | 33.23 0.06 | 31.70 0.11 | 31.53 0.78 | 30.90 1.44 | 33.56 0.38 | 32.25 1.04 | 33.99 3.87 | 38.25 0.56 | ||
| Text+Image | 30.42 1.64 | 33.65 1.09 | 31.53 0.31 | 31.11 0.64 | 31.04 0.49 | 36.34 1.01 | 32.06 0.77 | 34.19 4.03 | 38.31 0.74 | ||
| GMCT | Random | 7.45 2.79 | 11.74 0.21 | 11.24 0.47 | 11.09 0.14 | 34.74 1.26 | 12.85 0.06 | 5.46 0.06 | 93.35 3.69 | 31.33 18.55 | |
| Text | 15.04 3.97 | 11.15 0.33 | 11.42 0.13 | 9.09 2.51 | 35.77 0.51 | 12.87 0.42 | 5.50 0.08 | 88.78 4.31 | 70.15 7.03 | ||
| Text+Image | 13.63 2.32 | 11.64 0.20 | 11.58 0.40 | 10.51 1.45 | 35.98 0.19 | 13.63 0.27 | 5.30 0.19 | 93.29 1.56 | 73.27 3.06 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | FreeDyG | TPNet | SALoM | DyGFormer | TST-MF | |
| tr. | GDELT | Random | 47.26 6.65 | 55.88 0.56 | 53.42 0.19 | 48.30 3.94 | 46.34 1.30 | 51.59 2.51 | 55.21 2.00 | 35.27 6.80 | 57.46 0.46 |
| Text | 49.37 4.36 | 55.20 0.54 | 53.64 0.14 | 52.96 1.39 | 53.50 1.01 | 54.73 0.82 | 55.01 1.21 | 51.40 6.58 | 58.98 1.08 | ||
| Text+Image | 51.56 2.13 | 55.65 1.06 | 53.46 0.21 | 51.71 2.01 | 51.67 0.63 | 54.84 2.20 | 56.03 0.24 | 52.06 6.41 | 59.05 0.36 | ||
| GMCT | Random | 20.00 5.05 | 25.25 0.31 | 25.20 0.35 | 25.57 0.35 | 39.36 0.84 | 26.29 0.07 | 11.35 0.13 | 100.00 0.01 | 59.31 31.43 | |
| Text | 30.51 6.38 | 25.00 0.18 | 24.90 0.29 | 23.08 2.21 | 38.90 0.37 | 26.56 0.16 | 11.60 0.16 | 100.00 0.01 | 99.63 0.34 | ||
| Text+Image | 29.04 4.09 | 25.53 0.18 | 25.24 0.17 | 25.07 1.56 | 38.84 0.27 | 27.28 0.17 | 11.31 0.22 | 100.00 0.01 | 99.69 0.69 |
| Task | Metric | Datasets | DyGFormer | Gated fusion | Modality attention | MoE fusion | TST-MF | |
| LP | AP | tr. | GDELT | 92.46 0.26 | 92.74 0.28 | 93.08 0.10 | 92.92 0.26 | 93.98 0.05 |
| GMCT | 95.54 0.10 | 96.41 0.17 | 96.30 0.20 | 96.59 0.16 | 89.08 0.72 | |||
| Amazon - Industrial | 92.56 0.24 | 92.63 0.26 | 92.61 0.61 | 90.89 2.25 | 94.10 0.12 | |||
| Amazon - Office | 89.00 0.23 | 90.26 1.41 | 90.73 1.02 | 89.59 0.94 | 92.67 0.10 | |||
| Yelp | 88.55 5.51 | 91.25 0.38 | 92.29 0.17 | 88.56 5.75 | 92.65 0.04 | |||
| in. | GDELT | 83.05 0.28 | 83.29 0.34 | 84.07 0.31 | 84.14 0.35 | 85.44 0.14 |
| Datasets | Metric | Feature | TGAT | CAWN | TCL | GraphMixer | DyGFormer | TST-MF | |
| tr. | GDELT | AP | Random | 96.19 0.27 | 97.04 0.04 | 96.20 0.11 | 96.06 0.20 | 97.25 0.03 | 97.36 0.03 |
| Text | 97.40 0.07 | 97.37 0.13 | 96.09 0.15 | 96.96 0.11 | 97.71 0.02 | 97.87 0.02 | |||
| Text+Image | 97.42 0.07 | 97.27 0.28 | 96.19 0.25 | 97.03 0.08 | 97.62 0.09 | 97.85 0.04 | |||
| AUC-ROC | Random | 95.97 0.26 | 96.91 0.04 | 96.02 0.15 | 95.94 0.14 | 97.01 0.07 | 97.18 0.03 | ||
| Text | 97.30 0.07 | 97.31 0.13 | 95.93 0.18 | 96.87 0.15 | 97.63 0.03 | 97.80 0.02 | |||
| Text+Image | 97.33 0.08 | 97.20 0.29 | 96.06 0.28 | 96.97 0.08 | 97.53 0.11 | 97.78 0.06 |
| Datasets | Metric | Feature | TGAT | CAWN | TCL | GraphMixer | DyGFormer | TST-MF |
| GDELT | Precision | Random | 60.92 2.70 | 61.85 0.58 | 46.09 4.48 | 60.68 0.94 | 57.56 0.26 | 61.23 0.14 |
| Text | 49.57 0.25 | 63.85 1.26 | 45.92 4.34 | 58.91 10.07 | 60.51 3.81 | 61.79 0.67 | ||
| Text+Image | 49.43 0.13 | 62.49 1.92 | 43.50 4.47 | 55.61 5.35 | 59.74 4.03 | 61.13 2.25 | ||
| Recall | Random | 64.69 0.03 | 65.01 0.02 | 64.43 0.40 | 65.09 0.06 | 65.09 0.02 | 64.18 0.34 | |
| Text | 64.39 0.35 | 65.04 0.04 | 64.27 0.35 | 65.00 0.10 | 65.20 0.09 | 65.41 0.09 | ||
| Text+Image | 64.50 0.21 | 64.94 0.02 | 64.20 0.39 | 64.97 0.18 | 65.15 0.22 | 65.48 0.01 |
| Datasets | Metric | Feature | TGAT | CAWN | TCL | GraphMixer | DyGFormer | TST-MF | |
| tr. | GDELT | Hits@1 | Random | 51.39 1.29 | 55.65 0.32 | 50.30 0.38 | 50.14 0.95 | 31.33 7.78 | 58.59 0.05 |
| Text | 58.39 0.65 | 55.33 1.70 | 50.00 0.61 | 54.93 0.39 | 59.63 0.19 | 61.35 0.46 | |||
| Text+Image | 58.48 0.19 | 55.66 2.01 | 49.96 1.00 | 55.08 0.20 | 52.54 7.70 | 61.18 0.35 | |||
| Hits@3 | Random | 73.00 2.03 | 76.29 0.13 | 73.47 0.25 | 70.30 2.69 | 45.47 6.98 | 79.51 0.11 | ||
| Text | 79.73 0.49 | 76.93 1.73 | 72.49 0.49 | 76.69 0.39 | 79.91 0.34 | 82.26 0.25 | |||
| Text+Image | 79.79 0.20 | 77.25 1.64 | 73.37 0.91 | 76.84 0.43 | 71.04 9.37 | 82.01 0.28 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | DyGFormer | TST-MF | |
| tr. | GDELT | Zero Filling | 90.24 0.64 | 93.08 0.18 | 91.67 0.14 | 91.18 0.32 | 92.33 0.17 | 93.93 0.11 |
| Mean Filling | 90.32 0.42 | 92.94 0.09 | 91.69 0.05 | 91.27 0.32 | 92.26 0.32 | 94.07 0.01 | ||
| Learned Embedding | 89.96 0.63 | 92.94 0.48 | 91.71 0.20 | 91.39 0.21 | 92.30 0.18 | 94.01 0.16 | ||
| Duplication | 90.76 0.34 | 93.08 0.25 | 91.47 0.19 | 91.38 0.20 | 92.46 0.26 | 93.98 0.05 | ||
| GMCT | Zero Filling | 82.47 3.32 | 79.58 0.08 | 78.63 0.10 | 79.57 0.38 | 95.60 0.27 | 87.59 0.99 | |
| Mean Filling | 84.19 2.11 | 79.59 0.03 | 78.11 0.23 | 79.54 0.22 | 96.16 0.32 | 88.55 1.57 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | DyGFormer | TST-MF |
| GDELT | Zero Filling | 47.83 0.31 | 51.86 3.13 | 40.77 0.00 | 48.19 0.50 | 47.54 0.16 | 49.39 1.96 |
| Mean Filling | 47.93 0.17 | 50.12 3.53 | 42.44 2.89 | 47.85 0.30 | 47.54 0.08 | 51.56 0.47 | |
| Learned Embedding | 47.96 0.11 | 50.77 2.57 | 44.51 6.47 | 48.27 0.23 | 47.46 0.14 | 50.54 1.90 | |
| Duplication | 48.15 0.09 | 51.62 5.99 | 40.77 0.00 | 48.08 0.31 | 47.54 0.10 | 53.56 1.70 | |
| GMCT | Zero Filling | 55.39 0.40 | 56.55 2.10 | 54.90 0.51 | 58.51 0.02 | 59.22 0.31 | 53.83 1.21 |
| Mean Filling | 55.16 0.28 | 55.46 0.09 | 54.28 0.28 | 58.35 0.25 | 58.56 2.63 | 52.31 0.91 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | DyGFormer | TST-MF |
| GDELT | Zero Filling | 64.01 0.04 | 64.28 0.09 | 63.85 0.00 | 64.29 0.23 | 63.91 0.04 | 63.89 0.64 |
| Mean Filling | 63.98 0.10 | 64.18 0.09 | 63.85 0.01 | 64.16 0.13 | 63.92 0.05 | 63.99 0.16 | |
| Learned Embedding | 64.01 0.03 | 64.26 0.12 | 63.86 0.01 | 64.34 0.09 | 63.88 0.08 | 64.13 0.09 | |
| Duplication | 64.05 0.03 | 64.24 0.12 | 63.85 0.00 | 64.26 0.11 | 63.93 0.08 | 63.77 0.07 | |
| GMCT | Zero Filling | 67.17 0.08 | 67.52 0.13 | 66.26 1.27 | 67.37 0.35 | 67.52 0.17 | 64.27 3.20 |
| Mean Filling | 67.00 0.27 | 67.45 0.08 | 66.98 0.19 | 67.55 0.08 | 67.62 0.11 | 64.59 1.93 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | DyGFormer | TST-MF |
| GDELT | Zero Filling | 50.86 0.21 | 53.40 0.11 | 49.77 0.00 | 52.62 0.66 | 52.85 0.22 | 53.27 0.34 |
| Mean Filling | 50.52 0.59 | 53.38 0.09 | 49.80 0.05 | 52.24 0.30 | 52.87 0.03 | 53.22 0.74 | |
| Learned Embedding | 50.69 0.08 | 53.26 0.16 | 49.79 0.04 | 52.95 0.19 | 52.75 0.14 | 53.09 0.55 | |
| Duplication | 50.81 0.16 | 53.45 0.10 | 49.77 0.00 | 52.66 0.86 | 52.81 0.07 | 53.64 0.03 | |
| GMCT | Zero Filling | 59.53 0.58 | 59.19 0.09 | 59.05 0.64 | 60.02 0.33 | 59.75 0.10 | 55.43 1.24 |
| Mean Filling | 59.25 0.50 | 59.42 0.07 | 58.13 0.49 | 59.78 0.12 | 59.60 0.26 | 55.67 0.54 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | DyGFormer | TST-MF | |
| tr. | GDELT | Zero Filling | 31.11 1.23 | 33.56 0.81 | 31.62 0.04 | 30.92 0.34 | 30.98 3.35 | 38.32 0.36 |
| Mean Filling | 29.89 0.96 | 33.26 0.78 | 31.71 0.00 | 30.97 0.07 | 31.05 1.39 | 38.36 0.16 | ||
| Learned Embedding | 30.05 0.48 | 33.46 1.22 | 31.61 0.01 | 31.02 0.25 | 33.92 3.22 | 38.09 1.07 | ||
| Duplication | 30.42 1.64 | 33.65 1.09 | 31.53 0.31 | 31.11 0.64 | 34.19 4.03 | 38.31 0.74 | ||
| GMCT | Zero Filling | 14.73 4.35 | 11.54 0.16 | 11.29 0.25 | 11.62 0.25 | 91.12 7.18 | 53.84 11.14 | |
| Mean Filling | 17.04 1.98 | 11.58 0.16 | 11.36 0.23 | 11.53 0.07 | 93.53 1.50 | 65.77 2.01 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | DyGFormer | TST-MF | |
| tr. | GDELT | Zero Filling | 52.29 0.85 | 56.05 0.66 | 53.79 0.13 | 51.47 1.10 | 45.49 7.59 | 59.28 0.39 |
| Mean Filling | 50.96 1.07 | 55.35 0.45 | 53.63 0.38 | 51.93 0.55 | 46.53 3.51 | 59.50 0.02 | ||
| Learned Embedding | 50.86 1.06 | 55.71 1.37 | 53.61 0.16 | 52.29 0.38 | 51.30 6.33 | 59.07 1.45 | ||
| Duplication | 51.56 2.13 | 55.65 1.06 | 53.46 0.21 | 51.71 2.01 | 52.06 6.41 | 59.05 0.36 | ||
| GMCT | Zero Filling | 30.79 6.07 | 25.57 0.12 | 25.54 0.38 | 25.81 0.74 | 99.98 0.03 | 97.40 1.97 | |
| Mean Filling | 33.83 3.37 | 25.51 0.14 | 24.72 0.23 | 26.26 0.98 | 100.00 0.00 | 99.31 0.08 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | DyGFormer | TST-MF | |
| tr. | GDELT | Zero Filling | 70.55 2.09 | 79.20 0.13 | 75.11 0.31 | 70.79 1.22 | 63.87 10.27 | 81.83 0.38 |
| Mean Filling | 70.47 0.99 | 79.05 0.27 | 74.92 0.59 | 71.28 1.57 | 64.12 5.79 | 82.01 0.66 | ||
| Learned Embedding | 69.57 2.06 | 79.41 0.70 | 74.84 0.22 | 71.74 1.53 | 70.45 8.88 | 81.67 0.72 | ||
| Duplication | 70.79 1.04 | 79.08 0.35 | 74.66 0.43 | 72.41 1.16 | 71.34 7.82 | 81.62 0.33 | ||
| GMCT | Zero Filling | 54.67 4.52 | 50.77 0.04 | 50.20 0.20 | 50.84 0.43 | 100.00 0.00 | 100.00 0.00 | |
| Mean Filling | 57.29 3.80 | 50.72 0.11 | 49.83 0.45 | 50.91 0.33 | 100.00 0.00 | 100.00 0.00 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | DyGFormer | TST-MF | |
| tr. | GDELT | Random | 20.78 0.26 | 26.18 0.80 | 20.98 0.16 | 20.70 0.25 | 33.32 0.57 | 27.27 0.78 |
| Text | 20.77 1.49 | 27.81 1.13 | 20.65 0.09 | 21.58 1.52 | 35.39 0.49 | 34.81 1.46 | ||
| Text+Image | 22.70 1.50 | 27.73 0.91 | 20.75 0.11 | 20.82 0.25 | 35.56 0.34 | 36.03 0.78 | ||
| GMCT | Random | 41.08 3.52 | 44.08 0.09 | 44.04 0.14 | 44.06 0.05 | 99.91 0.12 | 47.54 30.15 | |
| Text | 47.63 4.12 | 44.15 0.03 | 43.91 0.22 | 25.25 16.46 | 99.96 0.06 | 95.85 3.10 | ||
| Text+Image | 45.95 1.68 | 44.19 0.06 | 43.99 0.18 | 34.15 11.72 | 99.99 0.02 | 81.52 3.04 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | DyGFormer | TST-MF | |
| tr. | GDELT | Random | 27.26 0.32 | 35.93 1.14 | 27.38 0.22 | 27.11 0.33 | 45.43 0.76 | 37.46 1.11 |
| Text | 27.07 2.30 | 38.30 1.62 | 26.88 0.12 | 28.35 2.12 | 47.80 0.67 | 46.73 1.94 | ||
| Text+Image | 29.62 1.98 | 38.03 1.32 | 27.06 0.12 | 27.36 0.32 | 48.13 0.46 | 48.08 0.95 | ||
| GMCT | Random | 33.76 2.96 | 37.38 0.28 | 38.49 0.04 | 38.27 0.20 | 99.03 0.10 | 45.75 28.91 | |
| Text | 42.04 4.45 | 37.58 0.20 | 37.74 0.32 | 24.11 12.57 | 99.05 0.06 | 94.89 3.06 | ||
| Text+Image | 40.61 2.61 | 37.54 0.22 | 38.32 0.13 | 30.79 8.96 | 99.09 0.00 | 81.00 2.87 |
| Datasets | Feature | TGAT | CAWN | TCL | GraphMixer | DyGFormer | TST-MF | |
| tr. | GDELT | Random | 8.77 0.16 | 7.83 0.20 | 9.04 0.08 | 8.81 0.11 | 10.42 0.23 | 8.27 0.15 |
| Text | 9.09 0.04 | 8.06 0.28 | 9.04 0.03 | 8.98 0.36 | 11.96 0.55 | 12.44 0.55 | ||
| Text+Image | 9.79 0.66 | 8.34 0.64 | 9.03 0.07 | 8.69 0.21 | 11.81 0.26 | 13.40 0.60 | ||
| GMCT | Random | 41.22 3.52 | 44.20 0.09 | 44.15 0.15 | 44.17 0.04 | 99.91 0.12 | 47.41 30.28 | |
| Text | 47.73 4.12 | 44.27 0.02 | 44.03 0.23 | 25.27 16.54 | 99.96 0.06 | 95.89 3.10 | ||
| Text+Image | 46.03 1.66 | 44.30 0.06 | 44.10 0.17 | 34.22 11.77 | 99.99 0.02 | 81.45 3.09 |
| Mean [95% CI] | Share of (%) | ||||
| Datasets | Task | Text | Image | Text | Image |
| GDELT | LP ( tr. ) | -0.096 [-0.102, -0.092] | -0.103 [-0.130, -0.084] | 42.1 | 36.6 |
| LP ( in. ) | -0.124 [-0.130, -0.117] | -0.131 [-0.158, -0.108] | 37.7 | 33.3 | |
| EC | -0.004 [-0.014, +0.003] | +0.000 [-0.006, +0.006] | 46.8 | 48.1 | |
| GMCT | LP ( tr. ) | +0.149 [+0.003, +0.406] | +0.282 [+0.006, +0.818] | 76.6 | 77.2 |
| LP ( in. ) | +0.163 [+0.003, +0.443] | +0.308 [+0.006, +0.889] | 78.6 | 79.3 | |
| Datasets | Metric | TST-MF | w/o target | w/o hier. | w/o spatial | w/o historical | |
| tr. | GDELT | Precision | 93.98 0.05 | 92.08 0.21 | 91.90 0.15 | 92.06 0.22 | 93.95 0.06 |
| AUC-ROC | 93.71 0.08 | 92.78 0.18 | 91.54 0.20 | 92.74 0.29 | 91.78 0.09 | ||
| GMCT | Precision | 89.08 0.72 | 88.83 1.24 | 82.28 3.99 | 88.46 0.66 | 89.03 0.34 | |
| AUC-ROC | 92.49 0.66 | 91.67 0.89 | 82.28 4.06 | 91.33 0.88 | 91.87 0.04 | ||
| Amazon - Industrial | Precision | 94.10 0.12 | 94.01 0.28 | 93.56 0.50 | 94.01 0.23 | 93.99 0.05 | |
| AUC-ROC | 94.26 0.16 | 93.23 0.27 | 93.94 0.22 | 93.25 0.19 | 93.38 0.11 |
Multimodal Graph Learning
Multimodal Graph Learning combines graph structure with text, images, signals, and other modalities for prediction, retrieval, and reasoning.
See all 119 papers