Hydra: Towards Transferable Multi-Task Learning on Temporal Graphs
Organizations: University of Manitoba · Mila – Quebec AI Institute · McGill University · CIFAR AI Chair ·
Abstract
Real-world evolving networks are naturally modeled as temporal graphs (TGs), where capturing temporal dynamics is essential for predicting future graph properties that support downstream decision-making. Existing temporal graph methods have been developed primarily for single-task prediction, and little is known about their generalization across tasks or transfer to unseen networks. This leaves the challenge of multi-task graph property prediction in TGs largely open. We address this challenge by introducing Hydra, a novel architecture that integrates local connectivity features from temporal GNNs with a spectral learning module that captures global connectivity patterns. This design enables joint learning of local and global information under a multi-task objective. In multi-task classification, Hydra achieves an 8.9% relative gain in AUC over the strongest competitor. In multi-task regression, Hydra achieves competitive results in all three tasks, while obtaining the best results in two tasks with a 8.2% relative gain in MAE compared to the strongest baseline. Moreover, Hydra delivers these gains with a 22% reduction in training time compared to temporal transfer models. These results provide the first systematic evidence that multi-task transferable learning on temporal graphs is effective. By delivering consistent top-ranked performance, Hydra highlights multi-task training on temporal graphs as a promising direction toward adaptable foundation models for temporal graphs.
Figures & tables
| LCC-G/S | Node-G/S | Edge-G/S | |||||||
| 1st | Rank | AUC | 1st | Rank | AUC | 1st | Rank | AUC | |
| Single Models | |||||||||
| HTGN | 2 | 4.40 | 0.648 | 0 | 3.65 | 0.615 | 1 | 4.85 | 0.684 |
| GC-LSTM | 0 | 6.00 | 0.572 | 0 | 6.65 | 0.489 | 1 | 5.80 | 0.609 |
| EvolveGCN | 0 | 6.30 | 0.585 | 0 | 7.00 | 0.487 | 0 | 6.10 | 0.626 |
| GraphPulse | 3 | 3.50 | 0.686 | 2 | 2.95 | 0.652 | 6 | 3.80 | 0.712 |
| New Node Count | Influential Node Count | Edge Count | |||||||
| 1st | Rank | MAE | 1st | Rank | MAE | 1st | Rank | MAE | |
| Single Models | |||||||||
| HTGN | 4 | 3.45 | 0.039 | 4 | 3.52 | 0.050 | 2 | 3.95 | 0.049 |
| TGCN | 1 | 4.10 | 0.042 | 1 | 4.85 | 0.059 | 1 | 4.60 | 0.054 |
| GCLSTM | 2 | 4.00 | 0.043 | 5 | 3.80 | 0.053 | 4 | 4.58 | 0.057 |
| ROLAND | 3 | 4.35 | 0.052 | 2 | 4.55 | 0.057 | 3 | 4.58 | 0.050 |
| Ablation | Avg. AUC | #1st-Place | ||
|---|---|---|---|---|
| w/o | w/ | w/o | w/ | |
| Density of States | 0.697 | 0.719 | 6 | 14 |
| Attention-based Pooling | 0.719 | 0.753 | 3 | 17 |
| Dataset | Hydra (One Task) | Hydra (Two Tasks) | Hydra (Three Tasks) |
|---|---|---|---|
| MIR | 0.057 ( 0.004) | 0.034 ( 0.002) | 0.016 ( 0.005) |
| DOGE2.0 | 0.169 ( 0.016) | 0.150 ( 0.015) | 0.187 ( 0.008) |
| MUTE | 0.053 ( 0.020) | 0.067 ( 0.011) | 0.021 ( 0.022) |
| EVERMOON | 0.029 ( 0.021) | 0.042 ( 0.010) | 0.017 ( 0.000) |
| DERC | 0.024 ( 0.016) | 0.035 ( 0.010) | 0.021 ( 0.003) |
| ADX | 0.023 ( 0.010) | 0.027 ( 0.006) | 0.025 ( 0.008) |
Appendix figures & tables13 assets
Supplementary material from the paper’s appendix.
Appendix
| Token | #Node | #Transaction | #Snapshots (days) | Growth rate | Novelty | Surprise | Token | #Node | #Transaction | #Snapshots (days) | Growth rate | Novelty | Surprise |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ARC | 11325 | 70968 | 606 | 0.43 | 0.32 | 0.88 | Metis | 52586 | 343141 | 907 | 0.44 | 0.48 | 0.89 |
| CELR | 65350 | 235807 | 1691 | 0.49 | 0.56 | 0.96 | cDAI | 52753 | 358050 | 1437 | 0.45 | 0.46 | 0.9 |
| CMT | 86895 | 205961 | 309 | 0.45 | 0.72 | 0.92 | BITCOIN | 34051 | 347054 | 178 | 0.48 | 0.39 | 0.63 |
| DRGN | 113453 | 341849 | 2164 | 0.44 | 0.57 | 0.97 | INJ | 60472 | 312822 | 1113 | 0.46 | 0.52 | 0.98 |
| GHST | 35156 | 180955 | 1146 | 0.43 | 0.51 | 0.93 | MIM | 23038 | 269366 | 885 | 0.44 | 0.4 | 0.89 |
| INU | 8556 | 66315 | 154 | 0.27 | 0.41 | 0.59 | GLM | 53385 | 234912 | 1080 | 0.5 | 0.53 | 0.96 |
| Dataset | Hydra w/o DOS | Hydra w DOS |
|---|---|---|
| MIR | 0.017 ( 0.005) | 0.013 ( 0.004) |
| DOGE2.0 | 0.183 ( 0.015) | 0.092 ( 0.008) |
| MUTE | 0.025 ( 0.012) | 0.025 ( 0.005) |
| EVERMOON | 0.015 ( 0.004) | 0.012 ( 0.005) |
| DERC | 0.016 ( 0.008) | 0.015 ( 0.004) |
| ADX | 0.024 ( 0.013) | 0.016 ( 0.005) |
| Model | MathOverflow | RedditB |
|---|---|---|
| HTGN | ||
| Hydra-Social | ||
| Hydra-Mix |
| Dataset | Hydra-32 | Hydra-64 | ||
|---|---|---|---|---|
| MIR | 0.796 | |||
| DOGE2.0 | 0.897 | |||
| MUTE | 0.764 | |||
| EVERMOON | 0.818 | |||
| DERC | 0.839 | |||
| ADX | 0.746 | |||
| Single Model on Individual Networks | Transfer Models | ||||||||
| Dataset | HTGN | GC-LSTM | EvolveGCN | GraphPulse | ROLAND | TGCN | WinGNN | MiNT | Hydra (Ours) |
| MIR | 0.750 0.005 | 0.768 0.026 | 0.745 0.015 | 0.689 0.097 | 0.228 0.060 | 0.749 0.026 | 0.742 0.015 | 0.836 0.016 | 0.793 0.002 |
| DOGE2.0 | 0.590 0.059 | 0.538 0.000 | 0.551 0.022 | 0.384 0.180 | 0.513 0.022 | 0.487 0.044 | 0.577 0.038 | 0.538 0.038 | 0.897 0.089 |
| MUTE | 0.649 0.015 | 0.593 0.030 | 0.617 0.010 | 0.779 0.004 | 0.289 0.042 | 0.557 0.068 | 0.593 0.054 | 0.673 0.013 | 0.701 0.098 |
| EVERMOON | 0.512 0.023 | 0.562 0.179 | 0.451 0.046 | 0.519 0.130 | 0.349 0.119 | 0.463 0.149 | 0.525 0.114 | 0.517 0.039 | 0.818 0.046 |
| DERC | 0.683 0.013 | 0.703 0.022 | 0.669 0.009 | 0.769 0.040 | 0.405 0.357 | 0.743 0.077 | 0.674 0.044 | 0.798 0.027 | 0.839 0.008 |
| Single Model on Individual Networks | Transfer Models | ||||||||
| Dataset | HTGN | GC-LSTM | EvolveGCN | GraphPulse | ROLAND | TGCN | WinGNN | MiNT | Hydra (Ours) |
| MIR | 0.745 (±0.023) | 0.585 (±0.128) | 0.575 (±0.146) | 0.800 (±0.008) | 0.536 (±0.275) | 0.585 (±0.055) | 0.749 (±0.020) | 0.845 (±0.035) | 0.815 (±0.007) |
| DOGE2.0 | 0.446 (±0.164) | 0.387 (±0.294) | 0.583 (±0.115) | 0.333 (±0.042) | 0.411 (±0.232) | 0.464 (±0.182) | 0.595 (±0.176) | 0.661 (±0.047) | 0.702 (±0.160) |
| MUTE | 0.574 (±0.022) | 0.579 (±0.022) | 0.578 (±0.033) | 0.647 (±0.014) | 0.624 (±0.037) | 0.567 (±0.007) | 0.641 (±0.061) | 0.582 (±0.078) | 0.704 (±0.085) |
| EVERMOON | 0.494 (±0.127) | 0.512 (±0.112) | 0.548 (±0.152) | 0.463 (±0.034) | 0.491 (±0.157) | 0.624 (±0.004) | 0.603 (±0.041) | 0.527 (±0.118) | 0.667 (±0.045) |
| DERC | 0.717 (±0.035) | 0.591 (±0.010) | 0.553 (±0.044) | 0.727 (±0.009) | 0.481 (±0.131) | 0.523 (±0.103) | 0.582 (±0.043) | 0.689 (±0.096) | 0.808 (±0.022) |
| Single Model on Individual Networks | Transfer Models | ||||||||
| Dataset | HTGN | GC-LSTM | EvolveGCN | GraphPulse | ROLAND | TGCN | WinGNN | MiNT | Hydra (Ours) |
| MIR | 0.545 (±0.030) | 0.537 (±0.033) | 0.528 (±0.081) | 0.633 (±0.066) | 0.472 (±0.040) | 0.532 (±0.021) | 0.525 (±0.043) | 0.622 (±0.030) | 0.764 (±0.001) |
| DOGE2.0 | 0.427 (±0.065) | 0.633 (±0.014) | 0.400 (±0.061) | 0.403 (±0.035) | 0.260 (±0.000) | 0.627 (±0.034) | 0.693 (±0.041) | 0.750 (±0.014) | 0.633 (±0.064) |
| MUTE | 0.518 (±0.023) | 0.448 (±0.008) | 0.475 (±0.051) | 0.677 (±0.008) | 0.411 (±0.053) | 0.458 (±0.009) | 0.562 (±0.015) | 0.606 (±0.056) | 0.748 (±0.025) |
| EVERMOON | 0.585 (±0.059) | 0.606 (±0.021) | 0.488 (±0.088) | 0.463 (±0.002) | 0.427 (±0.137) | 0.567 (±0.030) | 0.548 (±0.116) | 0.614 (±0.071) | 0.655 (±0.040) |
| DERC | 0.662 (±0.051) | 0.492 (±0.069) | 0.503 (±0.084) | 0.611 (±0.049) | 0.551 (±0.013) | 0.447 (±0.003) | 0.517 (±0.034) | 0.569 (±0.004) | 0.742 (±0.004) |
| Single Model on Individual Networks | Transfer Models | |||||||
| Dataset | HTGN | TGCN | GCLSTM | ROLAND | EGCN | GraphPulse | WinGNN | Hydra (Ours) |
| MIR | 0.059 (±0.007) | 0.044 (±0.009) | 0.047 (±0.003) | 0.039 (±0.000) | 0.057 (±0.015) | 0.059 (±0.001) | 0.046 (±0.010) | 0.016 (±0.005) |
| DOGE2.0 | 0.101 (±0.035) | 0.063 (±0.017) | 0.106 (±0.029) | 0.052 (±0.003) | 0.092 (±0.031) | 0.046 (±0.000) | 0.045 (±0.003) | 0.187 (±0.008) |
| MUTE | 0.025 (±0.006) | 0.038 (±0.004) | 0.017 (±0.001) | 0.040 (±0.007) | 0.049 (±0.005) | 0.025 (±0.002) | 0.027 (±0.003) | 0.021 (±0.022) |
| EVERMOON | 0.010 (±0.001) | 0.021 (±0.013) | 0.025 (±0.007) | 0.016 (±0.016) | 0.030 (±0.010) | 0.235 (±0.005) | 0.025 (±0.004) | 0.017 (±0.000) |
| DERC | 0.038 (±0.015) | 0.059 (±0.011) | 0.016 (±0.005) | 0.060 (±0.008) | 0.023 (±0.007) | 0.023 (±0.003) | 0.032 (±0.001) | 0.021 (±0.003) |
| Single Model on Individual Networks | Transfer Models | |||||||
| Dataset | HTGN | TGCN | GCLSTM | ROLAND | EGCN | GraphPulse | WinGNN | Hydra (ours) |
| MIR | 0.031 (±0.002) | 0.028 (±0.001) | 0.039 (±0.005) | 0.025 (±0.018) | 0.030 (±0.001) | 0.025 (±0.001) | 0.037 (±0.011) | 0.013 (±0.004) |
| DOGE2.0 | 0.046 (±0.009) | 0.064 (±0.021) | 0.044 (±0.014) | 0.073 (±0.019) | 0.051 (±0.031) | 0.157 (±0.010) | 0.098 (±0.009) | 0.092 (±0.008) |
| MUTE | 0.021 (±0.003) | 0.041 (±0.005) | 0.030 (±0.003) | 0.048 (±0.002) | 0.053 (±0.003) | 0.031 (±0.001) | 0.051 (±0.015) | 0.025 (±0.005) |
| EVERMOON | 0.010 (±0.004) | 0.017 (±0.008) | 0.026 (±0.009) | 0.029 (±0.019) | 0.028 (±0.017) | 0.222 (±0.005) | 0.022 (±0.002) | 0.012 (±0.005) |
| DERC | 0.028 (±0.009) | 0.034 (±0.018) | 0.016 (±0.024) | 0.043 (±0.024) | 0.019 (±0.004) | 0.043 (±0.011) | 0.027 (±0.003) | 0.015 (±0.004) |
| Single Model on Individual Networks | Transfer Models | |||||||
| Dataset | HTGN | TGCN | GCLSTM | ROLAND | EGCN | GraphPulse | WinGNN | Hydra (ours) |
| MIR | 0.114 (±0.003) | 0.119 (±0.005) | 0.105 (±0.020) | 0.115 (±0.020) | 0.114 (±0.017) | 0.127 (±0.002) | 0.082 (±0.007) | 0.039 (±0.005) |
| DOGE2.0 | 0.064 (±0.031) | 0.090 (±0.023) | 0.053 (±0.021) | 0.070 (±0.015) | 0.059 (±0.021) | 0.087 (±0.004) | 0.091 (±0.009) | 0.126 (±0.032) |
| MUTE | 0.028 (±0.004) | 0.042 (±0.002) | 0.018 (±0.002) | 0.051 (±0.006) | 0.042 (±0.012) | 0.021 (±0.001) | 0.045 (±0.033) | 0.045 (±0.027) |
| EVERMOON | 0.011 (±0.002) | 0.014 (±0.006) | 0.018 (±0.008) | 0.014 (±0.004) | 0.032 (±0.015) | 0.235 (±0.004) | 0.026 (±0.006) | 0.038 (±0.024) |
| DERC | 0.069 (±0.007) | 0.084 (±0.001) | 0.053 (±0.002) | 0.104 (±0.011) | 0.058 (±0.010) | 0.048 (±0.001) | 0.077 (±0.003) | 0.033 (±0.017) |
Multi-Task Learning
Multi-task learning trains models to solve related tasks together by sharing representations, parameters, or supervision.
See all 417 papers