Your Temporal Link Predictor Is Blind to Who Is Active: A Missing Factor That Transfers Across Models
Organizations: Tsinghua University
Abstract
An interaction has two parts: someone decides to act, and then chooses whom to act on. Temporal link prediction has concentrated on the second, and we show that it is blind to the first by construction: a standard negative keeps the real source and swaps the destination, and we prove that this cancels the source's activity exactly from the optimal score, so no model trained and evaluated this way is ever rewarded for learning it. Under the harder historical and inductive negatives, whose sources differ, the same factor becomes the dominant signal. We model it with Source Node Activity Modeling (SNAM), a self-exciting event intensity fitted by an exact point-process likelihood to decayed interaction counts the history states already contain; it has fewer than 20 parameters. On their own, never looking at the destination, these parameters beat DyGFormer and TPNet on four of five datasets under historical negatives. Added to the frozen scores of TPNet, TGN, DyGFormer and DSRD, four models of different design, without retraining anything, they raise AP on almost every backbone-dataset pair in both settings, by up to 25 points. Our full model ranks first overall against eleven baselines on 13 datasets and three protocols, and on million-event streams trains an epoch 9-100x faster than TPNet and DyGFormer. We conclude that source activity is a blind spot of temporal link prediction, and a cheap, transferable one to close. Code is available at https://github.com/Erutaner/Your-Temporal-Link-Predictor-Is-Blind-to-Who-Is-Active.
Figures & tables
| NSS | Dataset | JODIE | TGN | CAWN | EdgeBank | GraphMixer | NAT | PINT | DyGFormer | TPNet | GRN † | DSRD † | Ours | Ours+ |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rnd | Wikipedia | 96.50 0.14 | 98.45 0.06 | 98.76 0.03 | 90.37 0.00 | 97.25 0.03 | 98.03 0.07 | 98.45 0.04 | 99.05 0.01 † | 99.32 0.03 | 94.50 0.23 † | 97.30 0.02 † | 98.95 0.02 | 98.95 0.02 |
| 98.31 0.14 | 98.63 0.06 | 99.11 0.01 | 94.86 0.00 | 97.31 0.01 | 99.13 0.10 | 99.15 0.02 | 99.23 0.00 † | 99.27 0.00 | 93.01 0.21 † | 99.26 0.01 † | 99.15 0.00 | 99.15 0.00 | ||
| MOOC | 80.23 2.44 | 89.15 1.60 | 80.15 0.25 | 57.97 0.00 | 82.78 0.15 | 85.88 0.55 | 88.08 0.86 | 87.52 0.49 | 96.39 0.09 | 75.37 0.66 † | 83.01 0.08 † | 89.42 0.71 | 89.42 0.71 | |
| LastFM | 70.85 2.13 | 77.07 3.97 | 86.99 0.06 | 79.29 0.00 | 75.61 0.24 | 88.02 1.94 | 89.66 1.81 | 92.99 † | 94.50 0.08 | 75.89 0.33 † | 92.30 0.28 † | 92.15 1.13 | 92.15 1.13 | |
| Enron | 84.77 0.30 | 86.53 1.11 | 89.56 0.09 | 83.53 0.00 | 82.25 0.16 | 90.60 0.66 | 92.20 0.15 | 92.45 0.10 † | 92.90 0.17 | 78.77 0.59 † | 91.13 0.12 † | 93.15 0.18 | 93.15 0.18 | |
| Social Evo. | 89.89 0.55 | 93.57 0.17 | 84.96 0.09 | 74.95 0.00 | 93.37 0.07 | 88.92 3.45 | 94.42 0.03 | 94.73 0.01 | 94.73 0.02 | 82.46 0.87 † | 92.51 0.03 † | 94.50 0.03 | 94.50 0.03 |
| backbone | score | Wikipedia | UCI | Enron | LastFM | |
|---|---|---|---|---|---|---|
| TPNet | alone | 83.44 0.93 | 80.22 0.21 | 86.59 1.15 | 81.74 0.56 | 87.26 0.90 |
| 92.99 0.06 | 90.79 0.17 | 94.98 0.12 | 91.38 0.20 | 96.00 0.02 | ||
| TGN † | alone | 86.79 0.74 | 80.23 0.42 | 80.10 1.06 | 73.89 1.37 | 77.31 5.13 |
| 92.52 0.06 | 89.11 0.09 | 93.35 0.18 | 87.87 0.53 | 93.70 0.24 | ||
| DyGFormer † | alone | 76.01 0.51 | 81.32 1.36 | 81.59 0.61 | 76.60 0.54 | 81.61 |
| 92.29 0.05 | 90.30 0.22 | 93.80 0.16 | 89.04 0.35 | 95.10 |
| term | Wikipedia | UCI | Enron | LastFM | |
|---|---|---|---|---|---|
| none ( alone, ) | 86.19 1.21 | 90.62 0.27 | 83.35 0.29 | 85.32 0.85 | 73.96 0.95 |
| (SNAM) ⋆ | 91.23 0.09 | 91.79 0.13 | 88.18 0.04 | 89.04 0.18 | 89.82 0.71 |
| 88.31 0.23 | 91.75 0.16 | 83.35 0.29 | 86.50 0.78 | 82.27 0.85 | |
| 89.44 0.44 | 91.26 0.19 | 86.85 0.48 | 88.93 0.39 | 85.23 0.89 | |
| 90.39 0.32 | 91.44 0.24 | 88.66 0.07 | 87.47 0.47 | 89.93 0.70 | |
| MLP on | 91.34 0.11 | 91.86 0.13 | 88.33 0.06 | 87.84 0.43 | 89.93 0.73 |
Appendix figures & tables17 assets
Supplementary material from the paper’s appendix.
Appendix
| Transductive, hist | Transductive, ind | Inductive, hist | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Dataset | alone | alone | alone | ||||||
| MOOC | 93.30 | 99.42 | +6.12 | 88.81 | 97.78 | +8.97 | 83.49 | 97.02 | +13.52 |
| Social Evo. | 96.91 | 99.20 | +2.29 | 97.42 | 99.32 | +1.90 | 96.33 | 98.51 | +2.18 |
| Flights | 69.18 | 83.91 | +14.73 | 65.48 | 85.31 | +19.83 | 55.51 | 70.18 | +14.67 |
| Can. Parl. | 75.19 | 75.19 | +0.00 | 70.74 | 70.74 | +0.00 | 57.20 | 57.20 | +0.00 |
| US Legis. | 73.16 | 73.72 | +0.55 | 73.41 | 76.33 | +2.92 | 47.28 | 47.28 | +0.00 |
| Transductive | Inductive | |||||||
| rnd | hist | hist | ind | ind | rnd | hist | hist | |
| Wikipedia, within-block updates on | ||||||||
| 48 | 98.92 0.02 | 88.65 0.46 | 93.29 0.05 | 85.20 1.50 | 91.15 0.12 | 98.35 0.01 | 78.11 1.50 | 88.35 0.13 |
| 96 ⋆ | 98.95 0.02 | 88.71 0.80 | 93.25 0.05 | 86.19 1.21 | 91.23 0.09 | 98.41 0.03 | 77.78 1.86 | 88.29 0.13 |
| 192 | 98.95 0.04 | 86.98 0.90 | 93.18 0.18 | 83.11 2.41 | 91.03 0.26 | 98.42 0.03 | 75.75 2.93 | 88.34 0.01 |
| Wikipedia, within-block updates off | ||||||||
| term | Wikipedia | UCI | Enron | LastFM | |
|---|---|---|---|---|---|
| Transductive setting, historical negatives | |||||
| none ( alone, ) | 88.71 0.80 | 82.74 1.44 | 91.47 0.52 | 84.04 2.43 | 84.60 1.20 |
| (SNAM) ⋆ | 93.25 0.05 | 90.16 0.17 | 96.04 0.17 | 90.26 0.77 | 95.36 0.03 |
| 89.03 0.54 | 85.25 0.61 | 91.47 0.52 | 84.03 2.43 | 87.15 0.54 | |
| 91.67 0.19 | 83.92 1.23 | 95.03 0.34 | 88.98 1.56 | 92.71 0.32 | |
| 93.33 0.04 | 90.29 0.21 | 96.02 0.08 | 88.96 0.89 | 95.30 0.03 | |
| Transductive, ind | Inductive, hist | |||||
| backbone / stream | alone | alone | ||||
| TPNet | ||||||
| Wikipedia | 82.13 3.35 | 91.18 0.26 | +9.05 3.10 | 74.81 1.88 | 88.83 0.06 | +14.02 1.83 |
| 87.92 0.54 | 90.10 0.36 | +2.19 0.18 | 61.70 0.32 | 80.27 0.25 | +18.57 0.08 | |
| UCI | 77.42 2.63 | 87.40 0.58 | +9.98 2.54 | 78.65 1.83 | 88.61 0.30 | +9.96 1.75 |
| Enron | 76.75 0.44 | 87.28 0.19 | +10.53 0.25 | 74.96 0.40 | 86.38 0.21 | +11.42 0.61 |
| Transductive | Inductive | |||||||
| rnd | hist | hist | ind | ind | rnd | hist | hist | |
| Wikipedia | ||||||||
| 1 | 95.19 0.02 | 89.51 0.03 | 91.91 0.03 | 87.25 0.03 | 90.05 0.07 | 95.61 0.02 | 87.67 0.04 | 90.18 0.05 |
| 8 | 98.96 0.02 | 87.87 1.75 | 93.22 0.01 | 85.68 1.47 | 91.43 0.03 | 98.40 0.02 | 77.58 2.64 | 88.49 0.07 |
| 14 ⋆ | 98.95 0.02 | 88.71 0.80 | 93.25 0.05 | 86.19 1.21 | 91.23 0.09 | 98.41 0.03 | 77.78 1.86 | 88.29 0.13 |
| 27 | 98.94 0.02 | 88.39 0.94 | 93.26 0.04 | 84.16 2.83 | 90.85 0.21 | 98.40 0.06 | 77.66 2.40 | 88.23 0.11 |
| Feature group | Dimension |
|---|---|
| Low-rank representation matches (3 types) | |
| Pair and endpoint activity counts | |
| Static node matching | |
| Random-projection matches (4 types) | |
| Historical edge-feature matching | |
| Total |
| Transductive | Inductive | |||||||
| variant | rnd | hist | hist | ind | ind | rnd | hist | hist |
| Wikipedia | ||||||||
| all inputs ⋆ | 98.95 0.02 | 88.71 0.80 | 93.25 0.05 | 86.19 1.21 | 91.23 0.09 | 98.41 0.03 | 77.78 1.86 | 88.29 0.13 |
| no | 98.95 0.02 | 90.37 0.69 | 93.36 0.08 | 87.80 0.37 | 91.16 0.05 | 98.38 0.01 | 81.79 1.32 | 88.41 0.05 |
| no projections | 98.91 0.02 | 89.54 0.36 | 93.35 0.07 | 84.95 0.89 | 90.93 0.13 | 98.30 0.02 | 79.72 1.04 | 88.39 0.03 |
| no counts | 98.25 0.04 | 86.49 1.09 | 92.94 0.06 | 78.37 1.97 | 90.54 0.24 | 97.56 0.09 | 74.19 1.58 | 88.12 0.11 |
| stream | prefix | train | test | epoch | s per | scoring | s per |
|---|---|---|---|---|---|---|---|
| edges | positives | time (s) | 100k edges | time (s) | 100k positives | ||
| LastFM | 10% | 74k | 19k | 12.6 | 17.1 | 1.3 | 6.8 |
| 30% | 222k | 58k | 12.8 | 5.8 | 1.7 | 2.8 | |
| 100% | 723k | 194k | 21.7 | 3.0 | 7.1 | 3.7 | |
| Flights | 10% | 104k | 24k | 0.5 | 0.5 | 0.5 | 1.9 |
| 30% | 328k | 84k | 2.5 | 0.8 | 0.9 | 1.0 |
| Dataset | Domain | #Nodes | #Events | Feat. | Bip. | Span | Steps / unit | Decades | Tied (%) | Rep. (%) | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Wikipedia | Social | 9,227 | 157,474 | 170 | yes | 31 d | 152,757 / s | 6.3 | 14 | 5.9 | 89.2 |
| Social | 10,984 | 672,447 | 172 | yes | 31 d | 669,065 / s | 9.3 | 16 | 1.0 | 93.1 | |
| MOOC | Interaction | 7,144 | 411,749 | 4 | yes | 30 d | 345,600 / s | 6.3 | 14 | 29.9 | 60.8 |
| LastFM | Interaction | 1,980 | 1,293,103 | – | yes | 4.3 yr | 1,283,614 / s | 8.0 | 16 | 1.4 | 90.7 |
| Enron | Social | 184 | 125,235 | – | no | 3.6 yr | 22,632 / s | 7.9 | 16 | 96.4 | 98.3 |
| Social Evo. | Proximity | 74 | 2,099,519 | 2 | no | 242 d | 565,932 / s | 7.2 | 16 | 94.7 | 100.0 |
| NSS | Dataset | JODIE | TGN | CAWN | TGAT | GraphMixer | NAT | PINT | DyGFormer | TPNet | GRN † | DSRD † | Ours | Ours+ |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rnd | Wikipedia | 94.82 0.20 | 97.83 0.04 | 98.24 0.03 | 96.22 0.07 | 96.65 0.02 | 96.30 0.08 | 98.03 0.04 | 98.60 0.02 † | 98.91 0.01 | 93.93 0.26 † | 96.86 0.08 † | 98.43 0.04 | 98.43 0.04 |
| 96.50 0.13 | 97.50 0.07 | 98.62 0.01 | 97.09 0.04 | 95.26 0.02 | 98.24 0.04 | 98.56 0.05 | 98.83 0.00 † | 98.86 0.01 | 91.13 0.31 † | 98.75 0.02 † | 98.22 0.02 | 98.22 0.02 | ||
| MOOC | 79.63 1.92 | 89.04 1.17 | 81.42 0.24 | 85.50 0.19 | 81.41 0.21 | 83.62 1.19 | 87.90 0.98 | 86.96 0.43 | 95.07 0.26 | 76.35 1.41 † | 81.49 0.12 † | 89.12 0.59 | 89.12 0.59 | |
| LastFM | 81.61 3.82 | 81.45 4.29 | 89.42 0.07 | 78.63 0.31 | 82.11 0.42 | 92.24 0.93 | 92.42 0.64 | 94.20 † | 95.36 0.11 | 85.20 0.38 † | 94.14 0.41 † | 92.23 2.25 | 92.23 2.25 | |
| Enron | 80.72 1.39 | 77.94 1.02 | 86.35 0.51 | 67.05 1.51 | 75.88 0.48 | 87.18 1.24 | 88.12 0.30 | 89.61 0.31 † | 90.34 0.28 | 78.45 0.90 † | 87.85 0.34 † | 89.50 0.11 | 89.50 0.11 | |
| Social Evo. | 91.96 0.48 | 90.77 0.86 | 79.94 0.18 | 91.41 0.16 | 91.86 0.06 | 87.44 5.48 | 92.40 0.60 | 93.14 0.04 | 93.24 0.07 | 92.35 0.42 † | 90.74 0.13 † | 92.09 0.11 | 92.09 0.11 |
| NSS | Dataset | JODIE | TGN | CAWN | EdgeBank | GraphMixer | NAT | PINT | DyGFormer | TPNet | GRN † | DSRD † | Ours | Ours+ |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rnd | Wikipedia | 96.33 0.07 | 98.37 0.07 | 98.54 0.04 | 90.78 0.00 | 96.92 0.03 | 97.75 0.11 | 98.16 0.06 | 98.94 0.00 † | 99.30 0.02 | 93.77 0.23 † | 96.92 0.03 † | 98.80 0.01 | 98.80 0.01 |
| 98.31 0.05 | 98.60 0.06 | 99.01 0.01 | 95.37 0.00 | 97.17 0.02 | 99.09 0.10 | 99.09 0.03 | 99.15 0.00 † | 99.22 0.00 | 92.96 0.22 † | 99.29 0.01 † | 99.05 0.00 | 99.05 0.00 | ||
| MOOC | 83.81 2.09 | 91.21 1.15 | 80.38 0.26 | 60.86 0.00 | 84.01 0.17 | 87.42 0.58 | 90.55 0.43 | 87.91 0.58 | 97.17 0.08 | 76.49 1.06 † | 84.28 0.08 † | 90.68 0.62 | 90.68 0.62 | |
| LastFM | 70.49 1.66 | 78.47 2.94 | 85.92 0.10 | 83.77 0.00 | 73.53 0.12 | 86.92 2.72 | 89.28 1.63 | 93.03 † | 94.39 0.04 | 74.71 0.35 † | 91.48 0.26 † | 92.77 0.94 | 92.77 0.94 | |
| Enron | 87.96 0.52 | 88.32 0.99 | 90.45 0.14 | 87.05 0.00 | 84.38 0.21 | 91.68 0.83 | 92.87 0.34 | 93.26 0.05 † | 93.98 0.26 | 81.76 0.43 † | 92.97 0.09 † | 94.13 0.35 | 94.13 0.35 | |
| Social Evo. | 92.05 0.46 | 95.39 0.17 | 87.34 0.08 | 81.60 0.00 | 95.23 0.07 | 90.84 3.72 | 96.16 0.02 | 96.30 0.01 | 96.43 0.02 | 85.89 0.90 † | 94.59 0.03 † | 96.30 0.02 | 96.30 0.02 |
| Dataset | Blocks | Table | Dropout | Weight decay | Negatives | Partner updates |
|---|---|---|---|---|---|---|
| Wikipedia | 96 equal | no | 0 | – | seen | no |
| 48 equal | no | 0 | – | seen | no | |
| MOOC | 192 equal | no | 0 | – | seen | no |
| LastFM | 192 equal | no | 0 | – | seen | no |
| Enron | 192 equal | no | 0 | – | seen | yes |
| Social Evo. | 96 equal | no | 0 | – | seen | no |
| Model | Retrained on (seeds) | Correction |
|---|---|---|
| DyGFormer | Can. Parl. (5); Wikipedia, Reddit, UCI, Enron (3); LastFM (1) | fixed-length padding |
| TPNet | Can. Parl., US Legis., UN Trade, UN Vote (5) | strictly earlier commit of events |
| GRN | all thirteen streams (5) | six corrections, Appendix F.3 |
| DSRD | all thirteen streams (5) | batch row mapping; loader alignment |
| NSS | Dataset | JODIE | TGN | CAWN | TGAT | GraphMixer | NAT | PINT | DyGFormer | TPNet | GRN † | DSRD † | Ours | Ours+ |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rnd | Wikipedia | 94.33 0.27 | 97.72 0.03 | 98.03 0.04 | 95.90 0.09 | 96.30 0.04 | 95.82 0.18 | 97.76 0.05 | 98.52 0.01 † | 98.90 0.01 | 92.59 0.31 † | 96.47 0.07 † | 98.25 0.04 | 98.25 0.04 |
| 96.52 0.13 | 97.39 0.07 | 98.42 0.02 | 96.98 0.04 | 94.97 0.05 | 98.00 0.04 | 98.38 0.07 | 98.69 0.00 † | 98.73 0.02 | 91.04 0.31 † | 98.74 0.01 † | 97.90 0.01 | 97.90 0.01 | ||
| MOOC | 83.16 1.30 | 91.24 0.99 | 81.86 0.25 | 86.84 0.17 | 82.77 0.24 | 84.72 1.31 | 90.27 0.96 | 87.62 0.51 | 95.55 0.25 | 76.92 2.01 † | 82.92 0.11 † | 90.55 0.50 | 90.55 0.50 | |
| LastFM | 81.13 3.39 | 82.61 3.15 | 87.82 0.12 | 76.99 0.29 | 80.37 0.18 | 91.60 1.31 | 92.15 0.68 | 94.04 † | 95.36 0.06 | 84.26 0.56 † | 93.54 0.38 † | 92.70 1.95 | 92.70 1.95 | |
| Enron | 81.96 1.34 | 78.83 1.11 | 87.02 0.50 | 64.63 1.74 | 76.51 0.71 | 87.95 0.58 | 87.97 0.61 | 90.26 0.13 † | 90.21 0.49 | 79.76 1.02 † | 89.11 0.21 † | 90.03 0.17 | 90.03 0.17 | |
| Social Evo. | 93.70 0.29 | 93.43 0.59 | 84.73 0.27 | 93.41 0.19 | 94.09 0.07 | 88.15 6.36 | 94.78 0.37 | 95.29 0.03 | 95.47 0.04 | 94.79 0.32 † | 93.17 0.08 † | 94.91 0.05 | 94.91 0.05 |
Temporal Link Prediction
Temporal link prediction forecasts which relationships will form or recur as networks and knowledge graphs change over time.
See all 59 papers