Flexible Intensities Matter: A Comprehensive Re-evaluation of Hawkes Processes and Neural Temporal Point Processes
Organizations: German Cancer Research Center (DKFZ), Heidelberg, Germany · Goethe-Universität Frankfurt, Frankfurt, Germany · European Molecular Biology Laboratory (EMBL), Heidelberg, Germany · Ruprecht-Karls-Universität Heidelberg, Heidelberg, Germany
Abstract
Temporal point processes (TPPs) are the canonical framework for event sequence data, with applications spanning seismology, social media, and electronic health records. Recently, neural TPPs have been reported to substantially outperform classical TPPs, such as Hawkes processes, but these comparisons pitted flexible neural models against Hawkes processes in their most restricted form, and did not consider large-scale medical data. Here, we revisit this comparison through a systematic evaluation of Poisson and Hawkes processes of increasing flexibility against neural TPPs, on five established benchmark datasets and on two large-scale medical evaluation tasks derived from UK Biobank disease histories and MIMIC-IV ICU records, under autoregressive next-event prediction. First, the previously reported gap between Hawkes processes and neural TPPs largely disappears once Hawkes processes are equipped with flexible, learnable baselines and kernels. Second, the flexibility of the intensity parametrization also limits prior neural TPPs: a Transformer with a spline-based intensity head outperforms previous intensity-based neural TPPs and is on par with the intensity-free model. Decomposing the log-likelihood into a time term and a type term , we find that this flexibility advantage lies almost entirely in the time density: more flexibility does not improve the type term. On these benchmarks, the gains of neural TPPs thus lie mostly in modeling when events occur, not which. Third, our results underscore the value of complex datasets for evaluating TPPs: only on the MIMIC-IV ICU records do neural TPPs retain an advantage in the type term. Our results inform both future method development and model choice. We release our framework, TorchPP, as an open-source package with consistent implementations of classical and neural TPPs.
Figures & tables
| Dataset | Term. | Train / Val / Test | Total Events | Mean Len | |
| Taxi | 10 | No | 1,400 / 200 / 400 | 74K | 37.0 |
| StackOverflow | 22 | No | 1,401 / 401 / 401 | 143K | 64.6 |
| Retweet | 3 | No | 9,000 / 1,535 / 1,520 | 494K | 41.1 |
| Amazon | 16 | No | 6,454 / 922 / 1,851 | 413K | 44.7 |
| Taobao | 17 | No | 1,300 / 200 / 500 | 113K | 56.7 |
| UKB | 1,257 | Yes | 351,656 / 100,473 / 50,238 | 6.2M | 12.4 |
| Model | Taxi | StackOv. | Retweet | Amazon | Taobao |
|---|---|---|---|---|---|
| Poisson processes | |||||
| H. Poisson | |||||
| S. Poisson | |||||
| Hawkes processes | |||||
| C/E Hawkes | |||||
| S/E Hawkes | |||||
| Model | UKB | MIMIC-IV |
|---|---|---|
| Poisson processes | ||
| H. Poisson | ||
| S. Poisson | ||
| Hawkes processes | ||
| C/E Hawkes | ||
| S/E Hawkes | ||
Appendix figures & tables23 assets
Supplementary material from the paper’s appendix.
Appendix
| TorchPP | EasyTPP (rerun) | EasyTPP (paper) | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Dataset | Model | LL | Acc | RMSE | LL | Acc | RMSE | Acc | RMSE |
| Taxi | SAHP | 0.25 | 0.918 | 0.290 | 0.897 | 0.313 | 0.903 | 0.372 | |
| THP | 0.25 | 0.913 | 0.285 | 0.24 | 0.909 | 0.305 | 0.913 | 0.370 | |
| StackOverflow | SAHP | 0.462 | 1.040 | 0.425 | 1.307 | 0.439 | 1.375 | ||
| THP | 0.452 | 1.029 | 0.443 | 1.130 | 0.450 | 1.374 | |||
| Retweet | SAHP | 0.596 | 15.95 | 0.540 | 19.69 | 0.584 | 22.40 | ||
| tick MHP (our fit) | ||||||
|---|---|---|---|---|---|---|
| Dataset | Majority | tick LS | MLE | MLE, | EasyTPP (reported) | Ours: C/E / best Hawkes |
| Taxi | 44.3 | 79.6 | 84.2 | 84.6 | 90.5 | 85.0 / 92.0 |
| StackOverflow | 42.5 | 44.5 | 43.6 | 44.2 | 35.0 | 46.2 / 46.7 |
| Retweet | 54.0 | 53.8 | 54.1 | 42.2 | 44.3 | 57.5 / 58.6 |
| Amazon | 30.0 | 29.9 | 28.9 | 32.8 | 24.1 | 35.0 / 39.1 |
| Taobao | 43.6 | 54.1 | 53.7 | 54.5 | 31.9 | 61.0 / 61.5 |
| Family | Configs / dataset | Swept hyperparameters | Integration | Params (MIMIC-IV) |
|---|---|---|---|---|
| Poisson, Const./Exp Hawkes | 2 | – | closed form | 117 – 27,495 |
| Spline Poisson, flexible Hawkes | , ; validation-selected | closed form | 2,340 – 285,481 | |
| Inhibitive Hawkes | 2 | inherited from analytical twin, clamping function | numerical (grid) | 27,495 – 285,481 |
| NeuralConstTPP, NeuralSplineTPP | ; ; validation-selected | closed form | 216,554 – 286,052 | |
| THP, SAHP | – | architecture from EasyTPP, validated | numerical (per interval) | 216,905 / 231,764 |
| NHP, IntensityFree | 7 | encoder (GRU/Transformer), , , learning rate | numerical / closed form | 73,066 / 64,746 |
| Hyperparameter tuning | Replica runs | |||
|---|---|---|---|---|
| Dataset | Runs | GPU-h | Runs | GPU-h |
| Standard benchmarks | 396 | 144 | 370 | 73 |
| MIMIC-IV ICU | 28 | 4 | 75 | 156 |
| UK Biobank | 205 | 289 | 133 | 98 |
| Total | 629 | 437 | 578 | 327 |
| Model | Taxi | StackOverflow | Retweet | Amazon | Taobao |
|---|---|---|---|---|---|
| Poisson processes | |||||
| Homogeneous Poisson | |||||
| Spline Poisson | |||||
| Hawkes processes | |||||
| Const./Exp Hawkes | |||||
| Spline/Exp Hawkes | |||||
| Model | Taxi | StackOverflow | Retweet | Amazon | Taobao |
|---|---|---|---|---|---|
| Poisson processes | |||||
| Homogeneous Poisson | |||||
| Spline Poisson | |||||
| Hawkes processes | |||||
| Const./Exp Hawkes | |||||
| Spline/Exp Hawkes | |||||
| Model | Taxi | StackOverflow | Retweet | Amazon | Taobao |
|---|---|---|---|---|---|
| Poisson processes | |||||
| Homogeneous Poisson | |||||
| Spline Poisson | |||||
| Hawkes processes | |||||
| Const./Exp Hawkes | |||||
| Spline/Exp Hawkes | |||||
| Model | Taxi | StackOverflow | Retweet | Amazon | Taobao |
|---|---|---|---|---|---|
| Poisson processes | |||||
| Homogeneous Poisson | |||||
| Spline Poisson | |||||
| Hawkes processes | |||||
| Const./Exp Hawkes | |||||
| Spline/Exp Hawkes | |||||
| Model | Taxi | StackOverflow | Retweet | Amazon | Taobao |
|---|---|---|---|---|---|
| Poisson processes | |||||
| Homogeneous Poisson | |||||
| Spline Poisson | |||||
| Hawkes processes | |||||
| Const./Exp Hawkes | |||||
| Spline/Exp Hawkes | |||||
| Model | Taxi | StackOverflow | Retweet | Amazon | Taobao |
|---|---|---|---|---|---|
| Poisson processes | |||||
| Homogeneous Poisson | |||||
| Spline Poisson | |||||
| Hawkes processes | |||||
| Const./Exp Hawkes | |||||
| Spline/Exp Hawkes | |||||
| Model | Taxi | StackOverflow | Retweet | Amazon | Taobao |
|---|---|---|---|---|---|
| Poisson processes | |||||
| Homogeneous Poisson | |||||
| Spline Poisson | |||||
| Hawkes processes | |||||
| Const./Exp Hawkes | |||||
| Spline/Exp Hawkes | |||||
| Model | Acc (%) | Acc (%) | RMSE | ||||
|---|---|---|---|---|---|---|---|
| Poisson processes | |||||||
| Homogeneous Poisson | |||||||
| Spline Poisson | |||||||
| Hawkes processes | |||||||
| Const./Exp Hawkes | |||||||
| Spline/Exp Hawkes | |||||||
| Model | Acc (%) | Acc (%) | RMSE | ||||
|---|---|---|---|---|---|---|---|
| Poisson processes | |||||||
| Homogeneous Poisson | |||||||
| Spline Poisson | |||||||
| Hawkes processes | |||||||
| Const./Exp Hawkes | |||||||
| Spline/Exp Hawkes | |||||||
| Dataset | Encoder | |||
|---|---|---|---|---|
| Taxi | Transformer | |||
| GRU | ||||
| StackOverflow | Transformer | |||
| GRU | ||||
| Retweet | Transformer | |||
| GRU |
| Dataset | Recorded resolution | Bins | Tied (%) |
|---|---|---|---|
| Taxi | 1 s | 1 s, 10 s | 0.0 |
| StackOverflow | float32 ( ) | , | 0.5 |
| Retweet | integer time stamps | 1, 10 | 7.4 |
| Amazon | none (minimum gap 0.01) | 0.01, 0.1 | 0.0 |
| Taobao | gaps of | , | 0.0 |
| MIMIC-IV | 1 min (dequantized) | 1 min, 5 min | 0.0 |
| , continuous | binned | |||||
|---|---|---|---|---|---|---|
| Dataset | Model | to | recorded | coarser | centered | |
| Taxi | NeuralSplineTPP | 0.73 | -0.05 | -0.05 | -0.04 | -0.05 |
| Spline/Spline Hawkes | 0.49 | +0.01 | +0.01 | +0.01 | +0.01 | |
| StackOverflow | NeuralSplineTPP | -0.72 | -0.04 | -0.05 | -0.06 | -0.09 |
| Spline/Spline Hawkes | -0.73 | -0.03 | -0.04 | -0.04 | -0.04 | |
| Retweet | NeuralSplineTPP | -3.32 | +1.47 | -0.06 | +0.00 | -0.28 |
| Model | Taxi | StackOverflow | Retweet | Amazon | Taobao | MIMIC-IV |
|---|---|---|---|---|---|---|
| Poisson processes | ||||||
| Homogeneous Poisson | ||||||
| Spline Poisson | ||||||
| Hawkes processes | ||||||
| Const./Exp Hawkes | ||||||
| Spline/Exp Hawkes | ||||||
| Binned | Acc (%) | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Model | all | other | all | other | same | all | other | same | all | other | same |
| Homogeneous Poisson | |||||||||||
| Spline Poisson | |||||||||||
| Const./Exp Hawkes | |||||||||||
| Spline/Exp Hawkes | |||||||||||
| Const./Spline Hawkes | |||||||||||
| Taxi | StackOverflow | Retweet | Amazon | Taobao | MIMIC-IV | |
| NeuralSplineTPP | ||||||
| 10 | ||||||
| 20 | ||||||
| 50 | ||||||
| 100 | ||||||
| 200 | ||||||
| Spline/Spline Hawkes | NeuralSplineTPP | |||||||
|---|---|---|---|---|---|---|---|---|
| #params | Acc (%) | #params | Acc (%) | |||||
| 10 | 148,591 | 77,220 | ||||||
| 20 | 285,481 | 154,440 | ||||||
| 50 | 696,151 | 386,100 | ||||||
| 100 | 1,380,601 | 772,200 | ||||||
| 200 | 2,749,501 | 1,544,400 | ||||||
| Model | Acc (%) | ||||
| Spline/Exp Hawkes | – | 1 | |||
| + NS kernel | – | 5 | |||
| Spline/Spline Hawkes + NS kernel | 12 | 3 | |||
| Spline/Spline Hawkes + NS kernel | 12 | 5 | |||
| Spline/Spline Hawkes | 20 | 1 | |||
| + NS kernel | 20 | 3 |
| Model (KS / ECE) | Taxi | StackOverflow | Retweet | Amazon | Taobao | MIMIC-IV |
|---|---|---|---|---|---|---|
| Const./Exp Hawkes | .151 / .274 | .033 / .023 | .060 / .008 | .267 / .045 | .063 / .022 | .315 / .040 |
| Spline/Spline Hawkes | .128 / .221 | .027 / .025 | .111 / .021 | .137 / .018 | .035 / .020 | .176 / .056 |
| NeuralConstTPP | .057 / .007 | .066 / .024 | .048 / .021 | .344 / .012 | .343 / .015 | .395 / .031 |
| NeuralSplineTPP | .040 / .008 | .009 / .027 | .083 / .009 | .025 / .015 | .037 / .016 | .021 / .024 |
Temporal Point Processes
Temporal point processes model the timing, types, and dependencies of events occurring irregularly over time.
See all 38 papers