Structure-Aware Message Passing on Petri Nets through Directed Walks and Incidence Diffusion
Organizations: HASH
Abstract
A common application of the process mining discipline is to connect observed event data with Petri nets, which are bipartite, directed graphical process models with rich formal underpinnings. Recent work learns vector representations of Petri nets to retrieve process models and relate them to event logs, but leaves implicit two key aspects hidden within the net's structure: directed cycles (process loops) and invariants recorded by the net's incidence matrix. We expose both of these to message-passing graph neural networks, through a positional encoding built from return probabilities of directed place-transition walks (PNRWPE), and through same-type messages gated by diffusion kernels of the incidence matrix (DA-PNGNN). Our constructions raise macro balanced accuracy in predicting the generation factors of the 96 Process Discovery Contest 2023 models from 0.751 to 0.796 with PNRWPE, which nearly doubles accuracy on process loops, and to 0.830 with DA-PNGNN, which, without retuning, also improves net-to-tree retrieval top-1 accuracy on the self-supervised ProcRosetta benchmark by 4.1 to 5.9 points.
Figures & tables
| Model | Macro BA | BA on B, loops |
|---|---|---|
| Shallow embeddings observing every factor | ||
| PetriNet2Vec | ||
| PetriNet2Vec + pooled PNRWPE | ||
| 1-NN readout on a fixed descriptor, without activity labels | ||
| Structural statistics | ||
| Pooled PNRWPE | ||
| Decoding from | Embedding | Loss | ||||
| Encoder | Exact | Edit | L1 | NN | N T | |
| Paper setting (acyclic nets) | ||||||
| Original study, seed 13 | 35.9 | 0.282 | 0.839 | 0.574 | 0.913 | 0.837 |
| PNGNN | 35.9 0.3 | 0.278 0.003 | 0.833 0.010 | 0.593 0.010 | 0.935 0.008 | 0.845 0.004 |
| + PNRWPE | 35.9 0.2 | 0.276 0.003 | 0.828 0.007 | 0.584 0.017 | 0.932 0.003 | 0.842 0.004 |
| + PNRWPE, shuffled | 36.0 0.3 | 0.278 0.003 | 0.840 0.006 | 0.566 0.021 | 0.939 0.008 | 0.849 0.005 |
| Retrieval top-1 (%) | ||||
| Encoder | N T | T N | N L | L N |
| Paper setting (acyclic nets) | ||||
| Original study, seed 13 | 34.2 | 44.3 | 15.4 | 14.1 |
| PNGNN | 34.6 1.3 | 45.0 1.1 | 14.5 1.1 | 13.5 0.9 |
| + PNRWPE | 36.0 1.2 | 45.6 1.6 | 14.7 1.4 | 13.4 0.6 |
| + PNRWPE, shuffled | 33.3 0.9 | 43.8 1.2 | 13.8 1.0 | 12.9 0.7 |
| Setting | Encoding | All-zero | Constant | Colliding | Distinct | 1st dir. |
|---|---|---|---|---|---|---|
| Paper | original | 4.0 | ||||
| teleport, | 12.3 | |||||
| teleport, | 12.3 | |||||
| Loops | original | 7.6 | ||||
| teleport, | 15.8 | |||||
| teleport, | 15.8 |
Appendix figures & tables8 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | Node input or variant | Seeds |
| PDC 2023: supervised factor prediction and the PetriNet2Vec setting | ||
| PNGNN | no PE; PNRWPE ( ); PNRWPE shuffled within type or across nodes | 0-9 |
| PNGNN | undirected RWPE (16 or 32 steps); out-degree | 0-9 |
| DA-PNGNN | linear or tanh gate, sum aggregation, rescaled kernels; real or zero kernels; no PE or PNRWPE | 0-9 |
| Depth | PNGNN, DA-PNGNN (linear gate), and DA-PNGNN + PNRWPE at 1 to 5 message-passing rounds | 0-9 |
| Paired comparison (first second) | Over 10 seeds |
|---|---|
| PNGNN + PNRWPE PNGNN | |
| PNGNN + PNRWPE same, shuffled across nodes | |
| PNGNN + PNRWPE same, shuffled within type | |
| PetriNet2Vec + pooled PNRWPE PetriNet2Vec | |
| Fusion: own another net’s descriptor | |
| DA-PNGNN, linear PNGNN |
| PNGNN | DA-PNGNN | DA-PNGNN + PNRWPE | |
| Macro BA | |||
| 1 | |||
| 2 | |||
| 3 | |||
| 4 | |||
| 5 | |||
| Model | s / epoch | s / run | Epochs | Peak memory (MB) |
|---|---|---|---|---|
| PNGNN | 82 | |||
| DA-PNGNN, linear | 159 | |||
| DA-PNGNN, tanh | 1363 |
| Comparison (first second) | Exact (pp) | L1 | N T (pp) | T N (pp) | Loss | |
|---|---|---|---|---|---|---|
| Paper setting, | ||||||
| Teleport no PE | ||||||
| Teleport original | ||||||
| Teleport shuffled | ||||||
| Shuffled no PE | ||||||
| DA + teleport DA | ||||||
Representation Learning
Representation learning develops data transformations that expose useful structure for prediction, transfer, generation, and control.
See all 798 papers