Graph Representation via Elements of Discrete Morse and Cobordism Theories
Organizations: Department of Mathematics; University of Texas, Austin · Department of Statistics; University of California, Riverside · Department of Statistics; Virginia Tech
Abstract
Topology is, by its nature and design, suited to structure that is nonlinear, multiscale, and nonstationary - however, within machine learning, its use remains largely confined to topological data analysis. We advocate that tools from low-dimensional topology which have remained almost exclusively contained within the domain of pure mathematics (such as Morse theory) offer a strong, complementary, and yet virtually unexplored perspective on the hidden structure of data-generating processes and learning tasks built upon them. Here we introduce concepts from cobordism theory and harness tools from discrete Morse theory to improve the performance of graph diffusion models through our pipeline MG-Diff. Further, we derive theoretical guarantees and sufficient conditions so that under a positive decision-gap, the Morse-theoretic tools and their application for induced diffusion guidance are stable under small perturbations. Finally, we illustrate the utility of discrete Morse theory in application to graph diffusion models for spatio-temporal graph forecasting and graph regeneration, and argue that these applications are only a small window into the part of what low-dimensional topology can offer to the field of machine learning.
Figures & tables
| Method | Data | PEMS-03 | PEMS-BAY | AIR-BJ | AIR-GZ | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Metric | MAE | RMSE | CRPS | MAE | RMSE | CRPS | MAE | RMSE | CRPS | MAE | RMSE | CRPS | |
| TimeGrad | 21.55 | 36.57 | 0.101 | 2.62 | 5.30 | 0.034 | 33.40 | 54.93 | 0.363 | 15.45 | 21.93 | 0.376 | |
| MC Dropout | 18.87 | 29.81 | 0.093 | 3.50 | 5.43 | 0.040 | 37.92 | 55.49 | 0.391 | 13.10 | 19.26 | 0.290 | |
| CSDI | 23.46 | 39.60 | 0.098 | 2.67 | 4.10 | 0.031 | 38.94 | 57.81 | 0.417 | 14.78 | 22.24 | 0.361 | |
| DiffSTG | 17.58 | 28.75 | 0.095 | 2.03 | 4.22 | 0.025 | 38.03 | 56.87 | 0.373 | 13.06 | 18.25 | 0.319 | |
| PriSTI | 22.30 | 37.58 | 0.092 | 2.51 | 3.99 | 0.026 | 36.81 | 54.34 | 0.388 | 14.04 | 21.03 | 0.352 | |
| Method | Degree | Clus. |
|---|---|---|
| GDSS | 0.0373 | 0.0723 |
| DiGress | 0.0899 | 0.1920 |
| GraphVAE-MM | 0.0587 | 0.3560 |
| HOG-Diff | 0.4700 | 0.3650 |
| CoPHo | 0.0523 | 0.0911 |
| SwinGNN | 0.00366 | 0.0862 |
Appendix figures & tables20 assets
Supplementary material from the paper’s appendix.
Appendix
| Symbol | Meaning |
|---|---|
| Graphs and complexes | |
| Simple graph: vertices , edges , node features | |
| Number of vertices and edges | |
| Degree of vertex ; | |
| Finite simplicial / regular CW complex | |
| Clique complex of (simplices cliques of ) | |
| Method | Topological signal | DMT | Persistence | Domain | Task |
|---|---|---|---|---|---|
| TAGG [ 53 ] | PH (diagram-matching loss, attention) | No | full | abstract graph | graph generation (diffusion) |
| TopoDiffusionNet [ 26 ] | PH (Betti number) | No | full | image/cubical | image generation (diffusion) |
| Prob. Topo. Rep. [ 34 ] | DMT+PH | Yes | prunes Morse complex | image likelihood field | segmentation (reconstruction) |
| Dey–Wang–Wang [ 19 ] | DMT+PH | Yes | prunes Morse complex | density field | graph/curve reconstruction |
| TOGL [ 31 ] | PH (learned filtration) | No | full | abstract graph | classification |
| PDGNN [ 73 ] | PH (EPD surrogate) | No | full | abstract graph | classification |
| Edge | Pairing | |
|---|---|---|
| 0.078 | ||
| 0.222 | ||
| 0.421 | ||
| 0.554 | ||
| 0.756 | ||
| 0.831 |
| Dataset | # Node | # Time Step | Granularity | Attribute |
|---|---|---|---|---|
| PEMS-03 | 358 | 26,208 | 5 min | Flow |
| PEMS-BAY | 325 | 52,116 | 5 min | Speed |
| AIR-BJ | 36 | 8,760 | 1 hour | PM2.5 |
| AIR-GZ | 42 | 8,760 | 1 hour | PM2.5 |
| Architecture | MAE | CRPS | ||
|---|---|---|---|---|
| PEMS-03 | AIR-BJ | PEMS-03 | AIR-BJ | |
| MG-Diff | 15.67 | 29.91 | 0.077 | 0.290 |
| MG-Diff W/o MoMoE | 16.20 | 30.22 | 0.082 | 0.348 |
| MG-Diff W/o MDDN | 16.56 | 30.83 | 0.234 | 0.534 |
| Method | PEMS-03 | AIR-BJ |
|---|---|---|
| MG-Diff | 15.67 | 29.91 |
| MG-Diff w. deg. | 16.20 | 30.22 |
| MG-Diff w. bet. | 16.56 | 30.83 |
| Method | Clean AIR-GZ | Noisy AIR-GZ | ||
|---|---|---|---|---|
| MAE | RMSE | MAE | RMSE | |
| USTD | 9.99 | 15.41 | 10.72 | 15.71 |
| MG-Diff (Ours) | 9.80 | 15.07 | 10.25 | 15.26 |
| PEMS-03 | PEMS-BAY | AIR-BJ | AIR-GZ | |
|---|---|---|---|---|
| MG-Diff | 136 | 67.5 | 1 | 1 |
| Conditioning skeleton | MAE | RMSE | MAPE | CRPS |
|---|---|---|---|---|
| Random skeleton (matched size) | 10.19767 0.00002 | 15.46738 0.00003 | 0.41979 0.00000 | 0.25223 0.00105 |
| Morse, | 9.72684 0.00000 | 15.20191 0.00003 | 0.38107 0.00000 | 0.23853 0.00084 |
| Morse, | 10.44039 0.00004 | 15.30176 0.00003 | 0.46580 0.00000 | 0.24502 0.00112 |
| Morse, (Ours) | 9.58643 0.00001 | 14.92188 0.00002 | 0.38942 0.00000 | 0.23099 0.00108 |
| Method | Degree | Wavelet | Spec. | Clus. | Orbit |
|---|---|---|---|---|---|
| DiGress | 0.000374 | 0.00567 | 0.0175 | 0 | 0.000611 |
| DeFoG | 0.000349 | 0.00517 | 0.0149 | 0 | 0.000335 |
| BWFlow | 0.003180 | 0.01920 | 0.0300 | 0 | 0.000840 |
| MG-Diff (Ours) | 0.000204 | 0.00500 | 0.0112 | 0 | 0.000175 |
| #Nodes | #Edges | Construction time (s) | Start memory (MB) | End memory (MB) |
|---|---|---|---|---|
| 1,000 | 1,333 | 0.0049 | 666.00 | 666.00 |
| 5,000 | 13,530 | 0.0333 | 666.64 | 666.64 |
| 10,000 | 44,175 | 0.0912 | 666.89 | 666.89 |
| 25,000 | 353,582 | 0.6185 | 666.90 | 666.90 |
| 50,000 | 669,889 | 1.1644 | 670.53 | 680.37 |
| 169,343 | 1,157,799 | 2.2019 | 681.35 | 706.65 |
| Corruption | Rate | MG-Diff (Ours) | USTD | ||||
|---|---|---|---|---|---|---|---|
| MAE | RMSE | CRPS | MAE | RMSE | CRPS | ||
| Clean | 0% | 10.259 | 15.201 | 0.2452 | 10.725 | 15.713 | 0.2750 |
| Missing events | 5% | 10.449 | 15.458 | 0.2508 | 11.271 | 16.196 | 0.2938 |
| Missing events | 10% | 10.815 | 15.837 | 0.2612 | 11.936 | 16.725 | 0.3174 |
| Missing events | 20% | 12.132 | 16.945 | 0.2953 | 13.628 | 18.073 | 0.3718 |
| Degradation at 5% | |||||||
| Method | Degree | Wavelet | Spec. | Clus. | Orbit |
|---|---|---|---|---|---|
| DiGress | 0.000374 | 0.00567 | 0.0175 | 0 | 0.000611 |
| DeFoG | 0.000349 | 0.00517 | 0.0149 | 0 | 0.000335 |
| BWFlow | 0.003180 | 0.01920 | 0.0300 | 0 | 0.000840 |
| MG-Diff (Ours) | 0.000204 | 0.00500 | 0.0112 | 0 | 0.000175 |