Where Do Two Populations of Persistence Diagrams Differ? Calibrated Local Inference at a Fixed Budget
Organizations: The George Washington University · Montana Technological University · University of Ljubljana
Abstract
Many two-sample tests for populations of persistence diagrams assess global differences without identifying the regions of the birth-death plane that contribute to them. We study simultaneous inference for local mean contrasts when the number of available diagrams is fixed. They are differences in expected weighted feature mass within neighborhoods at several centers and radii. We estimate these contrasts using additive landmark responses. A Gaussian multiplier bootstrap calibrates simultaneous confidence intervals while allowing unequal group covariances. The neighborhoods whose intervals exclude zero form a map with approximate family-wise error control, and selecting a subset of original intervals for display preserves their joint coverage guarantee. On the simultaneous coverage event, every reported neighborhood lies within twice its radius of the support of the mean-measure difference. A geometric result gives sufficient radius conditions for a displaced feature to produce a nonzero contrast. A comparison of sufficient detection thresholds quantifies the tradeoff between reducing the number of tested coordinates and reserving observations for an independent pilot. In simulations with 40 to 120 diagrams per class, the bands achieved 94%-98% simultaneous coverage under both the strict null and equal means with unequal covariances. In the latter setting, a permutation maximum and the pooled-t implementation of the two-stage persistence-image test of Moon and Lazar rejected in up to 32% and 26% of runs, respectively. In the fixed-budget simulations, spending a third of the observations on a pilot to choose landmarks or radii located changes less often than a prespecified grid at a single radius. On the MUTAG benchmark, the localized region concentrates on rings of fused-ring systems, an exploratory reading.
Figures & tables
| design | / | F0 | F1 | F2 | A1 | A2 | F1-perm | I1 | ML |
|---|---|---|---|---|---|---|---|---|---|
| strict null | 40/40 | 0.032 | 0.033 | 0.036 | 0.055 | 0.047 | 0.039 | 0.027 | 0.019 |
| strict null | 80/80 | 0.035 | 0.048 | 0.046 | 0.046 | 0.044 | 0.053 | 0.048 | 0.026 |
| strict null | 120/120 | 0.040 | 0.043 | 0.051 | 0.057 | 0.049 | 0.042 | 0.041 | 0.020 |
| strict null | 40/120 | 0.033 | 0.054 | 0.036 | 0.038 | 0.034 | 0.059 | 0.042 | 0.032 |
| clustered | 80/80 | 0.063 | 0.054 | 0.059 | 0.052 | 0.052 | 0.051 | 0.057 | 0.038 |
| clustered | 120/40 | 0.047 | 0.041 | 0.062 | 0.052 | 0.057 | 0.324 | 0.038 | 0.262 |
Appendix figures & tables25 assets
Supplementary material from the paper’s appendix.
Appendix
| design | F0 | F1 | F2 | A1 | A2 | F1-perm | I1 | ML | |||
|---|---|---|---|---|---|---|---|---|---|---|---|
| shift-pers | 40 | 40 | 0.0 | 0.97 | 0.97 | 0.96 | 0.94 | 0.95 | – | 0.97 | – |
| shift-pers | 80 | 80 | 0.0 | 0.96 | 0.95 | 0.95 | 0.95 | 0.96 | – | 0.95 | – |
| shift-pers | 120 | 120 | 0.0 | 0.96 | 0.96 | 0.95 | 0.94 | 0.95 | – | 0.96 | – |
| shift-pers | 40 | 120 | 0.0 | 0.97 | 0.95 | 0.96 | 0.96 | 0.97 | – | 0.96 | – |
| wn-cluster | 80 | 80 | 0.0 | 0.94 | 0.95 | 0.94 | 0.95 | 0.95 | – | 0.94 | – |
| wn-cluster | 120 | 40 | 0.0 | 0.95 | 0.96 | 0.94 | 0.95 | 0.94 | – | 0.96 | – |
| F0 | F1 | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| design | / | fixed | group | pooled | fixed | group | pooled | hyb. 1% | hyb. 0.5% |
| strict null | 40/40 | 0.032 | 0.034 | 0.014 | 0.033 | 0.040 | 0.010 | 0.063 | 0.047 |
| strict null | 80/80 | 0.035 | 0.032 | 0.012 | 0.048 | 0.040 | 0.016 | 0.061 | 0.041 |
| strict null | 120/120 | 0.040 | 0.029 | 0.024 | 0.043 | 0.034 | 0.023 | 0.042 | 0.035 |
| strict null | 40/120 | 0.033 | 0.375 | 0.022 | 0.054 | 0.392 | 0.007 | 0.160 | 0.341 |
| clustered | 80/80 | 0.063 | 0.035 | 0.021 | 0.054 | 0.034 | 0.019 | 0.067 | 0.045 |
| F0 | F1 | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| design | fixed | group | pooled | fixed | group | pooled | hyb. 1% | hyb. 0.5% | ||
| unequal variances | 40 | 0.05 | 0.00 | 1.00 | 1.00 | 0.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| unequal variances | 40 | 0.10 | 0.00 | 1.00 | 1.00 | 0.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| unequal variances | 80 | 0.05 | 0.00 | 1.00 | 1.00 | 0.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| unequal variances | 80 | 0.10 | 0.00 | 1.00 | 1.00 | 0.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| unequal variances | 120 | 0.05 | 0.00 | 1.00 | 1.00 | 0.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| design | F0 | F1 | F2 | A1 | A2 | F1-perm | I1 | ML | |||
|---|---|---|---|---|---|---|---|---|---|---|---|
| shift-pers | 40 | 40 | 0.05 | 0.77 | 0.19 | 0.29 | 0.10 | 0.17 | 0.19 | 0.10 | 0.07 |
| shift-pers | 40 | 40 | 0.1 | 0.85 | 0.60 | 0.49 | 0.40 | 0.47 | 0.61 | 0.44 | 0.36 |
| shift-pers | 40 | 40 | 0.15 | 0.97 | 0.79 | 0.64 | 0.52 | 0.57 | 0.80 | 0.62 | 0.58 |
| shift-pers | 80 | 80 | 0.05 | 0.98 | 0.58 | 0.72 | 0.27 | 0.39 | 0.59 | 0.31 | 0.25 |
| shift-pers | 80 | 80 | 0.1 | 1.00 | 0.97 | 0.90 | 0.78 | 0.80 | 0.98 | 0.87 | 0.85 |
| shift-pers | 80 | 80 | 0.15 | 1.00 | 1.00 | 0.96 | 0.87 | 0.88 | 1.00 | 0.96 | 0.96 |
| design | F0 | F1 | F2 | A1 | A2 | F1-perm | I1 | ML | |||
|---|---|---|---|---|---|---|---|---|---|---|---|
| shift-pers | 40 | 40 | 0.05 | 0.023 | 0.030 | 0.019 | 0.034 | 0.025 | 0.034 | 0.000 | 0.003 |
| shift-pers | 40 | 40 | 0.1 | 0.025 | 0.026 | 0.026 | 0.029 | 0.022 | 0.027 | 0.004 | 0.008 |
| shift-pers | 40 | 40 | 0.15 | 0.015 | 0.037 | 0.030 | 0.035 | 0.030 | 0.040 | 0.001 | 0.004 |
| shift-pers | 80 | 80 | 0.05 | 0.016 | 0.016 | 0.018 | 0.035 | 0.029 | 0.017 | 0.005 | 0.006 |
| shift-pers | 80 | 80 | 0.1 | 0.027 | 0.033 | 0.018 | 0.028 | 0.025 | 0.036 | 0.003 | 0.010 |
| shift-pers | 80 | 80 | 0.15 | 0.023 | 0.026 | 0.023 | 0.030 | 0.027 | 0.025 | 0.001 | 0.013 |
| variant | design | F0 | F1 | F2 | A1 | A2 | F1-perm | I1 | ML | |||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| baseline | shift-pers | 80 | 80 | 0.1 | 1.00 | 0.96 | 0.91 | 0.80 | 0.82 | 0.96 | 0.87 | 0.84 |
| q=0.25 | shift-pers | 80 | 80 | 0.1 | 0.53 | 0.25 | 0.18 | 0.14 | 0.18 | 0.26 | 0.16 | 0.13 |
| q=1 | shift-pers | 80 | 80 | 0.1 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| eps=0.01 | shift-pers | 80 | 80 | 0.1 | 1.00 | 0.99 | 0.97 | 0.87 | 0.89 | 0.99 | 0.94 | 0.95 |
| eps=0.04 | shift-pers | 80 | 80 | 0.1 | 0.39 | 0.59 | 0.31 | 0.34 | 0.33 | 0.59 | 0.41 | 0.34 |
| delta=0.05 | shift-pers | 80 | 80 | 0.05 | 1.00 | 0.58 | 0.75 | 0.28 | 0.37 | 0.58 | 0.31 | 0.24 |
| variant | design | F0 | F1 | F2 | A1 | A2 | F1-perm | I1 | ML | F0-permHolm | I1-permHolm | I1_10 | I1_20 | I1_20-permHolm | I1_40 | ML_10 | ML_20 | ML_40 | |||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| f=1/4 | shift-pers | 80 | 80 | 0.0 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | – | – | – | – | – | – | – | – | – |
| f=1/4 | shift-pers | 80 | 80 | 0.1 | 1.00 | 0.96 | 0.90 | 0.87 | 0.88 | 0.96 | 0.87 | 0.85 | – | – | – | – | – | – | – | – | – |
| f=1/3 | shift-pers | 80 | 80 | 0.0 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | – | – | – | – | – | – | – |
| f=1/3 | shift-pers | 80 | 80 | 0.1 | 1.00 | 0.96 | 0.88 | 0.75 | 0.79 | 0.95 | 0.87 | 0.85 | 0.97 | 0.64 | – | – | – | – | – | – | – |
| f=1/2 | shift-pers | 80 | 80 | 0.0 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | – | – | – | – | – | – | – | – | – |
| f=1/2 | shift-pers | 80 | 80 | 0.1 | 1.00 | 0.96 | 0.78 | 0.56 | 0.65 | 0.96 | 0.87 | 0.85 | – | – | – | – | – | – | – | – | – |
| Method | Null FWER | Power, | Power, | Coverage, |
|---|---|---|---|---|
| All radii jointly | 5.5 | 25.9 | 69.8 | 92.7 |
| Pilot: radius | 8.2 | 10.3 | 41.6 | 93.9 |
| Pilot: region and radius | 5.1 | 3.2 | 70.8 | 94.7 |
| Cross-fitted: radius | 6.9 | 8.1 | 39.4 | 91.4 |
| Cross-fitted: region and radius | 6.5 | 4.5 | 82.6 | 93.3 |
| Oracle region | 5.4 | 58.2 | 98.1 | 93.9 |
| F0 | F1 | F2 | A1 | A2 | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| dataset | filtration | deg. | / | loc. | loc. | loc. | loc. | loc. | |||||
| MUTAG | HKS | 1 | 63/112 | 1 | 0.024 | 3 | 0.005 | 1 | 0.001 | 58 | 0.001 | 26 | 0.001 |
| MUTAG | HKS | 0 | 63/112 | 2 | 0.001 | 7 | 0.001 | 2 | 0.001 | 116 | 0.001 | 58 | 0.001 |
| COX2 | HKS | 1 | 363/102 | 0 | 0.262 | 1 | 0.015 | 0 | 0.123 | 0 | 0.252 | 0 | 0.383 |
| DHFR | HKS | 1 | 269/449 | 1 | 0.001 | 4 | 0.001 | 1 | 0.001 | 20 | 0.001 | 7 | 0.001 |
| COX2 | HKS | 0 | 363/102 | 0 | 0.337 | 0 | 0.381 | 0 | 0.317 | 8 | 0.020 | 1 | 0.019 |
| dataset | filtration | deg. | method | empty | overlap | matched | loc. (median) |
|---|---|---|---|---|---|---|---|
| MUTAG | HKS | 1 | F2 | 2/20 | 1.00 | 0.89 | 1.0 |
| MUTAG | HKS | 1 | A1 | 0/20 | 0.62 | 0.97 | 50.5 |
| MUTAG | HKS | 1 | A2 | 0/20 | 0.65 | 0.97 | 23.5 |
| MUTAG | HKS | 0 | F2 | 0/20 | 0.66 | 0.93 | 2.0 |
| MUTAG | HKS | 0 | A1 | 0/20 | 0.59 | 1.00 | 57.0 |
| MUTAG | HKS | 0 | A2 | 0/20 | 0.20 | 0.93 | 14.5 |
| dataset | per class | method | any localized | loc. (median) | overlap with full map |
|---|---|---|---|---|---|
| DHFR | 40 | A1 | 0.28 | 0.0 | 0.00 |
| DHFR | 40 | A2 | 0.28 | 0.0 | 0.00 |
| DHFR | 40 | F1 | 0.30 | 0.0 | 0.00 |
| DHFR | 80 | A1 | 0.52 | 1.0 | 0.07 |
| DHFR | 80 | A2 | 0.58 | 1.0 | 0.02 |
| DHFR | 80 | F1 | 0.48 | 0.0 | 0.00 |
| map | cycle basis | localized | rings in -fused systems in region | other rings in region |
|---|---|---|---|---|
| A1 | minimum cycle basis | 58 | 331/346 (0.96) | 68/140 (0.49) |
| A1 | cycle basis | 58 | 297/312 (0.95) | 68/140 (0.49) |
| F1 | minimum cycle basis | 3 | 7/346 (0.02) | 24/140 (0.17) |
| F1 | cycle basis | 3 | 7/312 (0.02) | 24/140 (0.17) |
| dataset | filtration | recovery | top agree | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| COX2 | hks_t1 | 196 | 3.92 | 3.23 | 0.0076 | 14 | 14 | 26 | 0.42 | 0.80 | ||
| COX2 | hks_t1 | 196 | 3.11 | 3.32 | 0.0820 | 0 | 0 | 0 | 0.40 | 1.00 | ||
| COX2 | hks_t10 | 182 | 3.73 | 4.27 | 0.1144 | 0 | 0 | 2 | 0.12 | 0.00 | ||
| COX2 | hks_t10 | 168 | 7.83 | 6.78 | 0.0268 | 1 | 3 | 9 | 0.34 | 0.65 | ||
| COX2 | ricci | 164 | 4.19 | 4.07 | 0.0418 | 1 | 1 | 1 | 0.28 | 0.60 | ||
| COX2 | ricci | 192 | 3.96 | 3.18 | 0.0048 | 2 | 2 | 2 | 0.35 | 0.55 |
| placement | cover | FWER boot | FWER Bonf | / | |||
|---|---|---|---|---|---|---|---|
| FPS | 50 | 20 | 0.978 | 0.022 | 0.070 | 3.64 / 3.29 | |
| FPS | 50 | 60 | 0.970 | 0.030 | 0.054 | 3.47 / 3.29 | |
| FPS | 100 | 20 | 0.984 | 0.016 | 0.086 | 3.84 / 3.48 | |
| FPS | 100 | 60 | 0.952 | 0.048 | 0.082 | 3.62 / 3.48 | |
| FPS | 200 | 20 | 0.988 | 0.012 | 0.086 | 4.15 / 3.66 | |
| FPS | 200 | 60 | 0.968 | 0.032 | 0.056 | 3.86 / 3.66 |
| arm | scale | / | cover | FWER boot | FWER Bonf | FWER perm | power 0.2 | ||
|---|---|---|---|---|---|---|---|---|---|
| FPS in-sample | sample | 49 | 20 / 20 | – | 0.042 | 0.036 | – | 0.87 | 3.16 |
| FPS in-sample | sample | 49 | 60 / 60 | – | 0.044 | 0.030 | – | 0.98 | 3.23 |
| FPS in-sample | sample | 99 | 20 / 20 | – | 0.068 | 0.040 | – | 0.96 | 3.33 |
| FPS in-sample | sample | 99 | 60 / 60 | – | 0.028 | 0.026 | – | 1.00 | 3.41 |
| FPS in-sample | sample | 199 | 20 / 20 | – | 0.060 | 0.032 | – | 1.00 | 3.49 |
| FPS in-sample | sample | 199 | 60 / 60 | – | 0.026 | 0.022 | – | 1.00 | 3.57 |
| placement | cover | power boot | power Bonf | power BH | FDR BH | FDR boot | loc. err. | |||
|---|---|---|---|---|---|---|---|---|---|---|
| FPS | 50 | 0.10 | 20 | 0.970 | 0.46 | 0.54 | 0.55 | 0.025 | 0.006 | 0.073 |
| FPS | 50 | 0.10 | 60 | 0.976 | 0.99 | 0.99 | 1.00 | 0.020 | 0.005 | 0.043 |
| FPS | 50 | 0.30 | 20 | 0.974 | 0.08 | 0.15 | 0.15 | 0.021 | 0.013 | 0.108 |
| FPS | 50 | 0.30 | 60 | 0.966 | 0.49 | 0.56 | 0.58 | 0.027 | 0.013 | 0.075 |
| FPS | 399 | 0.10 | 20 | 0.994 | 0.95 | 0.99 | 0.99 | 0.040 | 0.000 | 0.007 |
| FPS | 399 | 0.10 | 60 | 0.974 | 1.00 | 1.00 | 1.00 | 0.034 | 0.002 | 0.006 |
| FWER, | power, | power, | |||||||
|---|---|---|---|---|---|---|---|---|---|
| map | boot | perm | boot | perm | boot | perm | loc. err. | ||
| image pixels | 63 | 20 | 0.044 | 0.052 | 0.09 | 0.10 | 0.33 | 0.34 | 0.118 |
| image pixels | 63 | 60 | 0.042 | 0.042 | 0.35 | 0.35 | 0.90 | 0.90 | 0.084 |
| image pixels | 111 | 20 | 0.066 | 0.084 | 0.15 | 0.19 | 0.52 | 0.57 | 0.065 |
| image pixels | 111 | 60 | 0.046 | 0.050 | 0.67 | 0.70 | 0.99 | 0.99 | 0.039 |
| image pixels | 189 | 20 | 0.018 | 0.052 | 0.23 | 0.30 | 0.66 | 0.74 | 0.052 |
| 0 | 0.025 | 0.05 | 0.075 | 0.1 | 0.15 | 0.2 | 0.3 | |
| persistence regime | ||||||||
| band (max-t, bootstrap) | 0.02 | 0.05 | 0.40 | 0.66 | 0.77 | 0.82 | 0.87 | 0.81 |
| embedding MMD (permutation) | 0.05 | 0.09 | 0.43 | 0.69 | 0.76 | 0.83 | 0.88 | 0.87 |
| STRAND (diagram perm.) | 0.05 | 0.05 | 0.05 | 0.06 | 0.08 | 0.06 | 0.08 | 0.13 |
| STRAND (pooled asympt.) | 0.05 | 0.05 | 0.05 | 0.06 | 0.07 | 0.07 | 0.09 | 0.15 |
| landscape MMD | 0.07 | 0.06 | 0.03 | 0.04 | 0.07 | 0.03 | 0.07 | 0.07 |
| pilot scale | sample scale | |||||||
|---|---|---|---|---|---|---|---|---|
| design | placement | / | band | Bonf. | perm | band | perm | |
| clustered | FPS | 100 | 20 / 20 | 0.032 | 0.024 | 0.042 | 0.252 | 0.201 |
| clustered | FPS | 100 | 20 / 60 | 0.041 | 0.028 | 0.000 | 0.090 | 0.024 |
| clustered | FPS | 100 | 60 / 20 | 0.048 | 0.035 | 0.178 | 0.343 | 0.184 |
| clustered | FPS | 400 | 20 / 20 | 0.039 | 0.014 | 0.048 | 0.283 | 0.219 |
| clustered | FPS | 400 | 20 / 60 | 0.057 | 0.010 | 0.001 | 0.121 | 0.024 |