High-dimensional nonparametric changepoint detection via low-rank degree-two density projection
Authors: Guoqing Zhang, Zhaixin Chen
Organizations: Operations Research Program North Carolina State University Raleigh, NC, USA · H. Milton Stewart School of ISyE Georgia Institute of Technology Atlanta, GA, USA
Detecting distributional changes in high dimension is difficult when neither the pre-change nor post-change density is parametrically specified. We introduce a representation-based approach that retains all degree-at-most-two density information while replacing density estimation by matrix mean estimation. For observations in [−1,1]d, a symmetric feature matrix H2(X)∈R(d+1)×(d+1) is constructed so that M(f)=\EfH2(X) is an isometric encoding of the degree-two orthogonal projection of the density. We scan matrix CUSUMs after rank-r truncation, exploiting the low rank of the projected jump rather than sparsity of individual coordinates. The resulting \LRD{} estimator has a tent-shaped population objective and a nonasymptotic operator-norm analysis whose leading stochastic term scales as rdlog(nd). For multiple changes, we give a seeded narrowest-over-threshold procedure and prove exact recovery by an induction that preserves an isolating interval for every undetected change. A cross-fitted scalar refinement learns the changing low-rank direction on one fold and localizes on the other, attaining O\Pp(κ−2) error; a matching Le Cam lower bound shows optimality up to logarithms. A geometrically β-mixing extension follows from a dependent matrix Bernstein inequality. Experiments with ambient dimension up to 200, a three-change d=100 sequence, and a 128-feature human-activity benchmark show that the method remains computationally practical and accurately detects pure dependence changes that are invisible to mean CUSUMs.
Figures & tables
Figure 1: Population and empirical rank-two degree-two CUSUM scores for one d=100 Gaussian-copula change. Coordinate means and marginal distributions are unchanged; only the dependence of the first two coordinates changes.
d
LR-D2 pre.
LR-D2 ref.
Full D2
Mean
Oracle
20
6
11
19
419
4
50
6
10
16
684
4
100
7
8
41
1416
6
200
4
4
96
3166
4
Table 1: Median absolute localization error over 50 single-change replications. “Full D2” uses the Frobenius norm without rank truncation; “Oracle” knows the affected interaction.
Figure 2: Median single-change error versus ambient dimension. Sample size scales as n=60d . The low-rank estimator remains stable through d=200 , while the full degree-two and mean scans accumulate high-dimensional noise.
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
d
n
Method
Median
Mean (SD)
P≤4
P0
20
1200
Full D2
19
44.44 (79.17)
0.24
0.10
20
1200
LR-D2 preliminary
6
38.80 (100.13)
0.46
0.20
20
1200
LR-D2 refined
11
31.68 (66.57)
0.40
0.18
20
1200
Mean CUSUM
419
355.08 (131.02)
0.00
0.00
20
1200
Oracle
4
9.68 (12.78)
0.56
0.28
50
3000
Full D2
16
76.76 (167.82)
0.26
0.08
Appendix
Table 2: Complete single-change summary over 50 replications. P≤4 is the proportion with absolute error at most four and P0 is exact recovery.
d
n
K
P(K=K)
Med. pre.
Mean pre.
Med. ref.
Mean ref.
100
24000
3
1.00
2.0
3.5
1.0
1.67
Appendix
Table 3: Multiple-change summary over 12 independent replications. Errors are Hausdorff distances in original time units.
Method
Median
Mean (SD)
P0
P≤4
Full D2
0
1.12 (2.29)
0.68
0.94
LR-D2 preliminary
0
1.12 (2.29)
0.68
0.94
LR-D2 refined
0
1.08 (2.11)
0.72
0.94
Mean CUSUM
256
221.56 (91.34)
0.00
0.00
Appendix
Table 4: UCI-HAR localization over 50 randomized replications, d=128 and n=800 .
Operations Research Program North Carolina State University Raleigh, NC, USA · H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology Atlanta, GA, USA
School of Mathematics, Statistics and Mechanics, Beijing University of Technology, Beijing 100124, China · College of Computing and Data Science, Nanyang Technological University, Singapore 639798, Singapore · College of Electrical Engineering, Sichuan University, Chengdu, Sichuan 610065, China
Federal Institute for Occupational Safety and Health, Dresden · Technical University of Munich, Munich Center for Machine Learning · Sapienza University of Rome