cs.LGAug 14, 2026

High-dimensional nonparametric changepoint detection via low-rank degree-two density projection

Authors: Guoqing Zhang, Zhaixin Chen

Organizations: Operations Research Program North Carolina State University Raleigh, NC, USA · H. Milton Stewart School of ISyE Georgia Institute of Technology Atlanta, GA, USA

Abstract

Detecting distributional changes in high dimension is difficult when neither the pre-change nor post-change density is parametrically specified. We introduce a representation-based approach that retains all degree-at-most-two density information while replacing density estimation by matrix mean estimation. For observations in [−1,1]d[-1,1]^d, a symmetric feature matrix H2(X)∈R(d+1)×(d+1)H_2(X)\in\R^{(d+1)\times(d+1)} is constructed so that M(f)=\EfH2(X)M(f)=\E_f H_2(X) is an isometric encoding of the degree-two orthogonal projection of the density. We scan matrix CUSUMs after rank-rr truncation, exploiting the low rank of the projected jump rather than sparsity of individual coordinates. The resulting \LRD{} estimator has a tent-shaped population objective and a nonasymptotic operator-norm analysis whose leading stochastic term scales as rdlog⁡(nd)\sqrt{rd\log(nd)}. For multiple changes, we give a seeded narrowest-over-threshold procedure and prove exact recovery by an induction that preserves an isolating interval for every undetected change. A cross-fitted scalar refinement learns the changing low-rank direction on one fold and localizes on the other, attaining O~\Pp(κ−2)\widetilde O_{\Pp}(κ^{-2}) error; a matching Le Cam lower bound shows optimality up to logarithms. A geometrically ββ-mixing extension follows from a dependent matrix Bernstein inequality. Experiments with ambient dimension up to 200200, a three-change d=100d=100 sequence, and a 128128-feature human-activity benchmark show that the method remains computationally practical and accurately detects pure dependence changes that are invisible to mean CUSUMs.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

Aug 16, 2026cs.LG

High-Dimensional Nonparametric Change-Point Detection via Low-Rank Degree-Three Density Projection

Distributional changes can be invisible to means and covariances yet appear in skewness, asymmetric interactions, or other third-order structure. We develop a nonparametric change-point method that retains every degree-at-most-three coefficient of a density while avoiding direct density estimation. For observations in [−1,1]d[-1,1]^d, we construct a symmetric order-three Legendre feature tensor H3(X)∈\Sym3(Rd+1)H_3(X)\in\Sym^3(\R^{d+1}) such that A(f)=\EfH3(X)A(f)=\E_fH_3(X) is an exact isometric encoding of the degree-three density projection: ∥A(f)−A(g)∥\F=∥P3(f−g)∥L2\|A(f)-A(g)\|_{\F}=\|P_3(f-g)\|_{L^2}. Instead, fixed tensor contractions are degree-three polynomial chaoses with ψ2/3ψ_{2/3} tails. The two terms have the characteristic order-three tensor scaling and match the powers in sharp concentration results for simple random tensors. For a coordinate-orthogonal specialization, the bound improves to log⁡d\sqrt{\log d} and enables a prefix-sum implementation in hundreds of dimensions. We derive the exact population tent shape and localization margin, introduce a seeded shortest-interval algorithm with a padded local recentering step, and prove exact recovery by induction: null recursive segments remain inactive, every undetected change retains a balanced isolating interval, and the shortest active seed contains exactly one change before recentering. A two-way cross-fitted scalar refinement attains O\Pp(κ−2)O_{\Pp}(κ^{-2}) localization in the small-jump regime, matching a Le Cam lower bound on a pure cubic family whose degree-two projection jump is exactly zero. Reproducible experiments at d∈{20,50,100,200}d\in\{20,50,100,200\} and a three-change d=100d=100 sequence demonstrate the intended high-dimensional regime without materializing a (d+1)3(d+1)^3 tensor.
Aug 3, 2026stat.ME

ARM: Detector-Agnostic Changepoint Attribution with Finite-Sample Error Control

Detecting a change in a multivariate series answers only the first of two questions; the operational question is which coordinates changed. Existing answers are incomplete. Block-level procedures certify predefined groups of coordinates under an additive union bound, high-dimensional variable-selection methods return interpretable rankings without error guarantees, and the post-detection inference literature controls error along the time axis rather than across coordinates. We propose ARM (Attribution by Rank Maxima), a wrapper that accepts a changepoint located by an arbitrary detector and returns the set of coordinates certified to have changed, each carrying a location or scale type label. ARM scores each coordinate by a max-over-splits rank statistic. Because this statistic dominates the corresponding statistic at the estimated split, the resulting certificate is invariant to the manner, and to the accuracy, of the changepoint estimate. Three finite-sample guarantees follow from within-coordinate ranks alone: per-coordinate validity under any detector; exact family-wise error control through a Westfall--Young joint permutation that preserves cross-coordinate dependence, with a fully distribution-free Holm fallback; and false discovery rate control under arbitrary coordinate dependence in high dimensions through Benjamini--Yekutieli and e-BH. In simulations, naive per-coordinate testing at the estimated changepoint inflates its family-wise error beyond 0.660.66 as the dimension grows, whereas ARM maintains the nominal level while retaining validity under heavy tails, power in high dimensions, and accurate type labels. On five financial series surrounding the 2008 collapse, ARM attributes a scale change to every asset class and excludes injected control coordinates.
Sep 21, 2026cs.LG

High-Dimensional Online Change Point Detection with Adaptive Thresholding and Interpretability

Change point detection (CPD) identifies abrupt and significant changes in sequential data, with applications in human activity recognition, financial markets, cybersecurity, manufacturing, and autonomous systems. Traditional CPD methods often face computational challenges in high-dimensional settings and typically provide limited explanations for detected changes, which can restrict their practical usability. This paper introduces a CPD framework that improves scalability and interpretability by leveraging the Sliced Wasserstein (SW) distance. Our contributions are fourfold: (1) we transform multivariate sequential data into one-dimensional scores using the SW distance, making the resulting representation compatible with existing CPD methods; (2) we analyze the distributional behavior of random slices of the SW distance and show that, under suitable assumptions, they can be approximated by a Gamma distribution, providing a principled basis for threshold calibration; (3) we propose a self-adapting online CPD algorithm that combines this SW-based score with an adaptive quantile-based threshold; (4) we introduce a model-specific framework for generating contrastive explanations for annotated change points. Empirically, our method reduces false positives by at least 48%48\% on average compared with popular online and offline CPD baselines, while maintaining competitive or superior detection performance. Code is available at https://github.com/jsve96/SWCPD_Code. At the same time, it produces interpretable change-point annotations, making it practical for deployment in high-stakes applications.