stat.MEDec 30, 2024

High-Dimensional Markov-Switching Ordinary Differential Processes

Authors: Katherine Tsai, Mladen Kolar, Sanmi Koyejo

Organizations: Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign · Marshall School of Business, University of Southern California · Department of Computer Science, Stanford University

Abstract

Complex systems often evolve in continuous time but are observed only at discrete time points with measurement noise. When the interactions can change across unobserved states, recovering both the state transitions and the differential equations is important for mechanistic insight and for identifying time-varying directed graphs. However, this recovery is challenging in high dimensions. In this paper, we study estimation and graph recovery for high-dimensional Markov-switching ordinary differential equation models from noisy discrete observations. We model the switching between states by a latent continuous-time Markov chain, and within each state the drift is a sparse additive function with unknown nonlinear components. We approximate each component by a finite basis expansion and estimate the parameters under group sparsity. Our procedure estimates the latent trajectories by wavelet smoothing and then runs a penalized surrogate expectation-maximization algorithm. Under stationarity and geometric ββ-mixing, given a sufficiently accurate estimated trajectory and other local regularity conditions, we show that the algorithm converges geometrically to a neighborhood of the true parameters. Finally, in an application to resting-state fMRI data, the procedure identifies multiple connectivity states, whose occupation times we compare descriptively between the children with combined-type ADHD and the typically developing children used in the fit.

Figures & tables

Appendix figures & tables14 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Disentangling Continuous-Time Latent Dynamics: Identifiability of Latent SDEs via Diffusion Shifts

    Jun 26, 2026Yuanyuan Wang, Wenjie Wang, Haoxuan Li +2Stochastic Differential EquationsCausal Representation Learning

  2. Identifying Drift, Diffusion, and Causal Structure from Temporal Snapshots

    Oct 30, 2024Vincent Guan, Joseph Janssen, Hossein Rahmani +4Stochastic Differential EquationsCausal Identifiability

  3. Learning Nonlinear Regime Transitions via Semi-Parametric State-Space Models

    Apr 3, 2026Prakul Sunil HiremathRegime-Switching Dynamical SystemsState Space Models