stat.MLOct 31, 2026

Self-Normalized Inference from Riemannian Stochastic Gradient Paths

Authors: Xiaotian Chang, Qirui Hu, Yi Liu

Organizations: Division of Mathematical Sciences, Nanyang Technological University. · School of Statistics and Data Science, Shanghai University of Finance and Economics. · York University.

Abstract

Riemannian stochastic gradient paths estimate constrained parameters, but confidence regions usually require estimating the Hessian and gradient-noise covariance. We develop self-normalized inference from one path by expressing retained iterates in a common random tangent space. Their average and centered partial sums share an unknown covariance factor that cancels in a Brownian bridge pivot. Under suitable regularity conditions, a joint expansion of the averaged estimator and integrated path controls nonlinear coordinate errors using conditional second moments. The procedure uses fixed-dimensional memory and extends to nondegenerate smooth functionals and alternative local coordinates. Numerical studies show competitive coverage relative to plug-in Wald inference while avoiding Hessian and residual-density estimation.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Locally Private Inference for Riemannian Stochastic Optimization

    Sep 18, 2026Xiaotian Chang, Yangdi Jiang, Qirui HuRiemannian OptimizationConfidence Region Estimation

  2. Riemannian Newton Methods with Statistical Inference

    Oct 31, 2026Xiaotian Chang, Qirui Hu, Yangdi Jiang +1Covariance EstimationRiemannian Optimization

  3. Bootstrap Inference for Riemannian Optimization Problems

    Oct 31, 2026Xiaotian Chang, Qirui Hu, Yangdi Jiang +1Confidence Region EstimationRiemannian Optimization