cs.AINov 10, 2026

Topological Dynamics Under Non-Stationary Supervision: Persistent Homology of Neural Network Weight Evolution

Authors: Mitra Varun

Organizations: Independent Researcher

Abstract

We investigate how the persistent topology of neuron- weight point clouds evolves under stable and non-stationary supervision. An identical multilayer perceptron is trained on Fashion-MNIST with correct labels, a fixed random permutation of the training-label vector, or a fresh permutation every epoch. Five paired seeds share initialisation and minibatch order, yielding 15 models trained for 100 epochs. Raw and row-normalised incoming weight clouds are analysed with H0 and H1 Vietoris Rips persistence at 22 checkpoints. Correct-label models reach 89.39% mean true-label test accuracy; fixed-random models fit 67.94% of their assigned training targets without generalising to the original task. Correct-label models have descriptively greater time-averaged normalised fc3 H1 persistence than either random-label condition, but the configured exact comparisons do not reach conventional significance after Holm correction. Early condition classification achieves 60.0% mean balanced accuracy using topology, 66.7% using conventional diagnostics, and 60.0% using both. Thus, no incremental predictive improvement is demonstrated in this setting. The archive contains all 3,300 configured topology cases. Interpretation is limited by five seeds, a single architecture and dataset, 282 capped H1 distance comparisons, and deferred bottleneck analysis.

Figures & tables

Appendix figures & tables24 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. A Topological Signature of Learning under Noisy Labels

    Oct 16, 2026Zhongtian Sun, Fan Mo, Prayag Tiwari +1Noisy-Label LearningNeural Representation Geometry

  2. Topological Signatures of Grokking

    May 7, 2026Yifan Tang, Qiquan Wang, Inés García-Redondo +1Neural Network GeneralizationNeural Representation Geometry

  3. TopTimeNet: Topologically-assisted time-series classification model

    Sep 30, 2026Sharareh Sayyad, Sophia BazziTime Series ClassificationClassification