math.OCJun 28, 2026

Fractional Stochastic Neural Networks

Authors: Yuecai Han, Jianming Xu

Organizations: School of Mathematics, Jilin University, Changchun 130012, Jilin, China

Abstract

In this paper, we develop a fractional stochastic neural network with residual dynamics driven by fractional Brownian motion. By introducing a discrete stochastic maximum principle for the network, we construct the corresponding adjoint recursion. For deterministic network parameters, we prove mean square convergence of projected samplewise stochastic gradient descent. Numerical experiments include a closed form convergence test, noisy regression with uncertainty quantification, long memory time series generation and image classification under structured perturbations. The results identify settings in which fractional drivers improve long memory recovery or robustness relative to Brownian and deterministic baselines.

Explore similar work

CardsList
  1. High-dimensional Limit of SGD for Diagonal Linear Networks

    May 16, 2026Begoña García Malaxechebarría, Courtney Paquette, Maryam Fazel +1Stochastic Gradient DescentStochastic Differential Equations