Two-Timescale Stochastic Approximation

Latest papers 14

All topics
CardsList
  1. Stationary Bias and Extrapolation in Nonlinear Two-Timescale Stochastic Approximation

    Oct 7, 2026A. Ch. Madhusudanarao, Rahul SinghStochastic ApproximationTwo-Timescale Stochastic Approximation

  2. Finite-Time Concentration and Convergence Rates for Projected Two-Time-Scale Stochastic Approximation with Markov Noise

    Sep 28, 2026Rahul Singh, Vivek S. Borkar, Eric MoulinesLast-Iterate ConvergenceStochastic Approximation

  3. A Concentration Bound for Two-Timescale Actor-Critic Algorithm

    Sep 24, 2026Prashansa Panda, Shalabh BhatnagarAverage-Reward RLTwo-Timescale Stochastic Approximation

  4. The Bias of Nonlinear Two-Time-scale Stochastic Approximation under Constant Step-Sizes

    Sep 17, 2026Djamel Rassem Lamouri, Dorian Baudry, Nicolas GastStochastic ApproximationTwo-Timescale Stochastic Approximation

  5. Non-Expansive Two-Time-Scale Stochastic Approximation: A Fixed-Schedule One-Quarter Barrier and Bias-Corrected Acceleration

    Jul 15, 2026Dhruv Sarkar, Vaneet AggarwalLast-Iterate ConvergenceStochastic Approximation

  6. Distribution-Aware Robust Bilevel Optimization: Quantile-Guided Huber Updates in Two-Timescale Stochastic Approximation

    Jun 21, 2026Zhiyu Li, Xi Xuan, Davide CarboneStochastic OptimizationStochastic Approximation

  7. Escaping the Variance Trap: Jacobian-Free Dynamics for Root-Finding Bilevel Optimization

    Jun 21, 2026Zhiyu Li, Xi Xuan, Davide CarboneStochastic ApproximationBilevel Optimization

  8. Nonlinear Two-Time-Scale Stochastic Approximation: A Sharp Phase Transition and How to Beat It

    Jun 12, 2026Dhruv Sarkar, Vaneet AggarwalStochastic ApproximationTwo-Timescale Stochastic Approximation

  9. Convergence of Two-Timescale Markovian Stochastic Approximations with Applications in Reinforcement Learning

    May 29, 2026Vagul Mahadevan, Claire Chen, Shuze Daniel Liu +1Stochastic ApproximationTemporal-Difference Learning

  10. Adynamical systems view of training generativemodels and the memorization phenomenon

    May 19, 2026Siva Athreya, Chiranjib Bhattacharya, Vivek S. BorkarNeural Network MemorizationMemorization in Generative Models

  11. Central Limit Theorem for Two-Time-Scale Approximate Distributionally Robust RL

    May 8, 2026Shengbo Wang, Zexi ZhangStochastic ApproximationDistributionally Robust RL

  12. Nonasymptotic CLT and Error Bounds for Linear Two-Time-Scale Stochastic Approximation

    Feb 14, 2025Seo Taek Kong, Sihan Zeng, Thinh T. Doan +1Stochastic ApproximationTwo-Timescale Stochastic Approximation