Overview

Stochastic optimization seeks good decisions when exact objectives or gradients are unavailable, observations are noisy, or the environment changes, making it central to machine learning, planning, and resource allocation. Common approaches include stochastic gradient descent and adaptive optimizers, variance reduction, mirror and proximal methods, and online or bandit algorithms; robust and risk-sensitive methods address heavy-tailed noise and costly failures. Researchers evaluate these methods through convergence, sample-complexity, and regret guarantees, as well as experiments in deep-model training, constrained planning, and simulation. A continuing challenge is to make guarantees hold under realistic noise, dependence, and changing data while keeping computation, communication, and tuning costs manageable.

Latest papers

CardsList

226 papers11 papers in the last four weeks, down 69% on the four weeks before. 0.1% of all new papers.

  1. An inexact stochastic variance-reduced gradient method for constrained convex finite-sum optimization

    Nov 17, 2026Zhaosong Lu, Yifeng XiaoConstrained OptimizationStochastic Optimization

  2. Muon Attains O(ε−3)\mathcal{O}(\varepsilon^{-3}) Iteration Complexity under Shuffling

    Nov 13, 2026Kun Huang, Shi Pu, Karl Henrik JohanssonMuon OptimizerStochastic Optimization

  3. Descending Everest, Part II: Oracle Complexity of Minimizing a Sum of Convex (L0,L1)(L_0,L_1)-Smooth Functions

    Nov 3, 2026Mikhail Rudomanov, Ivan Fomin, Alexander V. Gasnikov +1Smooth Convex OptimizationOracle Complexity

  4. Beyond Monotonicity: Stochastic Online Optimization under Semi-Bandit Feedback

    Nov 2, 2026Tsubasa Harada, Yasushi Kawase, Hanna SumitaStochastic Optimization

  5. Robustness Starts with the Objective: Designing and Certifying Robust LLM-Generated Heuristics

    Oct 31, 2026Pantea Karimi, Roozbeh Bostandoost, Dany Rouhana +5Automated Heuristic DesignLarge Language Model-Guided Optimization

  6. Riemannian Optimization on Unknown Manifolds via Stochastic Proximal Refinement

    Oct 30, 2026Ruixiang Wu, Jiahao Ai, Tinko Sebastian Bartels +5Riemannian OptimizationStochastic Optimization

  7. Rennala NSGD: Asynchronous Stochastic Optimization Beyond Euclidean Geometry

    Oct 28, 2026Igor Sokolov, Alexander Tyurin, Peter RichtárikStochastic OptimizationStochastic Gradient Descent

  8. Non-Ergodic Markovian Mirror Descent with Unbounded Noise

    Oct 25, 2026Yunus Alp Biyikoglu, R. SrikantStochastic OptimizationStochastic Optimization Convergence

  9. Agent-Based Transport Model Calibration via Online Stochastic Batch Optimization

    Oct 23, 2026Abdelkader Dib, Milos BalacAgent-Based ModelingStochastic Optimization

  10. When Momentum Helps Polyak--Ruppert Averaging

    Oct 20, 2026Alexandra Suvorikova, Darina Dvinskikh, Yuriy Dorn +1Stochastic OptimizationStochastic Optimization Convergence

  11. Near-Optimal Regret for Semi-Bandit Learning of Monotone Stochastic Problems

    Oct 17, 2026Zhengjia Zhuo, Viswanath NagarajanStochastic OptimizationCombinatorial Semi-Bandits

  12. A general recipe for data-adaptive anytime-valid envelopes for iterative algorithms

    Oct 16, 2026Soham Bonnerjee, Aaditya RamdasStochastic Optimization

  13. Non-Parametric Optimization for Scalable Learning in Stochastic Decision Problems

    Oct 16, 2026Mohsen Amidzadeh, Lauri Viitasaari, Mario Di FrancescoStochastic Optimization

  14. Large-Step Last-Iterate Convergence of Random-Reshuffling Stochastic Gradient Descent

    Oct 14, 2026Zijun Chen, Zihan ZhangStochastic OptimizationLast-Iterate Convergence

  15. Steering the Fidelity in State Preparation on Noisy Bosonic Systems with Risk-Seeking Optimization

    Oct 13, 2026Riccardo Piantoni, Riccardo Pellini, Maurizio Ferrari Dacrema +1Quantum State PreparationStochastic Optimization

  16. Principled Design of Expected Improvement for Continuous Simulation Optimization

    Oct 13, 2026Songhao Wang, Jianglin Xia, Haowei Wang +1Stochastic OptimizationStochastic Optimization Convergence

  17. Bayesian Optimization of CVaR with Unknown Hyperparameters

    Oct 13, 2026Valentin Margraf, Jonas Hanselle, Viktor Bengs +3Bayesian OptimizationConditional Value-at-Risk

  18. Risk-Averse Inference-Time Diffusion Model Alignment with Finite-Sample Guarantees

    Oct 13, 2026Yuchen Liang, Xian YuDiffusion Model AlignmentStochastic Optimization

  19. Near-Optimal Regret Bounds for Monotone Stochastic Optimization under Semi-Bandit Feedback

    Oct 12, 2026Tao Hu, Rohan GhugeStochastic OptimizationMonotonicity Constraints

  20. Minimax Optimality of Shampoo for Nonstationary Stochastic Optimization

    Oct 12, 2026Abir Sarkar, Nirmalya Mandal, Martin T. WellsStochastic OptimizationNonconvex Stochastic Optimization

  21. Efficient Preconditioned Optimization Methods with Frequent Directions

    Oct 12, 2026Sifan Yang, Yuanyu Wan, Yibo Wang +1Adaptive Gradient MethodsOnline Convex Optimization

  22. Partially Informed Stochastic Optimization via Zeroth-Order Residual Tracking

    Oct 9, 2026El Mahdi Chayti, Alireza Mirrokni, Martin JaggiStochastic OptimizationNonconvex Stochastic Optimization

  23. Geometry-Aware Multi-Objective Optimization: Norm-Constrained Oracles with Entropic Weight Updates

    Oct 9, 2026El Mahdi Chayti, Alireza Mirrokni, Martin JaggiLMO MethodsMulti-Objective Optimization