Overview

Stochastic optimization seeks good decisions when exact objectives or gradients are unavailable, observations are noisy, or the environment changes, making it central to machine learning, planning, and resource allocation. Common approaches include stochastic gradient descent and adaptive optimizers, variance reduction, mirror and proximal methods, and online or bandit algorithms; robust and risk-sensitive methods address heavy-tailed noise and costly failures. Researchers evaluate these methods through convergence, sample-complexity, and regret guarantees, as well as experiments in deep-model training, constrained planning, and simulation. A continuing challenge is to make guarantees hold under realistic noise, dependence, and changing data while keeping computation, communication, and tuning costs manageable.

Latest papers

CardsList

226 papers11 papers in the last four weeks, down 69% on the four weeks before. 0.1% of all new papers.

  1. Convergence Analysis of the ProbAbilistic Gradient Estimator Algorithm for Weakly Convex Finite-Sum Optimization

    Aug 31, 2025Laurent Condat, Peter RichtárikStochastic OptimizationNonconvex Stochastic Optimization

  2. First-order methods for stochastic and finite-sum convex optimization with deterministic constraints

    Jun 25, 2025Zhaosong Lu, Yifeng XiaoStochastic OptimizationConstrained Optimization

  3. Primal-dual algorithm for contextual stochastic combinatorial optimization

    May 7, 2025Louis Bouvier, Thibault Prunet, Vincent Leclère +1Stochastic OptimizationNeural Combinatorial Optimization

  4. Sufficient Decision Proxies for Decision-Focused Learning

    May 6, 2025Noah Schutte, Grigorii Veviurko, Krzysztof Postek +1Stochastic OptimizationLearning to Optimize

  5. Towards Weaker Variance Assumptions for Stochastic Optimization

    Apr 14, 2025Ahmet Alacaoglu, Yura Malitsky, Stephen J. WrightStochastic OptimizationLast-Iterate Convergence

  6. Decision-Dependent Stochastic Optimization: The Role of Distribution Dynamics

    Mar 10, 2025Zhiyu He, Saverio Bolognani, Florian Dörfler +1Stochastic OptimizationDistribution Shift

  7. Preconditioned Inexact Stochastic ADMM for Deep Model

    Feb 15, 2025Shenglong Zhou, Ouya Wang, Ziyan Luo +2Stochastic OptimizationDeep Learning Optimization

  8. A SPIDER-type stochastic subgradient method for expectation-constrained nonconvex nonsmooth optimization

    Jan 31, 2025Wei Liu, Yangyang XuStochastic OptimizationConstrained Optimization

  9. Projected gradient methods for nonconvex and stochastic smooth optimization: new complexities and auto-conditioned stepsizes

    Dec 18, 2024Guanghui Lan, Tianjiao Li, Yangyang XuGradient ProjectionNonconvex Optimization

  10. MPPI-Generic: A CUDA Library for Stochastic Trajectory Optimization

    Sep 11, 2024Bogdan Vlahov, Jason Gibson, Manan Gandhi +1Trajectory OptimizationModel Predictive Control

  11. On the Approximation and Convergence of Distributional Policy Gradient Algorithms for Risk-Sensitive Reinforcement Learning

    May 23, 2024Xian Yu, Minheng Xiao, Lei YingStochastic OptimizationDistributional RL

  12. Budgeted Prompt-Set Expansion and Refinement for Language Models via Simulation Optimization

    Apr 12, 2024Haoting Zhang, Jinghai He, Rhonda Righter +1Prompt OptimizationLLM Prompting

  13. Conformal Predictive Programming for Chance Constrained Optimization

    Feb 12, 2024Yiqi Zhao, Xinyi Yu, Matteo Sesia +2Stochastic OptimizationChance-Constrained Optimization

  14. Semi-Bandit Learning for Monotone Stochastic Optimization

    Dec 24, 2023Arpit Agarwal, Rohan Ghuge, Viswanath Nagarajan +1Stochastic OptimizationMulti-Armed Bandits

  15. NAG-GS: A Semi-Implicit Stochastic Optimizer with Large-Step Stability

    Sep 29, 2022Valentin Leplat, Daniil Merkulov, Aleksandr Katrutsa +3SGD with MomentumStochastic Optimization