Overview

Variance reduction studies how to make noisy estimates—such as gradients, Monte Carlo expectations, policy values, and experiment effects—more precise without simply collecting more samples. Common approaches include control variates, recursive estimators such as SVRG and STORM, importance and stratified sampling, and Rao-Blackwellization or shared randomness. The methods are studied in finite-sum optimization and sampling as well as reinforcement learning, diffusion-model training, Bayesian computation, and A/B testing, with evaluations often measuring variance, sample complexity, or convergence. A central tension is that lower estimator variance may require extra computation or stronger assumptions, and minimizing variance alone does not always improve downstream outcomes such as model quality.

Latest papers

CardsList

114 papers14 papers in the last four weeks, down 33% on the four weeks before. 0.1% of all new papers.

  1. Variance-Reduced Stochastic Hessian-Driven Nesterov Acceleration with Adam-Style Preconditioning

    Nov 8, 2026Yaxin Yu, Long Chen, Minfu FengAccelerated Gradient MethodsSmooth Convex Optimization

  2. Compressed Per-Player Local Methods for Multiplayer Federated Learning: Exact Convergence via Increment Sharing

    Nov 5, 2026Bhavika Balani, TaeHo Yoon, Nicolas LoizouFederated LearningCommunication-Efficient Distributed Training

  3. Post-stratified importance sampling

    Nov 3, 2026Yuling Yao, Sergei TikhonovImportance SamplingVariance Reduction

  4. The Cost of Mismatch: Noise Amplification in Zeroth-Order Reinforcement Learning

    Nov 2, 2026Lianmin Chen, Junbin Qiu, Chenxing Wei +2Zeroth-Order OptimizationRL Post-Training

  5. Variance Reduction for Decentralized Stochastic Optimization with Multiple Local Updates

    Oct 30, 2026Jie Liu, Nicola Bastianello, Wenying Xu +2Decentralized OptimizationVariance Reduction

  6. Variance Reduction with Delayed Feedback for Non-Convex Optimization

    Oct 20, 2026Wei Jiang, Dingzhi Yu, Zechao LiVariance ReductionNonconvex Stochastic Optimization

  7. Fixed-Size Active Statistical Inference

    Oct 19, 2026Erik Skalnes, Michael OberstVariance Reduction

  8. Learned Control Variates for Rare Grid-Outage Estimation at Electric Vehicle Charging Stations

    Oct 19, 2026Sulyman Iyanda, Mansur AriefRare-Event EstimationVariance Reduction

  9. Multifidelity Monte Carlo Estimator for High-Dimensional Quantities of Interest

    Oct 18, 2026Zhibo Dai, Hamdi A. Tchelepi, Daniel M. TartakovskyUncertainty QuantificationVariance Reduction

  10. Gaussian Process Bandits with Paired Auxiliary Observations

    Oct 17, 2026Weibo Huang, Qing Feng, Ruihao Zhu +1Bayesian OptimizationGaussian Process Bandits

  11. Personalized Projected Ascent for Federated Stackelberg Optimization

    Oct 15, 2026M Yashwanth, Sharannya Ghosh, Saikiran Bulusu +1Federated LearningStochastic Gradient Descent

  12. Scaling Online Optimal Transport Minibatches for Flow Matching

    Oct 13, 2026Peter Chen, Sergey LevineFlow MatchingFlow-Based Generative Modeling

  13. Understanding Circulant Permutation to Extend the CMinHash Estimator

    Oct 13, 2026Keegan Kang, Avery Hood, Benedict H. W. WongVariance Reduction

  14. Adaptive Variance Reduction across Smoothness and Noise Conditions

    Oct 9, 2026Wei Jiang, Yibo Wang, Sifan Yang +2Nonconvex Stochastic OptimizationVariance Reduction

  15. Randomized Momentum Transport with Cheap Predictors

    Oct 9, 2026El Mahdi Chayti, Martin JaggiMomentum MethodsStochastic Optimization Convergence

  16. Variance-Reduced Policy Gradient is Nearly Minimax-Optimal

    Oct 9, 2026Leonardo Cesani, Matteo Papini, Marcello RestelliPolicy GradientPolicy Gradient Methods

  17. Estimating Great Expectations Under Autoregressive Language Models with Potentials

    Oct 8, 2026Francesco I. Re, Shubhangi Ghosh, Tim Vieira +1Variance Reduction

  18. Transformed Samplers with Variance Reduction

    Oct 7, 2026Siran Liu, Michalis Tisias, Petros DellaportasMarkov Chain Monte CarloVariance Reduction

  19. Dataset Pruning from First Principles: A Label-Free Linear Programming Approach

    Oct 7, 2026Rodrigo Schuller, Francisco GanacimDataset PruningTraining Data Selection

  20. Robust Importance Sampling for Rare Events via Constrained Gaussian Mixtures

    Oct 5, 2026Paweł Lorek, Rafał Nowak, Rafał Topolnicki +2Gaussian Mixture ModelsImportance Sampling

  21. SteadySplats: Resampling of Low-Variance Gaussians for High-Fidelity Stochastic Rendering

    Oct 4, 2026Felix Windisch, Thomas Köhler, Lukas Radl +43D Gaussian Splatting3DGS Acceleration

  22. ResOPD: Tail Residualization for Sparse On-Policy Distillation

    Oct 4, 2026Penghui Yang, Long Xing, Xuanlang Dai +3Language Model DistillationOn-Policy Distillation

  23. Variance-Optimal Control Variates for Learning with Black-box Feedback

    Oct 3, 2026Zihao Zhao, Shuhan Zhang, Kai WangVariance ReductionPolicy Gradient Methods

  24. Tail-Influence Sampling for CVaR Policy Evaluation

    Sep 29, 2026Pauline Bourigault, Xiaotong Ji, Matthieu Zimmer +2Policy EvaluationAdaptive Sampling

  25. OSCC: Certified Observation-Safe Coupling Optimization for Gradient-Noise Control in Imperfect-Information Learning

    Sep 27, 2026Miaobo Hu, Shuhao Hu, Xiaobo Guo +4Partially Observable RLPolicy Gradient Methods

  26. Private Decentralized Optimization with Noise Reduction and Bias Correction

    Sep 23, 2026Yizhao Fan, Wenjian Luo, Jiaojiao ZhangDifferential PrivacyVariance Reduction

  27. Gaussian Flow-Matching Schedules: Implications for Sampling and Training

    Sep 22, 2026Arsène Claustre, Hugo Negrel, Claire Boyer +2Flow MatchingDiffusion Sampling

  28. Optimal Multi-way Decision Trees for Stratified Sampling in Online Controlled Experiments

    Sep 20, 2026Tomoka Takei, Shunnosuke Ikeda, Yuichi TakanoStratified SamplingVariance Reduction