Overview

Zeroth-order optimization studies how to improve an objective using only its evaluations, making it useful when gradients are unavailable, expensive, or incompatible with black-box systems. Common approaches estimate directions with finite differences or random perturbations, then reduce cost and noise through variance reduction, adaptive sampling, low-dimensional subspaces, or structured updates. The methods are used in settings such as language-model fine-tuning, robotics, test-time adaptation, and optimization under privacy or communication limits, alongside theoretical work on convergence and query complexity. A central tension is that avoiding backpropagation can save memory and enable broader access, but noisy estimates and many required evaluations can make optimization slower or less reliable than first-order methods.

Latest papers

CardsList

99 papers13 papers in the last four weeks, down 7% on the four weeks before. 0.1% of all new papers.

  1. Power Homotopy for Zeroth-Order Non-Convex Optimizations

    Nov 17, 2025Chen XuZeroth-Order OptimizationNonconvex Optimization

  2. An Introduction to Zero-Order Optimization Techniques for Robotics

    Jun 27, 2025Armand Jordana, Jianghan Zhang, Joseph Amigo +1Zeroth-Order OptimizationRobotic Optimization

  3. Minimisation of Quasar-Convex Functions Using Random Zeroth-Order Oracles

    May 4, 2025Amir Ali Farzin, Yuen-Man Pun, Philipp Braun +1Zeroth-Order OptimizationConstrained Optimization

  4. Mirror Descent Linearized Augmented Lagrangian Methods for Nonconvex Constrained Stochastic Zeroth-Order Optimization

    Apr 13, 2025Qiankun Shi, Han Yuan, Xiao Wang +1Zeroth-Order OptimizationAugmented Lagrangian Method

  5. Sample-Efficient Optimization over Generative Priors via Coarse Learnability

    Mar 10, 2025Pranjal Awasthi, Sreenivas Gollapudi, Ravi Kumar +1Zeroth-Order Optimization

  6. Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training

    Feb 5, 2025Reza Shirkavand, Peiran Yu, Qi He +1LLM Fine-TuningZeroth-Order Optimization

  7. Risk-averse learning with delayed feedback

    Sep 25, 2024Siyi Wang, Zifan Wang, Karl Henrik Johansson +1Dynamic Regret MinimizationZeroth-Order Optimization

  8. A Historical Trajectory Assisted Optimization Method for Zeroth-Order Federated Learning

    Sep 24, 2024Yu Cai, Canxi Huang, Zike Li +2Zeroth-Order OptimizationFederated Learning

  9. Gradient Testing and Estimation by Comparisons

    May 19, 2024Xiwen Tao, Chenyi Zhang, Helin Wang +2Black-Box OptimizationZeroth-Order Optimization