Evolution Strategies

Also known as ES

Overview

Evolution strategies (ES) optimize by evaluating perturbed candidates and using their rewards or ranks to estimate which parameter changes are useful, without backpropagation. Methods such as CMA-ES and natural evolution strategies adapt mutation scales or covariance, while low-rank and cooperative variants reduce the cost of searching large spaces. They are used for black-box engineering and reinforcement learning, as well as language-model fine-tuning, prompt search, and agent training where rewards may be delayed or gradients unavailable. A central tension is balancing broad exploration and diverse solutions against evaluation cost, noisy feedback, and stability; matching gradient-based methods on task scores does not necessarily mean similar effects on other capabilities or knowledge.

Latest papers

CardsList

35 papers2 papers in the last four weeks, down 71% on the four weeks before. 0.0% of all new papers.

  1. The Evolution Strategies Paradox: Better Models from Worse Perturbations

    Nov 3, 2026Roberto Dailey, Kajetan Schweighofer, Jamieson Warner +5Evolution StrategiesFine-Tuning Language Models

  2. DP-ES: Differentially Private Evolution Strategies for Prompt Optimization

    Oct 5, 2026Ziniu Liu, Aiping Li, Yue Han +5Large Language Model-Guided OptimizationEvolution Strategies

  3. DART-ES: Difficulty-Aware Reweighting and Targeted Replay for Fine-Tuning LLMs with Evolution Strategies

    Oct 4, 2026Zhishen Sun, Hongzhan Wang, Sizhe Dang +2LLM Fine-TuningEvolution Strategies

  4. Asynchrony Is Nearly Free for Evolution Strategies on Long-Horizon LLM Agentic Tasks

    Oct 3, 2026William Hoy, Jingxuan Fan, Nurcin Celik +1Evolution StrategiesRL Post-Training

  5. Continual Reinforcement Learning with Neuroevolution

    Oct 1, 2026Eleni Nisioti, Andrea Cossu, Kathrin Korte +1NeuroevolutionLoss of Plasticity

  6. Online Evolution Strategy for Flow-Matching VLA Policies via Self-Supervised Trajectory Distribution Optimization

    Sep 30, 2026Gongxin Yao, Yongsheng Zhao, Jiayin Deng +4Flow MatchingEvolution Strategies

  7. EGGROLL, Unrolled: Understanding and Improving Low-Rank Evolution Strategies at Scale

    Sep 10, 2026Ege C. Kaya, Abolfazl HashemiEvolutionary OptimizationEvolution Strategies

  8. Flawed in Nature, Perfect through Evolution

    Aug 31, 2026J. M. Diederik KruijssenEvolution StrategiesAdaptive Learning

  9. Understanding Evolution Strategies for LLM Reasoning: Broader Reasoning Coverage than GRPO

    Aug 27, 2026Yunpeng Ba, Zhi Zheng, Yue Xie +7Evolution StrategiesLLM Post-Training

  10. ES-AHD: An Evolution Strategy Framework for Automatic Heuristic Design

    Aug 26, 2026Yutao Lai, Kezhao Lai, Hai-Lin Liu +2Automated Heuristic DesignLarge Language Model-Guided Optimization

  11. Integer Natural Evolution Strategies

    Aug 24, 2026Jacob de Nobel, Diederick Vermetten, Hao Wang +3Evolution StrategiesNatural Gradient Methods

  12. Agentic ESOpt: Fine-Tuning Long-Horizon LLM Agents with Minimal GPU Requirements

    Aug 18, 2026Zhi Zheng, Rongsheng Chen, Yunpeng Ba +3LLM Agent TrainingLong-Horizon LLM Agents

  13. Beyond the Best Guess: Improving LLM Solution Coverage with Evolution Strategies

    Aug 13, 2026Conor F. Hayes, Elliot Meyerson, Kajetan Schweighofer +4Evolution StrategiesLLM Post-Training

  14. Cooperative Coevolution for Resource-Constrained Agentic LLM Post-Training

    Aug 3, 2026Zhiyuan Wang, Shengcai Liu, Jiahao Wu +5Cooperative Co-EvolutionEvolutionary Optimization

  15. Accelerating Evolutionary Strategy via Rao-Blackwellizing Realization of Uncertain Input

    Aug 3, 2026So Nakashima, Tetsuya J. KobayashiStochastic OptimizationEvolution Strategies

  16. Bridging Spherical Black-Box Optimizers

    Jun 24, 2026Johannes Ackermann, Stefano PeluchettiEvolutionary OptimizationBlack-Box Optimization

  17. Model Merging to Evolution: Parameter Space Exploration for Expert Models

    Jun 17, 2026Chao Wang, Yuchen Guo, Zheng Tan +4Evolutionary OptimizationEvolution Strategies

  18. Runtime Analysis of the (μ+1)(μ+ 1)-ES in a Homogenous Progress Model

    Jun 11, 2026Johannes Lengler, Raghu Raman RaviEvolutionary OptimizationEvolution Strategies

  19. Beyond Static Evaluation: Co-Evolutionary Mechanisms for LLM-Driven Strategy Evolution in Adversarial Games

    Jun 9, 2026Haoran Li, Zengle Ge, Ziyang Zhang +10Game-Playing AgentsEvolutionary Optimization

  20. Depth over Fidelity in Fixed-Budget Noisy Evolution Strategies

    Jun 4, 2026Sichen Wang, Zhipeng LuEvolutionary OptimizationBlack-Box Optimization

  21. Overcoming Forgetting in LLM Fine-Tuning with Evolution Strategies

    May 28, 2026Kajetan Schweighofer, Conor F. Hayes, Roberto Dailey +2Continual Learning for LLMsEvolutionary Optimization

  22. Convergence Analysis of Evolution Strategies for Mixed-Integer Optimization

    May 20, 2026Ryoki Hamano, Kento Uchida, Shinichi ShirakawaEvolutionary OptimizationEvolution Strategies

  23. From Mean-Field Limits to Semiclassical Concentration: Global Convergence of the Canonical Evolutionary Strategy

    May 19, 2026Matías Neto, Nicolás Garay, Luis Martí +1Dynamical SystemsEvolutionary Optimization

  24. RCMAES: A Robust CMA-ES Variant for CEC2026 Competition

    Apr 29, 2026Khoirul Faiq Muzakka, Sören Möller, Martin FinsterbuschEvolutionary OptimizationBlack-Box Optimization