Evolutionary Optimization

Evolutionary optimization studies how populations of candidate solutions can improve through selection, mutation, recombination, and other forms of variation, especially when gradients are unavailable or objectives are expensive. Common approaches include genetic algorithms, differential evolution, CMA-ES and evolution strategies, as well as multi-objective methods that preserve trade-offs and diversity. Researchers apply them to engineering design, robotics, scheduling, scientific discovery, and increasingly to evolving code, prompts, and language-model behavior; newer methods add learned surrogates, adaptive resource allocation, and large-language-model-generated operators. A central challenge is balancing exploration, solution quality, and evaluation cost, while ensuring improvements generalize beyond the benchmarks and search budgets used to find them.