The View from Nowhere: Population-Centered Agent Evolution
Organizations: Macquarie University · Monash University
Abstract
Self-improving AI systems can revise the designs that govern their own behavior. Yet existing approaches center improvement on selected parent agents and their evolutionary experience, leaving the broader population largely underused. We identify a substantial gap between population coverage (i.e., the tasks solved by at least one evolved variant) and the performance of the best individual agent. This gap shows that useful capabilities and diagnostic evidence emerge across the population without being consolidated into its leading agents. These observations motivate the view from nowhere, a principle for agent evolution: an agent should be improved by interpreting its behavior through population-wide patterns of success, failure, and prior self-modification. We instantiate this principle as Population-Centered Evolution (PCE). PCE distils task records and modification histories from the population into a population block, which captures recurring failures, complementary successes, and the effects of previously attempted modifications to guide improvements to a selected parent's harness. Under matched models, initial harnesses, and evolution schedules, PCE achieves 72.1% success on SWE-bench Verified and 96.7% on Polyglot, improving over a strong group-evolution baseline by 3.2 and 5.9 percentage points. In our evaluation, PCE reduces the gap between population coverage and best-agent performance by one-third on SWE-bench and closes it on Polyglot. These results suggest that treating the population as evidence, not merely as candidates for selection, provides a complementary principle for agent evolution.
Figures & tables
| Benchmark | Method | Model | Gen. | Best | Overall |
| SWE-bench | OpenHands † | GPT-5 | N/A | N/A | 71.8 |
| DGM | Claude 3.5 Sonnet | 80 | — | 50.0 | |
| DGM ‡ | Claude 3.7 Sonnet | 80 | — | 59.5 | |
| DGM ‡ | o3-mini | 80 | — | 33.0 | |
| DGM (GEA) † | Haiku/Sonnet 4.5 | 60 | — | 56.7 | |
| GEA † | Haiku/Sonnet 4.5 | 30 | — | 71.0 |
| Benchmark | Method | Top-1 | Top-3 min. | Top-5 min. | Union | Gap |
|---|---|---|---|---|---|---|
| SWE-bench | GEA | 70.0 2.4 | 66.7 2.4 | 66.7 2.4 | 84.2 3.5 | 14.2 1.2 |
| PCE | 75.0 0.0 | 72.5 1.2 | 70.8 1.2 | 85.0 0.0 | 10.0 0.0 | |
| Polyglot | GEA | 90.0 | 85.0 | 83.3 | 100.0 | 10.0 |
| PCE | 100.0 | 98.3 | 96.7 | 100.0 | 0.0 |
| Method | Best | Mean sd | Intersection | Union |
|---|---|---|---|---|
| GEA | 90.0 | 92.0 2.5 | 85.0 | 100.0 |
| Parent distillation | 91.7 | 92.0 4.3 | 78.3 | 98.3 |
| Population distillation (PCE) | 100.0 | 96.0 2.8 | 88.3 | 100.0 |
| Metric | SWE-bench | Polyglot | ||
| GEA | PCE | GEA | PCE | |
| Overall success (%) | 68.9 | 72.1 | 90.8 | 96.7 |
| Total tokens (billions) | 2.98 | 1.92 | 0.99 | 0.41 |
| Total requests | 114,629 | 69,539 | 52,034 | 28,823 |
| Distillation calls | 0 | 758 | 0 | 775 |
| Evaluation episodes | 1,100 | 1,200 | 1,147 | 1,177 |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| SWE-bench | Polyglot | ||||||
| Gen | PCE 1 | PCE 2 | GEA 1 | GEA 2 | PCE | GEA | Parent dist. |
| 0 | 40, 34 | 40, 29 | 41, 31 | 25, 15 | 38, 47 | 42, 47 | 45, 48 |
| 1 | 38, 40 | 40, 36 | 0/10, 33 | 27, 19 | 38, 45 | 50, 41 | 45, 46 |
| 2 | 40, 40 | 42, 45 | 42, 39 | 28, 25 | 42, 58 | 51, 50 | 47, 47 |
| 3 | 42, 37 | 42, 40 | 40, 37 | 39, 13 | 58, 59 | 47, 54 | 45, 51 |
| 4 | 44, 38 | 41, 40 | 39, 19 | 37, 27 | 60, 57 | 49, 44 | 0/10, 44 |
| Prompt condition | Sphinx-7748 | Sphinx-8638 | Sphinx-9229 |
|---|---|---|---|
| I / E / T | I / E / T | I / E / T | |
| GEA | 3 / 2 / 0 | 4 / 0 / 1 | 5 / 0 / 0 |
| +Success | — | 4 / 0 / 1 | 5 / 0 / 0 |
| +Own failures | — | 4 / 0 / 1 | 5 / 0 / 0 |
| +Population failures | — | 3 / 0 / 2 | 5 / 0 / 0 |
| +Block | 0 / 5 / 0 | 5 / 0 / 0 | 3 / 2 / 0 |
| Benchmark | Set | Agent | Rep 1–5 | Mean sd (%) |
| SWE-bench | Held-in 60 | Initial | 33, 33, 36, 33, 35 | 56.7 2.4 |
| GEA | 39, 39, 39, 42, 40 | 66.3 2.2 | ||
| PCE | 39, 43, 45, 44, 40 | 70.3 4.3 | ||
| Held-out 60 | Initial | 38, 30, 31, 29, 32 | 53.3 5.9 | |
| GEA | 41, 39, 39, 40, 37 | 65.3 2.5 | ||
| PCE | 40, 42, 43, 42, 44 | 70.3 2.5 |
LLM Agent Self-Improvement
Large language model agent self-improvement studies how agents use experience and feedback to improve their behavior, tools, and workflows.
See all 277 papers