cs.AINov 11, 2026

Verify by Doing: Co-Evolving Agent Execution and Evaluation without External Feedback

Authors: Yitong Lin, Jianda Chen, Yihao Hu, Pan Wang, Hang Wang, Zhihao Wen, Xiaoxue Ren, Wei Wu

Organizations: Ant International · Zhejiang University

Abstract

Agent self-improvement requires feedback about task success, yet external feedback may be unavailable at test time. Agents must then infer success from observable evidence, and incomplete verification can misguide subsequent updates. We introduce Verify by Doing (VbD), a method that co-evolves Actor and Evaluator harnesses within a single task while keeping model weights fixed. The Evaluator actively inspects artifacts and environment state with tools; its findings ground an internal signal for output selection and guide updates to both execution and verification procedures. Proposed Evaluators undergo comparative review on common candidates, while Actor updates require support from their own fresh outputs. Across AutomationBench, τ3τ^3 Banking, and selected GDPval tasks, VbD achieves the highest overall scores among the compared methods operating without external feedback, with gains of 3.3, 4.1, and 2.3 percentage points over the strongest baselines on the main backbone. Ablations support the contributions of active verification and Evaluator evolution, and selection from fixed candidate pools shows that improved verification can recover successful outputs without generating new ones.

Figures & tables

Appendix figures & tables55 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. VeriEvolve: Evaluator-First Evolution for Tool-Using Agents

    Oct 21, 2026Yueshen Li, Kamer Ali Yuksel, Gokhan Tur +2Self-Evolving AgentsTool-Use Evaluation

  2. Verifier-Harness Co-Evolution for Training-Free Self-Improvement on Open-Ended Tasks

    Oct 13, 2026Tianyi Xu, Yaolun Zhang, Yiran Wu +6LLM Agent Self-ImprovementLLM Self-Refinement

  3. Who Verifies the Verifier? Co-Evolving Inspectable Graders with Self-Improving Agents

    Oct 8, 2026Xing Zhang, Guanghui Wang, Yanwei Cui +4Automated EvaluationLLM Agent Self-Improvement