cs.RONov 14, 2026

RoboCoEvo: Expanding Robot Capabilities through Agent-Policy Co-Evolution

Authors: Ran Qi, Yixin Xiao, Dawei Wang, Zhiyuan Li, Jinbang Huang, Xuan Zhao, Yintao Ma, Yangzheng Wu, 

Organizations: University of Toronto · Huawei Noah’s Ark Lab · Department of Foundation Model, 2012 Labs

Abstract

Integrating MLLM-based agents with robotic foundation models has attracted increasing attention as a means of enhancing robotic capabilities. However, the improvement of such integrated systems remains largely decoupled across their agent and model components, with advances in one component not necessarily benefiting the other, substantially limiting the capabilities of the combined system. As both MLLMs and robotic foundation models become increasingly capable, fully realizing their combined potential calls for co-evolution, an iterative process in which improvements in agents and robotic foundation models reinforce one another. We propose RoboCoEvo, a failure-guided co-evolution framework that couples the refinement of the agent's explicit and reusable executable knowledge with parameter learning in robotic foundation models, such as vision-language-action (VLA) models. Through a code-as-policy formulation, the agent develops and refines executable failure-detection and recovery programs, generating targeted corrective experience. Post-training consolidates the resulting corrective behaviors into the robotic model's end-to-end policy, improving autonomous task execution. Changes in the updated policy's failure distribution, in turn, guide subsequent revisions to the agent's programs. Experiments on BEHAVIOR-1K, RoboCasa, and RoboTwin demonstrate sustained improvements in autonomous VLA task performance across successive co-evolution rounds.

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. RoboFoundry: System-as-Policy Evolution for Self-Learning Embodied Agents

    Sep 26, 2026Jingsong Liang, Shuhao Liao, Shizhe Zhang +15Embodied AISelf-Evolving Agents

  2. Co-Evolving Robot Orchestrators and Policies through Deployment

    Oct 6, 2026Xilun Zhang, Maggie Wang, Erik Bauer +4Robot LearningRobot Policy Adaptation

  3. CoEvolve: Self-Evolving Code Policies from Skills to Strategies for Humanoid Robots

    Oct 16, 2026Zicheng Liu, Haochen Wu, Jiawei He +4Multi-Robot CoordinationMulti-Robot Cargo Transportation