VEvo-Harness: Causally-Guarded Self-Evolving Harness for Agentic Image Generation
Organizations: Taobao & Tmall group of Alibaba · Tsinghua University
Abstract
The central bottleneck in visual generation and editing has migrated from achieving pixel-level fidelity to satisfying densely constrained user specifications through increasingly agentic workflows. Prevailing agentic generation pipelines remain shallow generate-verify-rewrite loops treating VLM judgments as coarse visual feedback, either discarding repair experience or admitting ungated updates that poison skill library. With memorize and govern periods left open, they degrade into ungoverned iterators of repeated trial-and-error rather than continual self-evolving harness. Towards this issue, we present VEvo-Harness, the first causally-guarded continual self-evolving harness system for agentic visual generation. VEvo-Harness introduces four coupled innovations: (1) a visual traceback that densifies sparse judgments into root-cause attributions with a hierarchical verification tree; (2) a visual continual governance that admits only causally valid skill patches through counterfactual dual-arm image generation replay; (3) a lifecycle-managed harness state that hierarchically distills root-cause-anchored episodes across working, experience, and pattern tiers into a persistent skill library of routable and causally verified capabilities; (4) a heterogeneous sandbox policy that orchestrates a diverse action space of repair primitives, dynamically routing cost-aware interventions based on root causes to select the most effective strategy. VEvo-Harness surpasses state-of-the-art agentic methods and rivals proprietary generators (e.g., GPT-Image, Nano-Pro) while maintaining the continual harness evolution and generalization.
Figures & tables
| Model | GenEval | GenEval2 | DPG-Bench | OneIG-EN | OneIG-ZH | WISE | Avg. | |
| Nano-Banana Comanici et al. (2025) | 0.75 | 44.6 | 85.23 | 0.550 | 0.405 | – | – | |
| GPT-Image-1 Hurst et al. (2024) | 0.84 | – | 85.15 | 0.533 | 0.474 | 0.80 | – | |
| Seedream-4 Seedream (2025) | 0.84 | – | 88.25 | 0.576 | 0.553 | 0.78 | – | |
| Bagel Deng et al. (2025) | 0.82 | 23.1 | 85.10 | 0.361 | 0.370 | 0.70 | 59.35 | |
| Ovis-U1 Wang et al. (2025) | 0.89 | 21.7 | 83.72 | 0.382 | 0.395 | 0.64 | 56.02 | |
| Echo-4o Ye et al. (2025) | 0.89 | 67.9 | 86.07 | 0.467 | 0.488 | 0.74 | 68.75 | |
| Model | LongText-EN | LongText-ZH | SpatialGenEval | CREA | ArtiMuse | Avg. | |
|---|---|---|---|---|---|---|---|
| Original ( Cai et al., 2025 ) | 0.912 0.000 | 0.932 0.000 | 58.7 0.0 | 11.84 0.00 | 43.27 0.00 | 58.41 | |
| Rewrite ( He et al., 2026b ) | 0.571 0.341 | 0.495 0.437 | 59.6 0.9 | 16.75 4.91 | 57.86 14.59 | 56.65 | |
| Promptist ( Hao et al., 2023 ) | 0.034 0.878 | 0.070 0.862 | 48.3 10.4 | 14.00 2.16 | 43.74 0.47 | 35.98 | |
| Search ( Ma et al., 2025 ) | 0.918 0.006 | 0.937 0.005 | 59.3 0.6 | 12.98 1.14 | 44.21 0.94 | 59.88 | |
| Maestro ( Wan et al., 2025 ) | 0.877 0.035 | 0.807 0.125 | 60.3 1.6 | 15.81 3.97 | 56.86 13.59 | 63.52 | |
| CRAFT ( Kovalev et al., 2025 ) | 0.951 0.039 | 0.760 0.172 | 60.6 1.9 | 13.63 1.79 | 54.95 11.68 | 61.63 | |
| Model | RISE-Bench | KRIS-Bench | WiseEdit | GEdit | |||||
| Temp. | Causal | Spatial | Logical | Factual | Concept. | Proced. | |||
| Seedream-4.0 ( Seedream, 2025 ) | 12.9 | 12.2 | 11.0 | 7.1 | 39.26 | — | — | 75.2 | 7.68 |
| Nano-Banana ( Pichai, 2024 ) | 25.9 | 47.8 | 37.0 | 18.8 | 80.48 | 78.11 | 75.31 | 75.0 | 6.51 |
| Nano-Banana-Pro ( Google, 2025 ) | 41.2 | 61.1 | 48.0 | 37.6 | 86.36 | 84.03 | 85.31 | 82.4 | 7.73 |
| GPT-Image-1 ( Hurst et al., 2024 ) | 34.1 | 32.2 | 37.0 | 10.6 | 79.80 | 81.37 | 78.32 | 77.6 | 7.53 |
| OmniGen ( Xiao et al., 2025 ) | 1.2 | 1.0 | 0.0 | 1.2 | 33.11 | 28.02 | 23.89 | 36.6 | 5.00 |
Agentic Image Generation
Agentic image generation uses reasoning, tools, search, and iterative feedback to create and refine images with greater control.
See all 45 papers