cs.AISep 27, 2026

WorldAgent: Verification-Guided Agentic Physical World Construction

Authors: Caoliwen Wang, Mengdi Wang, Yige Chen, Zejia Wu, Bowen Huang, Siyuan Chen, Guanxiong Chen, Lifu Wei, +8 more

Abstract

Constructing complex physical worlds from language requires coordinating extensive 3D environments, detailed structures and objects at different spatial scales, and interacting physical processes under both stated goals and implicit physical constraints. We present WorldAgent, an agentic framework for verification-guided physical world construction from a single natural-language prompt, without iterative user debugging. A world construction layer expands the prompt into a structured world specification and uses physical knowledge to build scenes and run numerical simulations. After every step, a verification layer inspects scene geometry and simulation states alongside rendered views. Failed checks guide automatic revisions to the specification and re-execution of the affected steps. Accepted worlds pass the required checks and remain editable for further inspection and resimulation. We introduce AgenticSimBench, on which WorldAgent achieves the best scores among the evaluated agent-based methods on five of seven metrics. In a 26-participant user study, it receives the highest mean ratings across all four criteria.

Explore similar work

CardsList
  1. Coding Agent Is Good As World Simulator

    May 14, 2026Hongyu Wang, Jingquan Wang, Bocheng Zou +2Robotics SimulationWorld Models

  2. SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation

    Jul 2, 2026Chunjiang Liu, Xiaoyuan Wang, Haoyu Chen +3Multi-Agent LLM Systems3D Scene Generation