cs.AIOct 29, 2026

Agentic World Modeling for Agent Test-time Scaling without Environment Replica

Authors: Wendi Li, Huseyin A. Inan, Wei-Ning Chen, Yanzhi Chen, Chetan Bansal, Saravan Rajmohan, Sharon Li

Organizations: University of Wisconsin–Madison · Microsoft

Abstract

Test-time scaling (TTS) improves large language model agents by sampling and selecting among multiple candidate trajectories, but common realizations assume that these trajectories can be executed in parallel. This assumption breaks in realistic deployments, where enterprise workspaces and cloud services are shared and persistent, costly or infeasible to replicate, and actions may introduce irreversible side effects or cross-trajectory interference. Existing generative world models avoid direct execution, but typically compress environment state into a single prompt, limiting their ability to reliably simulate transitions under partial observability. Instead, we introduce Agentic World Modeling (AWM), which reformulates next-observation prediction as a multi-turn evidence-acquisition task. For each hypothetical action, an agentic simulator adaptively queries the real environment through safe read-only interfaces, reasons over the returned evidence, and uses executable computation to construct the resulting observation without mutating shared state. Integrated with trajectory-level TTS, AWM enables parallel exploration over a single shared environment. Across ττ-bench, AppWorld, and OfficeBench, AWM outperforms a single-shot simulation baseline by 40.07% on average, and surpasses a trained world-model baseline by 12.36% on average. These results establish interactive, read-grounded simulation as a practical foundation for safe and scalable agentic test-time scaling in shared, non-resettable environments.

Explore similar work

CardsList
  1. ARTIS: Agentic Risk-Aware Test-Time Scaling via Iterative Simulation

    Feb 2, 2026Xingshan Zeng, Lingzhi Wang, Weiwen Liu +5LLM Agent ReliabilityTest-Time Scaling

  2. From Traces to Agentic Worlds: Agentic Language World Models for Interactive Environment Simulation

    Oct 5, 2026Quanyu Long, Xiao Chen, Jianda Chen +4LLM World ModelsInteractive World Models

  3. Qwen-AgentWorld: Language World Models for General Agents

    Jun 23, 2026Yuxin Zuo, Zikai Xiao, Li Sheng +30LLM World ModelsAgentic RL