World Reasoning Arena
Organizations: Institute of Foundation Models, Mohamed bin Zayed University of Artificial Intelligence
Abstract
World models (WMs) are intended to serve as internal simulators of the real world that enable agents to understand, anticipate, and act upon complex environments. Existing WM benchmarks remain narrowly focused on next-state prediction and visual fidelity, overlooking the richer simulation capabilities required for intelligent behavior. To address this gap, we introduce WR-Arena, a comprehensive benchmark for evaluating WMs along three fundamental dimensions of next world simulation: (i) Action Simulation Fidelity, the ability to interpret and follow semantically meaningful, multi-step instructions and generate diverse counterfactual rollouts; (ii) Long-horizon Forecast, the ability to sustain accurate, coherent, and physically plausible simulations across extended interactions; and (iii) Simulative Reasoning and Planning, the ability to support goal-directed reasoning by simulating, comparing, and selecting among alternative futures in both structured and open-ended environments. We build a task taxonomy and curate diverse datasets designed to probe these capabilities, moving beyond single-turn and perceptual evaluations. Through extensive experiments with state-of-the-art WMs, our results expose a substantial gap between current models and human-level hypothetical reasoning, and establish WR-Arena as both a diagnostic tool and a guideline for advancing next-generation world models capable of robust understanding, forecasting, and purposeful action. The code is available at https://github.com/MBZUAI-IFM/WR-Arena.
Figures & tables
| Action Simulation Fidelity | Long-horizon Forecast | Simulative Reasoning & Planning | |||||
| Model | Agent Simulation | Env. Simulation | Transition Smoothness | Simulation Consistency | Step-Wise Sim. | Open-Ended Sim. | Struct. Sim. |
| KLING | 51.0 | 43.3 | 40.5 | 59.2 | |||
| MiniMax | 72.3 | 51.7 | 30.7 | 57.2 | |||
| Gen-3 | 45.3 | 47.3 | 47.8 | 45.1 | |||
| Cosmos1-14B | 37.7 | 37.7 | 31.6 | 54.0 | 7.8 | +6.7% | -2.1% |
| Cosmos2-14B | 58.0 | 44.0 | 17.3 | 59.2 | 31.1 | +0% | +4.3% |
World Model Evaluation
World Model Evaluation measures whether learned simulators predict consistent, physically plausible, action-responsive futures that help agents plan and act.
See all 212 papers