cs.CVMar 23, 2026

Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models

Authors: Meiqi Wu, Zhixin Cai, Fufangchen Zhao, Xiaokun Feng, Rujing Dang, Bingze Song, Ruitian Tian, Jiashu Zhu, 

Organizations: School of Computer Science and Technology, UCAS · The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, CASIA · AMAP, Alibaba Group · School of Computer Science and Engineering, Beihang University · 

Abstract

Video--based world models have emerged along two dominant paradigms: video generation and 3D reconstruction. However, existing evaluation benchmarks either focus narrowly on visual fidelity and text--video alignment for generative models, or rely on static 3D reconstruction metrics that fundamentally neglect temporal dynamics. We argue that the future of world modeling lies in 4D generation, which jointly models spatial structure and temporal evolution. In this paradigm, the core capability is interactive response: the ability to faithfully reflect how interaction actions drive state transitions across space and time. Yet no existing benchmark systematically evaluates this critical dimension. To address this gap, we propose Omni--WorldBench, a comprehensive benchmark specifically designed to evaluate the interactive response capabilities of world models in 4D settings. Omni--WorldBench comprises two key components: Omni--WorldSuite, a systematic prompt suite spanning diverse interaction levels and scene types; and Omni--Metrics, an agent-based evaluation framework that quantifies world modeling capabilities by measuring the causal impact of interaction actions on both final outcomes and intermediate state evolution trajectories. We conduct extensive evaluations of 18 representative world models across multiple paradigms. Our analysis reveals critical limitations of current world models in interactive response, providing actionable insights for future research. Omni-WorldBench will be publicly released to foster progress in interactive 4D world modeling.

Figures & tables

Explore similar work

CardsList
  1. WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation

    May 25, 2026Kaining Ying, Hengrui Hu, Siyu Ren +6World Model EvaluationInteractive World Models

  2. HappyWorld-Bench

    Sep 21, 2026Zhiqi Bai, Junai Cai, Yixin Chen +33World ModelsWorld Model Evaluation

  3. WorldMark: A Unified Benchmark Suite for Interactive Video World Models

    Apr 23, 2026Xiaojie Xu, Zhengyuan Lin, Kang He +5Action-Conditioned World ModelsWorld Model Evaluation