World Model Evaluation

Follow this topic Ask about this topic

Momentum

29 papers in the last four weeks, up 123% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 146

All topics

Programmable World Model
Sep 9, 2026Zheng-Hui Huang, Guixu Lin, Jiacheng Lin +8World Models Controllable Video Generation
Alaya Lab
CALIPER: Clean Scenes Cannot Rank Physical Inference in Pretrained Visual Representations
Sep 8, 2026Aman Mehta, Riya BaviskarPhysical Reasoning Visual Representation Learning
Independent Researcher
World Models Under Asynchronous Sensor Observations
Sep 7, 2026Akash Anand, Abhay Anand, Yash VisheWorld Model Learning World Models
University of California, Davis · University of California, San Diego
Beyond Task Success: Stage-Wise Reliability of World Model Planning under Sensing Degradation
Sep 7, 2026Geonmyeong Lee, Byoung-Tak ZhangWorld Models for Robotics World Model-Based Planning
Seoul National University
WorldReward: Reward Modeling for Camera-Conditioned World Models
Sep 3, 2026Yibin Wang, Zehan Wang, Junshu Tang +13Reward Modeling Camera-Conditioned Video Generation
Fudan University · Tencent Hunyuan · Shanghai Innovation Institute +3
VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement
Sep 2, 2026Wenzhuo Xu, Yuchen Zhu, Chongjian Ge +8Physical Consistency in Video Generation LLM Agent Verification
1Carnegie Mellon University · 2Georgia Institute of Technology · 4Adobe Research +1
Do Better Imagined Rollouts Mean Better Robot Control? A Controlled Study of World-Model Evaluation Under Feedback
Sep 2, 2026Dharini Raghavan, Amritpal SinghWorld Model Evaluation Robot State Estimation
Georgia Institute of Technology, Emory University
The Intervention Gap in Latent World Models
Aug 30, 2026Donna VakalisWorld Model-Based Planning Model-Based Planning
Mila – Quebec AI Institute · University of Montreal
PAWBench: How Far Are We from Probabilistically Aligned World Modeling?
Aug 27, 2026Yuandong Pu, Le Zhuo, Sayak Paul +11World Model Learning World Model Evaluation
Shanghai Jiao Tong University · Shanghai AI Laboratory · Krea AI +4
HarnessEval-W: Agentifying the Evaluation of Visual Worlds
Aug 17, 2026Weiliang Chen, Haowen Sun, Jun Gao +40Agent Evaluation Automated Evaluation
PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
Aug 13, 2026Kaixin Ding, Xi Chen, Minghong Cai +9Long-Horizon Agent Evaluation World Model Evaluation
The University of Hong Kong · Kling Team, Kuaishou Technology · The Chinese University of Hong Kong +1
The Objective Is the Bottleneck: Latent World Models Encode What Their Planners Cannot Use
Aug 13, 2026Joyjeet SinghWorld Model-Based Planning Model-Based Planning
Independent researcher
Diagnosing JEPA World Models with Action-Conditioned Predictive Consistency
Aug 13, 2026Guo An, Zijing Wu, Honghua Dong +7World Models Joint-Embedding Predictive Architecture
Huawei · University of Science and Technology of China · Zhejiang University +3
Better Slots, Better Worlds: Representation Quality & Robustness in Object-Centric World Models
Aug 12, 2026Shukrullo Nazirjonov, Sai Prasanna, Anna Manasyan +1World Models World Model-Based Planning
University of Tuebingen · Max Planck Institute for Intelligent Systems
VIScore: Diagnosing Planning-Relevant Quality in Latent World Models
Aug 11, 2026Haiyu Wu, Randall Balestriero, Morgan LevineRepresentation Learning World Models
Altos Labs · Brown University
The Evaluation Protocol Determines the Result: An Independent Reproduction of LeWorldModel on TwoRoom
Aug 10, 2026Joyjeet SinghWorld Model-Based Planning Long-Horizon Agent Evaluation
Independent researcher
WorldSimProbe: Diagnosing Simulator Faithfulness in Action-Conditioned World Models for Embodied Manipulation
Aug 10, 2026Peterson Co, Sicheng Hu, Chunxuan Jiao +17Robotics Simulation Action-Conditioned World Models
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University
SurgWMBench: A Vision-Based Benchmark for World-Modeling Surgical Instrument Motion Planning
Aug 8, 2026Huanrong Liu, Weiliang Huang, Bob Zhang +3World Models for Robotics World Model-Based Planning
University of Macau · Xiamen University · National University of Singapore
Beyond Myopic World Models: Long-Horizon End-to-End Training for Direct Future Prediction
Aug 7, 2026Xinyi Li, Zaishuo Xia, Chenjie Hao +1World Model Learning Action-Conditioned World Models
University of California, Davis
MemWM: Memory-Augmented Text-Based World Model
Aug 7, 2026Yujun Wang, Tao Zhang, Jinhe Bi +9LLM World Models World Model Learning
LMU Munich · Munich Center for Machine Learning (MCML) · Huawei Heisenberg Research Center +4
GAUGE: A Measurement-Grounded Benchmark for Physical Fidelity in Simulation Engines and Video World Models
Aug 6, 2026Shuai Wang, Yaxin Feng, Xuekun Jiang +12Physical Consistency in Video Generation World Model Evaluation
1Shanghai Artificial Intelligence Laboratory · 2Hong Kong University of Science and Technology · 3Shanghai Jiao Tong University +1
AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents
Aug 6, 2026Weikai Xu, Yunren Feng, Haoxiang Lei +6Mobile GUI Automation World Model Learning
1Nanyang Technological University, Singapore · University of Electronic Science and Technology of China · 3Independent Researchers +2
WorldCycle: Self-Verifiable Reinforcement Learning for Long-Horizon Video World Models
Aug 5, 2026Bohai Gu, Yueyang Yuan, Taiyi Wu +9World Model-Based Planning Action-Conditioned World Models
1The Hong Kong University of Science and Technology · 2Wuhan University · 3AI Technology Center, Tencent Video, Tencent
WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity
Aug 3, 2026Yuxue Yang, Shuyao Shang, Jiahe Wang +13Controllable Video Generation World Model Evaluation
1CASIA · 4AMAP · 5THU +2
WM-Cov: Test Adequacy for Interactive World-Model-Style Autonomous Driving Simulation
Jul 31, 2026Jianxun Cui, Ping Wu, Stanisa Peric +2Autonomous Driving Safety Evaluation World Model Evaluation
School of Transportation Science and Engineering, Harbin Institute of Technology, Harbin, China · Chongqing Research Institute of HIT, Chongqing, China · Chongqing Changan Automobile Co., Ltd., Chongqing, China +2
BWM: A Low-Cost High-Fidelity World Simulator for Robot Learning
Jul 31, 2026BWM TeamWorld Models for Robotics Robotics Simulation
Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluation
Jul 30, 2026Fazhong Liu, Zhuoyan Chen, Haozhen Tan +3AI Agent Security World Model Evaluation
Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translation
Jul 28, 2026Zhaoyan Chen, Zhongxiu Cong, Zhuanfeng Jin +7World Model Learning Longitudinal EHR Modeling
National and Local Joint Engineering Laboratory of Computer Aided Design, School of Software Engineering, Dalian University, Dalian, China · Department of Radiology, Xinhua Hospital Affiliated to Dalian University, Dalian, China · The Chinese University of Hong Kong, Shenzhen, China +3
TRW: TRACE-RealWorld---An Auditable Consistency Contract for World Models as Materialized Views
Jul 24, 2026Edward Y. ChangWorld Models World Model-Based Planning
Stanford University
KineBench: Benchmarking Embodied World Models via IDM-Free Kinematic Grounding
Jul 22, 2026Zeyu Liu, Zhangzhe Zhu, Yang Zhang +3Physical Consistency in Video Generation Robot Manipulation Benchmarks
Institute of Artificial Intelligence (TeleAI), China Telecom, China · National University of Singapore, Singapore · Fudan University, China +2

Sep 9, 2026, cs.CVJ/K move · Enter open · S save

Programmable World Model

Zheng-Hui Huang, Guixu Lin, Jiacheng Lin, Yi-Chuan Huang+7

Alaya Lab

World Models Controllable Video Generation World Model Evaluation Interactive World Models Video World Models

Open paper AskPDF arXiv

Recent video world models generate increasingly realistic and interactive visual experiences, yet lack reliable mechanisms for maintaining persistent world state and enforcing programmable rules over extended interactions. We introduce Programmable World Model, a framework that decouples world-state evolution from visual observation generation. An agent translates natural-language instructions into executable programs that specify entity states and state-transition rules, enabling direct control over individual entities and their interactions. A lightweight engine executes these programs to update and maintain an explicit, persistent global world state, including off-screen entities and non-visual attributes. To connect world state with visual generation, we introduce state-augmented 3D oriented bounding boxes (OBBs) as an intermediate representation. This representation, together with the target camera trajectory, is deterministically compiled into pixel-aligned spatiotemporal conditioning signals for a pretrained video model serving as the generative renderer. This design allows users to create playable games with predefined mechanics, direct control over individual entities, and persistent world state throughout gameplay. We further introduce CombatStateBench, a benchmark for evaluating programmable world models. On CombatStateBench, our method achieves 94% Count Accuracy and 98% State Accuracy, substantially outperforming existing interactive video world models while supporting coherent long-horizon generation. These results demonstrate the effectiveness of separating explicit state evolution from generative rendering for building persistent, programmable worlds.

Momentum

Related topics

Latest papers 146