Interactive World Models

Follow this topic Ask about this topic

Momentum

13 papers in the last four weeks, up 30% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 86

All topics

WorldCast: Distributed Multiplayer World Models
Oct 8, 2026Ziyang Ye, Junchao Huang, Evelyn Zhang +9World Models Interactive World Models
CUHK-Shenzhen · SLAI · Tsinghua SIGS +2
MultiWorldBench: Do Independently Controlled Views Describe One Shared World?
Oct 8, 2026Zhangbo Xu, Ruoxi Zhang, Rui Hu +1Multi-View Consistency World Model Evaluation
Zhiying Guangnian Technology Co., Ltd.
UltraWorld: Learning Interactive Ultrasound World Models from Untracked Clinical Videos with Acoustic Sampling Map
Oct 7, 2026Keke Yang, Erqi Wang, Sainan Guan +1Interactive World Models World Models for Robotics
The Chinese University of Hong Kong · The Eighth Affiliated Hospital, Sun Yat-sen University
From Traces to Agentic Worlds: Agentic Language World Models for Interactive Environment Simulation
Oct 5, 2026Quanyu Long, Xiao Chen, Jianda Chen +4LLM World Models Interactive World Models
Nanyang Technological University · The Hong Kong Polytechnic University
Video2World: Benchmarking Coding Agents for Interactive World Modeling from Embodied Videos
Oct 3, 2026Jinzhou Tang, Zijun Zhang, Jing Yang +10Interactive World Models Coding Agents
Aether AI · University of California, San Diego
Oneira: From Open-Ended Generation to Open-World Interaction in Video World Models
Oct 1, 2026Xindi Yang, Baolu Li, Liam Lee +8Long-Horizon Video Generation Action-Conditioned World Models
Monash University · Dalian University of Technology · The Chinese University of Hong Kong, Shenzhen +2
ReWAM: Reciprocal World Action Models for Interactive Autonomous Driving
Sep 30, 2026Benshan Ma, Pei Liu, Ruiguo Zhong +4Action-Conditioned World Models Multi-Agent Systems
The Hong Kong University of Science and Technology (Guangzhou) · Leapmotor · The Hong Kong University of Science and Technology
HelixWorld: A Real-time Interactive Audio-Visual World Model
Sep 29, 2026Lei Ke, Jiahao Pan, Zeyue Tian +13World Model Learning Real-Time Interactive Video Generation
The Hong Kong University of Science and Technology · Noiz AI
Waypoint-1.5: A Real-Time Video World Model for Consumer Hardware
Sep 29, 2026Rajit Rajpal, Shahbuland Matiana, Liew Wei Pyn +12Video Diffusion Models Real-Time Interactive Video Generation
HuggingFace
WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon
Sep 28, 2026Haiyu Zhang, Wenqiang Sun, Tengfei Wang +5Long-Horizon Video Generation World Models
Precise Editing and Flexible Referencing for Interactable Worlds
Sep 28, 2026Xinyao Liao, Xianfang Zeng, Zhu Liang +5Instruction-Based Video Editing Autoregressive Video Generation
Nanyang Technological University · StepFun
CAST: Reconstruction-Coupled Acceleration of Interactive World Models
Sep 28, 2026Leyang Chen, Junyi Wu, Fanqing Kong +2Real-Time Interactive Video Generation Inference Acceleration
Shanghai Jiao Tong University
HappyWorld-Bench
Sep 21, 2026Zhiqi Bai, Junai Cai, Yixin Chen +33World Models World Model Evaluation
Alibaba Token Hub, Alibaba Group · State Key Laboratory of General Artificial Intelligence, BIGAI · Tsinghua University +2
Continual Enterprise World Model Discovery in Dynamic Systems
Sep 17, 2026Shambhavi Mishra, David Vazquez, Perouz Taslakian +3World Model Learning World Model Evaluation
ServiceNow Research · LIVIA, ILLS, ÉTS Montréal · Université Polytechnique Montréal +3
Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control
Sep 15, 2026Mingyang Chen, Shengdong Chen, Xiaoxiao Fu +13Action-Conditioned Video Generation Real-Time Interactive Video Generation
Zing Team, SeedLeap.ai
Programmable World Model
Sep 9, 2026Zheng-Hui Huang, Guixu Lin, Jiacheng Lin +8World Models Controllable Video Generation
Alaya Lab
ActionSplice: In-Flight Action Editing for Interactive World Models
Sep 8, 2026Pardis Taghavi, Tingyu Guo, Jonas Lossner +2Action-Conditioned Video Generation Efficient Inference for World Action Models
Texas A&M University
Long-Horizon Consistent and Interaction-Aware World Models for Multi-Style End-to-End Driving
Sep 3, 2026Yuxuan Han, Kunyuan Wu, Liyunong Yang +4End-to-End Autonomous Driving World Models for Autonomous Driving
School of Intelligence Science and Engineering, Harbin Institute of Technology, Shenzhen, China · Autonomous Driving Center, Shanghai Utopilot Technology Co.Ltd., China
Solaris: Towards Interfaces That Are Generated, Not Coded
Sep 1, 2026Yuval Alaluf, Omri Avrahami, Guy Bukchin Leshem +18Interactive World Models
Runway
IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Training
Aug 31, 2026Rongze Tang, Jianjie Fang, Zhaolu Wang +8World Model Learning Action-Conditioned World Models
University of Science and Technology of China · 2Zhongguancun Academy · 3Tsinghua University +1
WebWorld: The Browser as a World Model for Self-Improving Web Code
Aug 31, 2026Jiajun Wu, Jian Yang, Yaxin Du +7Self-Training for Language Models Code Generation
Beihang University · Shanghai Jiao Tong University · IQuest Research +1
Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory
Aug 30, 2026Runjia Qian, Zile Wang, Jihai Zhang +14Camera-Controlled Video Generation Real-Time Interactive Video Generation
Riemann Dynamics
BehaviorWorldGen: Closing the Loop between Action Models and World Simulators via Controllable Behavior-Aware Structured World Generation
Aug 23, 2026Jiaqi Wang, Zhuo Zhang, Haining Guan +15Action-Conditioned World Models World Models for Autonomous Driving
AFARI World Model Team
PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
Aug 13, 2026Kaixin Ding, Xi Chen, Minghong Cai +9Long-Horizon Agent Evaluation World Model Evaluation
The University of Hong Kong · Kling Team, Kuaishou Technology · The Chinese University of Hong Kong +1
Alaya-EVOKE: From Linear-Scaling Supervision to Endless World
Aug 13, 2026Yuanyang Yin, Gongxuan Wang, Yifan Zhan +3Open-Ended Generation Long-Horizon Video Generation
MoE Key Lab of BIPC, USTC · Shanghai Innovation Institute · Alaya Lab
AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report (v1.1)
Aug 13, 2026AlayaWorld Team, Kaipeng Zhang, Chuanhao Li +15Camera-Controlled Video Generation Long-Horizon Video Generation
Alaya Lab
Sekai2: From World Exploration to Interactive World Modeling
Aug 10, 2026Kang He, Wenshuo Peng, Zihui Gao +3Camera-Controlled Video Generation Long-Horizon Video Generation
1Alaya Lab · 2Shanghai Innovation Institute · 3Wuhan University +1
Population-Scalable Multi-Agent World Modeling
Aug 9, 2026Renjie Zhao, Yuxiang Wu, Mingyu Zhang +7World Model Learning Multi-Agent Systems
Shanghai Jiao Tong University
GeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actions
Aug 6, 2026Chenghao Gu, Hanyang Yu, Jingbo Zhang +7Action-Conditioned World Models Robotic Policy Evaluation
Shenzhen International Graduate School, Tsinghua University · Tencent Robotics X · The Hong Kong University of Science and Technology +1
AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents
Aug 6, 2026Weikai Xu, Yunren Feng, Haoxiang Lei +6Mobile GUI Automation World Model Learning
1Nanyang Technological University, Singapore · University of Electronic Science and Technology of China · 3Independent Researchers +2

Oct 8, 2026, cs.CVJ/K move · Enter open · S save

WorldCast: Distributed Multiplayer World Models

Ziyang Ye, Junchao Huang, Evelyn Zhang, Zhihao Xie+8

CUHK-Shenzhen · SLAI · Tsinghua SIGS+2

World Models Interactive World Models Real-Time Interactive Video Generation Video World Models

Open paper AskPDF arXiv

Multiplayer world models must generate independently controlled views with consistent representations of both players and their shared environment. Most existing approaches coordinate multiple players through joint multi-view generation, whose cost grows with each additional player. We present WorldCast, a distributed multiplayer world model in which each player runs a local client comprising a video generator and a state model. Using recorded player positions and map geometry during training, the state model estimates the player's position from generated video and control inputs. Clients exchange player states and project them into camera-aligned player state fields that guide where and how other players are rendered. Shared scene state enables clients to reuse one another's generated observations to maintain consistent scene appearance across views. Experiments on Counter-Strike 2 demonstrate WorldCast's consistency, real-time performance, and distributed scalability. The camera-aligned player state field improves player rendering rates by over an order of magnitude over joint-generation methods, while shared scene state improves visual consistency over whole rounds. Each client runs in real time and exchanges only player and scene states, enabling scalable multiplayer generation without a centralized computational bottleneck. Image quality remains stable over hour-long rollouts.

Momentum

Related topics

Latest papers 86