cs.CVNov 19, 2026

ContextRenderer: Dynamic-Context Video Generation for Interactive Game Worlds

Authors: Runze Wang, Fei Zha, Bing He, Ke Xu, Zhongyuan Wu, Yuxuan Xie, Wenzheng Wu, Zhongyuan Liu, 

Organizations: University of Science and Technology of China · Shanghai Jiao Tong University · University of British Columbia · Harbin Institute of Technology

Abstract

Interactive game world models separate executable world evolution from visual generation, using video models to render engine-provided scene representations into detailed observations. During sustained gameplay, however, existing generative renderers struggle to follow changing conditions while preserving visual continuity across diverse proxies and target styles. We therefore introduce ContextRenderer, an autoregressive video diffusion framework designed for both dynamic conditioning and cross-proxy generalization. It couples Dynamic-Context Learning (DCL) for chunk-level interaction supervision with Recurrent History Compression (RHC) to follow condition updates while preserving visual continuity within a bounded token budget. Across proxy representations, Cross-Representation Flow Alignment (CRFA) connects proxy reconstruction with appearance and interaction variation through a shared high-fidelity reconstruction. WorldPrism, our interaction-centric dataset constructed from agent-built worlds, AAA gameplay, and open-source videos, supplies the corresponding renderings and chunk-level annotations for these learning tasks. Experiments on GWM-Bench and Solar-Bench show improved reconstruction and visual quality, while qualitative results demonstrate minute-long interactive rendering under changing prompts and subject references. Project page: https://rainzor.github.io/contextrenderer/

Figures & tables

Explore similar work

CardsList
  1. BoxWorld: Let World Engines Control and Video Generators Render

    Oct 26, 2026Zike Wu, Ahmed Hatem, Chintan Trivedi +4Real-Time Interactive Video GenerationInteractive World Models

  2. WorldDraft: If Code Builds the World, Can Video Models Just Render It?

    Nov 12, 2026Zhiyu Hou, Wen-Jie Shu, Harold Haodong Chen +7Video GenerationPhysical Consistency in Video Generation