cs.CVFeb 26, 2026

UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Models

Authors: Tianxing XuZixuan WangGuangyuan WangLi HuZhongyi ZhangPeng ZhangBang ZhangSonghai Zhang

Abstract

World models based on video generation demonstrate remarkable potential for simulating interactive environments yet suffer from persistent difficulties in two key areas: maintaining long-term content consistency when scenes are revisited and enabling precise camera control from user-specified inputs. Existing methods based on explicit 3D reconstruction often compromise flexibility in unbounded scenarios and struggle to preserve fine-grained structures. Alternative methods rely directly on previously generated frames without establishing explicit spatial correspondence, thereby limiting controllability and consistency. To address these limitations, we present UCM, a novel framework for unified modeling of long-term memory and precise camera control via a time-aware positional encoding warping mechanism. To reduce computational overhead, we design an efficient dual-stream diffusion transformer for high-fidelity generation. Moreover, we introduce a scalable data curation strategy that utilizes point-cloud-based rendering to simulate scene revisiting, enabling training on over 500K monocular videos. Extensive experiments on real-world and synthetic benchmarks demonstrate that UCM significantly outperforms state-of-the-art methods on long-term scene consistency, while achieving precise camera controllability in high-fidelity video generation.

Explore similar work

CardsList
  1. Wonder: Video World Model Done Better

    Jul 28, 2026Jiacong Xu, Hanwen Jiang, Zhixin Shu +3Video World Models