cs.CVApr 11, 2026

Prompt Relay: Inference-Time Temporal Control for Multi-Event Video Generation

Authors: Gordon Chen, Ziqi Huang, Ziwei Liu

Organizations: S-Lab, Nanyang Technological University

Abstract

Video diffusion models have achieved remarkable progress in generating high-quality videos. However, these models struggle to represent the temporal succession of multiple events in real-world videos and lack explicit mechanisms to control when semantic concepts appear, how long they persist, and the order in which multiple events occur. Such control is especially important for movie-grade video synthesis, where coherent storytelling depends on precise timing, duration, and transitions between events. When using a single paragraph-style prompt to describe a sequence of complex events, models often exhibit semantic entanglement, where concepts intended for different moments in the video bleed into one another, resulting in poor text-video alignment. To address these limitations, we propose Prompt Relay, an inference-time, plug-and-play method to enable fine-grained temporal control in multi-event video generation, requiring no architectural modifications and no additional computational overhead. Prompt Relay introduces a penalty into the cross-attention mechanism, so that each temporal segment attends only to its assigned prompt, allowing the model to represent one semantic concept at a time and thereby improving temporal prompt alignment, reducing semantic interference, and enhancing visual quality.

Figures & tables

Explore similar work

CardsList
  1. SwitchCraft: Training-Free Multi-Event Video Generation with Attention Controls

    Feb 27, 2026Qianxun Xu, Chenxi Song, Yujun Cai +1Video GenerationControllable Video Generation

  2. TS-Attn: Temporal-wise Separable Attention for Multi-Event Video Generation

    Apr 21, 2026Hongyu Zhang, Yufan Deng, Zilin Pan +6Image-to-Video GenerationT2V Generation

  3. Temporal Specification Guidance for Text-to-Video Generation

    Oct 14, 2026Avishree Khare, Hideki Okamoto, Bardh Hoxha +2T2V GenerationControllable Video Generation