cs.CVSep 24, 2026

MVAgent: Multi-Agent Video Generation via Consistent Condition Construction and Shot-Level Policy Optimization

Authors: Xiangyu Kong, Wenjie Zhou, Fengping Tian, Lihua Fang, Haoqin Sun, Chenyang Lyu, Longyue Wang, Weihua Luo

Organizations: University of Exeter, United Kingdom · Alibaba Group, China

Abstract

Multi-shot agentic video generation requires consistent character appearance, stable spatial layout across camera angles, and continuous character state between shots. When every shot is a separate request to a frozen generator, repeated text does not determine appearance, layout or state. We therefore recast the problem as condition construction and present MVAgent, a multi-agent pipeline whose agents collaborate through typed conditioning inputs. Because an environment image shows one viewpoint, a Spatial Grounding agent samples views from generated camera-traversal clips and anchors each shot to the view matching its framing. As generated shots drift from the plan, an Observer records how each shot ends in a continuity memory, from which a Transition agent builds character action and spatial references for the next shot. An Orchestrator composes these inputs into each request. Since a request reveals its effect only after rendering, we train it by agentic reinforcement learning with Trunk-GDPO, which compares rendered candidates at every shot rather than once per video and continues the best as the trunk. With generator and judges frozen, MVAgent attains the highest cross-shot consistency and narrative-planning quality among the compared methods on ViMax-Bench and is preferred over the strongest agentic baseline in human evaluation.

Figures & tables

Explore similar work

CardsList
  1. ViMax: Agentic Video Generation

    Jun 2, 2026Lingxuan Huang, Sizhe He, Hengji Zhou +3Long Video GenerationAgentic Video Generation

  2. Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generation

    Oct 14, 2026Weijie Wang, Haomin Zhang, Ye Li +7Agentic Video GenerationMulti-Shot Video Generation

  3. VideoGen-Agent: Reinforcing Video Generation Agents

    Sep 21, 2026Binxu Li, Haoyi Duan, Yuhui Zhang +9RL for Video GenerationAgentic Video Generation