cs.CVNov 18, 2026

VOL-Agent: Programming Your Film via Video Orchestration Language Agentic System

Authors: Hongji Yang, Yucheng Zhou, Lingting Zhu, Shengju Qian, Xinye Li, Huan Zheng, Dongyue Lu, Wei Chow, 

Organizations: SKL-IOTSC, Department of AIX, University of Macau · LIGHTSPEED · CUHK · NUS

Abstract

Recent video foundation models generate high-quality and limited-length clips, but orchestrating them into minute-level, story-coherent films remains an open problem. Existing video agents highly rely on natural-language planning or predefined workflows, which make their production hard to program, customize, and extend. Therefore, we introduce VOL-Agent, a programmable video agent built on a Video Orchestration Language (VOL). With static compilation and verification, followed by runtime dynamic loading, VOL-Agent decouples structural reliability from execution flexibility. Through the skill-driven executor, VOL-Agent dynamically resolves tools and skills from an open-world repository and supports user-defined skills in natural language. Moreover, VOL-Agent is capable of crafting new director skills from learned knowledge and improves itself through feedback to accumulate filmmaking knowledge. To overcome the disconnect between different segments, we apply a structural memory mechanism to record and recall world and entity states, sustaining entity and scene consistency across different shots. Critic feedback supports local revision, while reusable filmmaking knowledge and experiences can be retained for subsequent tasks. Experiments on three benchmarks show that VOL-Agent generates minute-scale videos with strong overall quality and limited cost.

Figures & tables

Explore similar work

CardsList
  1. Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generation

    Apr 10, 2026Haobo Hu, Qi Mao, Yuanhang Li +1Agentic Video GenerationVideo Generation

  2. FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Production

    Aug 30, 2026Zhendong Li, Lei Sun, Letian Shi +8Multi-Agent OrchestrationAgentic Video Generation

  3. VideoAgent: All-in-One Framework for Video Understanding and Editing

    Jun 22, 2026Hengji Zhou, Lingxuan Huang, Jian Wang +4Video Editing BenchmarksAgentic Video Editing