DramaAgent: Agentic Storytelling Video Generation
Organizations: Peking University · UTS AAII · UOL · UTHealth Houston ·
Abstract
Recent diffusion and autoregressive models have substantially improved text-to-video generation, yet producing coherent long-form story videos with consistent characters and aligned audio remains challenging. Existing methods often suffer from narrative drift, unstable character identity, weak cross-scene continuity, and audio-visual mismatch over extended sequences. We propose DramaAgent, a hierarchical, agentic, and model-agnostic framework for long-form text-to-video-and-audio generation. Rather than improving the underlying video backbone itself, DramaAgent introduces an upper-level control layer that decomposes generation into story planning, persistent character conditioning, scene-wise synthesis, and reflection-guided targeted repair. The framework maintains reusable story and character states across scenes, diagnoses failures such as identity drift, missing scene semantics, temporal discontinuity, and cross-modal mismatch, and repairs problematic clips in a stage-specific manner. Experiments across multiple video generation backbones show that DramaAgent improves long-horizon coherence, character consistency, narrative fidelity, and scene-level audio-visual consistency over direct generation and strong baselines. These results suggest that hierarchical agentic control is a practical direction for controllable long-form audiovisual generation. Code: https://github.com/AIGeeksGroup/DramaAgent. Website: https://aigeeksgroup.github.io/DramaAgent.
Figures & tables
| Method | CLIP | Inception | VBench Metrics /% | ||||
| Subject Cons. | Bg Cons. | Motion Smth. | Dyn. Degree | Aesthetic | |||
| Script Synopsis to Keyframe/StoryBoard Generation | |||||||
| StoryDiffusion Zhou et al. (2024) | 20.46 | 6.24 | - | - | - | - | - |
| AutoStory Wang et al. (2025) | 20.21 | 6.01 | - | - | - | - | - |
| MovieAgent Weijia Wu (2025) | 22.12 | 7.23 | - | - | - | - | - |
| DramaAgent (Ours) | 23.02 | 7.64 | - | - | - | - | - |
| Method | CLIP | Inception | VBench Metrics / % | ||||
|---|---|---|---|---|---|---|---|
| Subject Cons. | Bg Cons. | Motion Smth. | Dyn. Degree | Aesthetic | |||
| Direct Generation (Seedance) | 22.90 | 8.65 | 92.10 | 95.60 | 97.10 | 64.20 | 62.30 |
| + Story Planning | 23.55 | 8.95 | 93.80 | 96.30 | 97.45 | 65.10 | 62.90 |
| + Character Stills | 24.12 | 9.41 | 96.85 | 97.33 | 97.96 | 66.84 | 64.37 |
| + Reflective Repair (Full) | 24.34 | 9.67 | 97.02 | 97.54 | 98.14 | 67.32 | 64.91 |
| Method | CLIP | Inception | VBench Metrics / % | ||||
|---|---|---|---|---|---|---|---|
| Subject Cons. | Bg Cons. | Motion Smth. | Dyn. Degree | Aesthetic | |||
| DramaAgent (Wan2.2-I2V-Flash) | 23.47 | 9.56 | 94.12 | 93.95 | 96.92 | 70.15 | 54.32 |
| DramaAgent (Keling) | 23.78 | 9.35 | 95.64 | 95.82 | 97.43 | 66.92 | 58.14 |
| DramaAgent (Jimeng) | 23.96 | 9.38 | 96.42 | 96.71 | 98.02 | 80.45 | 61.27 |
| DramaAgent (Hailuo 3.0) | 22.91 | 9.12 | 96.34 | 97.27 | 98.61 | 84.31 | 61.32 |
| DramaAgent (Seedance) | 24.12 | 9.41 | 96.85 | 97.33 | 97.96 | 66.84 | 64.37 |
| Method | CLIP | Inception | VBench Metrics / % | ||||
| Subject Cons. | Bg Cons. | Motion Smth. | Dyn. Degree | Aesthetic | |||
| Script Synopsis to Keyframe/Storyboard Generation | |||||||
| DramaAgent w/o Reflection | 22.05 | 7.64 | - | - | - | - | - |
| DramaAgent w/ Reflection | 23.02 | 7.64 | - | - | - | - | - |
| Script Synopsis to Movie Generation | |||||||
| DramaAgent w/o Reflection | 24.12 | 9.41 | 96.85 | 97.33 | 97.96 | 66.84 | 64.37 |
Appendix figures & tables8 assets
Supplementary material from the paper’s appendix.
Appendix
| Backbone | Version / API Variant | Access Date | Input Type | Candidates / Scene | Repair Rounds | Clip Duration | Resolution |
|---|---|---|---|---|---|---|---|
| Wan2.2-I2V-Flash | Wan2.2-I2V-Flash | 2025-11 | image + text | 3 | 2 | 5s | 1280 720 |
| Keling | Keling | 2025-11 | image + text | 3 | 2 | 5s | 1280 720 |
| Jimeng | Jimeng | 2025-11 | text-only / multimodal | 3 | 2 | 5s | 1280 720 |
| Hailuo 3.0 | Hailuo 3.0 | 2025-11 | image + text | 3 | 2 | 5s | 1280 720 |
| Seeddance 3.0 | Seeddance 3.0 | 2025-11 | image + text | 3 | 2 | 5s | 1280 720 |
| Statistic | Value |
|---|---|
| Average initial generation time / scene | 75 s |
| Average repaired generation time / scene | 28 s |
| Average end-to-end time / 30–60s script | 18–32 min |
| Average API calls / scene | 4.1 |
| Approximate cost / minute of final video | $7.8 |
| Parameter | Value |
|---|---|
| 0.35 | |
| 0.30 | |
| 0.20 | |
| 0.15 | |
| Acceptance threshold | 0.80 |
| Early-stop threshold | 0.02 |
| Metric | DramaAgent Preference |
|---|---|
| Temporal Coherence | 66.7% |
| Character Consistency | 71.3% |
| Narrative Fidelity | 63.3% |
| Audio-Visual Alignment | 68.0% |
| Inter-rater Agreement (Fleiss’ Kappa) | 0.42 |
Video Generation
Video generation studies models that create and edit moving images from text, images, audio, and structured controls.
See all 354 papers