Designing with Cinematic Language: An Intent-Driven Approach to Human-AI Video Clip Co-Creation
Organizations: aiDVX Lab, College of Design and Innovation, Tongji University, Shanghai, China · Innovation Center for Intelligent Design, Shanghai Innovation Institute, Shanghai, China · Shanghai Research Institute for Intelligent Autonomous Systems, Shanghai, China
Abstract
Generative video models have made video creation more accessible, yet creators still struggle to translate high-level narrative intentions into coherent cinematic expressions. Existing systems primarily rely on prompt refinement or expose isolated camera controls, leaving a gap between what to express and how to film it. We present CineAssist, a human-AI co-creation system that treats cinematic language as an interactive design medium connecting creative intentions with executable video controls. We construct a Cinematic Language Design Space and an annotated dataset from 107 filmmaking sources and 1,436 film clips, linking communicative intentions to cinematic parameter values. CineAssist combines a multi-agent workflow for intent alignment and strategy recommendation with an interactive cinematic editor and a context-sensitive preference learner for user-controlled personalization. We evaluate the system through three studies examining end-to-end usability, cinematic quality, and preference evolution. Results show that CineAssist facilitates efficient, controllable, and personalized intent-driven cinematic video creation.
Figures & tables
| ID | Group | Age | Gender | Background | YoE | GenAI tools used |
| E1 | Experienced | 29 | M | Director | 5 years | Runway, Kling, Jimeng AI (Dreamina) |
| E2 | Experienced | 34 | M | Writer-director | 4 years | Vidu, Runway, Kling, Jimeng AI (Dreamina) |
| E3 | Experienced | 31 | F | Director | 5 years | Jimeng AI (Dreamina), ComfyUI, Kling |
| E4 | Experienced | 28 | M | AI filmmaking practitioner | 5 years | Vidu, Kling |
| E5 | Experienced | 36 | M | Director | 6 years | Jimeng AI (Dreamina), Runway, Pika, Kling |
| E6 | Experienced | 39 | M | AI filmmaking practitioner | 8 years | Stable Diffusion, ComfyUI, Runway, Kling |
| Dimension | Representative Values |
| Shot scale | Extreme wide; wide; full; medium; medium close-up; close-up; extreme close-up |
| Composition | Centered; symmetry; rule of thirds; leading lines; negative space; foreground occlusion |
| Camera angle and viewpoint | Eye-level; low angle; high angle; overhead; subjective/POV; objective observation |
| Camera movement | Static; push-in; pull-out; pan; tilt; tracking; orbit; handheld |
| Focal length | Wide-angle; standard; telephoto |
| Depth of field | Deep; medium; shallow |
Human-AI Co-Creation
Human-AI co-creation studies how people and AI jointly develop ideas, artifacts, and decisions while preserving meaningful human agency.
See all 164 papers