Attention of a Kiss: Generative Video Attention Maps as Explainable and Creative Material
Organizations: University of the Arts London London, UK
Abstract
This paper presents an artistic and technical investigation into the attention mechanisms of video diffusion transformers. Inspired by early video artists who manipulated analog video signals to create new visual aesthetics, this study proposes a method for extracting and visualizing cross-attention maps in generative video models. Built on the open-source Wan model, our tool provides an interpretable window into the temporal and spatial behavior of attention in text-to-video generation. Through exploratory probes and a series of artistic case studies, we examine the potential of attention maps as both analytical tools and raw artistic material. This work contributes to the growing field of Explainable AI for the Arts (XAIxArts), inviting artists to reclaim the inner workings of AI as a creative medium.
Figures & tables
| Probe Type | Prompt Text (Tracked Tokens in Bold) | Figure |
|---|---|---|
| Single Object | A cute black cat playing in a green field | Fig. 2 |
| Multiple Objects | A cute black cat playing with a ball in front of the Eiffel Tower | Fig. 4, 6 |
| Motion | A red car driving fast through the rocky mountains | Fig. 5 |
| Abstract Action | A cinematic romantic kiss between two people | Fig. 5 |
Computational Creativity
Computational creativity studies how machines can generate, evaluate, and collaborate on novel, valuable ideas and artifacts.
See all 125 papers