Portrait Animation

Portrait animation aims to realistically animate a static portrait image using various driving signals, such as audio, video, or landmarks, to create dynamic videos. Current research heavily utilizes diffusion models and other deep learning architectures like GANs and UNets, focusing on improving controllability (e.g., through mixed-modal input, landmark manipulation, or 3D representations) and efficiency (e.g., for real-time mobile applications). These advancements enhance the realism and expressiveness of generated animations, with implications for applications ranging from video conferencing and entertainment to personalized avatars and creative content generation.

Papers