Dynamic Portrait

Dynamic portrait generation aims to create realistic and controllable animated portraits from various input sources, such as audio, monocular videos, or still images. Current research focuses on developing sophisticated models, often employing 3D morphable models, Gaussian splatting, or diffusion-based methods, to achieve high-fidelity reconstructions with accurate lip synchronization and expressive control, often leveraging techniques like tri-plane generation and hierarchical audio-visual synthesis. These advancements are significant for applications in virtual reality, augmented reality, and digital avatar creation, offering improved realism and user interaction capabilities.