Latent Motion

Latent motion modeling focuses on representing and manipulating the underlying movement patterns in data, such as videos or human activity, using lower-dimensional latent representations. Current research emphasizes the development of sophisticated models, including diffusion models, transformers, and variational autoencoders, to learn these latent representations for tasks like video generation, interpolation, and anomaly detection. This work has significant implications for diverse fields, improving the accuracy of medical image analysis (e.g., cardiac strain assessment), enhancing human-computer interaction (e.g., realistic gesture generation), and providing more nuanced understandings of urban dynamics through mobility data analysis. The resulting improvements in efficiency and accuracy across these applications highlight the growing importance of latent motion modeling.

Papers