Camera Motion
Camera motion estimation and control are central to numerous computer vision tasks, aiming to accurately determine and manipulate camera trajectories for applications like 3D scene reconstruction, video generation, and object tracking. Current research emphasizes robust methods for estimating camera pose from various data sources (RGB, RGB-D, inertial data), often employing neural networks (e.g., transformers, convolutional neural networks) and optimization techniques (e.g., bundle adjustment, genetic algorithms) to handle challenges like motion blur, rolling shutter effects, and dynamic scenes. These advancements are crucial for improving the accuracy and efficiency of numerous applications, ranging from autonomous navigation and augmented reality to cinematic video production and medical imaging.
Papers
ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuning
David Junhao Zhang, Roni Paiss, Shiran Zada, Nikhil Karnad, David E. Jacobs, Yael Pritch, Inbar Mosseri, Mike Zheng Shou, Neal Wadhwa, Nataniel Ruiz
SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generation
Koichi Namekata, Sherwin Bahmani, Ziyi Wu, Yash Kant, Igor Gilitschenski, David B. Lindell