Optical Flow
Optical flow, the estimation of apparent motion in image sequences, is a fundamental computer vision task aiming to understand and represent movement in visual data. Current research emphasizes improving accuracy and efficiency in challenging conditions like adverse weather and low-light, often employing deep learning architectures such as recurrent neural networks, transformers, and convolutional neural networks, sometimes integrated with other modalities like depth or inertial measurements. This field is crucial for numerous applications, including autonomous driving, robotics, video processing (e.g., inpainting, deblurring), and medical image analysis, with ongoing efforts focused on developing more robust, efficient, and generalizable methods.
Papers
Tracking Everything Everywhere All at Once
Qianqian Wang, Yen-Yu Chang, Ruojin Cai, Zhengqi Li, Bharath Hariharan, Aleksander Holynski, Noah Snavely
FlowFormer: A Transformer Architecture and Its Masked Cost Volume Autoencoding for Optical Flow
Zhaoyang Huang, Xiaoyu Shi, Chao Zhang, Qiang Wang, Yijin Li, Hongwei Qin, Jifeng Dai, Xiaogang Wang, Hongsheng Li
The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation
Saurabh Saxena, Charles Herrmann, Junhwa Hur, Abhishek Kar, Mohammad Norouzi, Deqing Sun, David J. Fleet
Unifying (Machine) Vision via Counterfactual World Modeling
Daniel M. Bear, Kevin Feigelis, Honglin Chen, Wanhee Lee, Rahul Venkatesh, Klemen Kotar, Alex Durango, Daniel L. K. Yamins
FEDORA: Flying Event Dataset fOr Reactive behAvior
Amogh Joshi, Adarsh Kosta, Wachirawit Ponghiran, Manish Nagaraj, Kaushik Roy
Parallelizing Optical Flow Estimation on an Ultra-Low Power RISC-V Cluster for Nano-UAV Navigation
Jonas Kühne, Michele Magno, Luca Benini
MFT: Long-Term Tracking of Every Pixel
Michal Neoral, Jonáš Šerých, Jiří Matas