Optical Flow
Optical flow, the estimation of apparent motion in image sequences, is a fundamental computer vision task aiming to understand and represent movement in visual data. Current research emphasizes improving accuracy and efficiency in challenging conditions like adverse weather and low-light, often employing deep learning architectures such as recurrent neural networks, transformers, and convolutional neural networks, sometimes integrated with other modalities like depth or inertial measurements. This field is crucial for numerous applications, including autonomous driving, robotics, video processing (e.g., inpainting, deblurring), and medical image analysis, with ongoing efforts focused on developing more robust, efficient, and generalizable methods.
Papers
Deformation Monitoring of Tunnel using Phase-based Motion Magnification and Optical Flow
Kecheng Chen, Hiroshi Kogi, Kenichi Soga
Infinite Photorealistic Worlds using Procedural Generation
Alexander Raistrick, Lahav Lipson, Zeyu Ma, Lingjie Mei, Mingzhe Wang, Yiming Zuo, Karhan Kayan, Hongyu Wen, Beining Han, Yihan Wang, Alejandro Newell, Hei Law, Ankit Goyal, Kaiyu Yang, Jia Deng
Neural World Models for Computer Vision
Anthony Hu
SplatFlow: Learning Multi-frame Optical Flow via Splatting
Bo Wang, Yifan Zhang, Jian Li, Yang Yu, Zhenping Sun, Li Liu, Dewen Hu
Tracking Everything Everywhere All at Once
Qianqian Wang, Yen-Yu Chang, Ruojin Cai, Zhengqi Li, Bharath Hariharan, Aleksander Holynski, Noah Snavely
FlowFormer: A Transformer Architecture and Its Masked Cost Volume Autoencoding for Optical Flow
Zhaoyang Huang, Xiaoyu Shi, Chao Zhang, Qiang Wang, Yijin Li, Hongwei Qin, Jifeng Dai, Xiaogang Wang, Hongsheng Li
The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation
Saurabh Saxena, Charles Herrmann, Junhwa Hur, Abhishek Kar, Mohammad Norouzi, Deqing Sun, David J. Fleet
Unifying (Machine) Vision via Counterfactual World Modeling
Daniel M. Bear, Kevin Feigelis, Honglin Chen, Wanhee Lee, Rahul Venkatesh, Klemen Kotar, Alex Durango, Daniel L. K. Yamins
FEDORA: Flying Event Dataset fOr Reactive behAvior
Amogh Joshi, Adarsh Kosta, Wachirawit Ponghiran, Manish Nagaraj, Kaushik Roy
Parallelizing Optical Flow Estimation on an Ultra-Low Power RISC-V Cluster for Nano-UAV Navigation
Jonas Kühne, Michele Magno, Luca Benini
MFT: Long-Term Tracking of Every Pixel
Michal Neoral, Jonáš Šerých, Jiří Matas