Future Video Prediction

Follow this topic Ask about this topic

Momentum

8 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 37

All topics

Variational Streaming Flow: Probabilistic Forecasting in Physical Time
Oct 1, 2026Hans Hao-Hsun Hsu, Minseon Gwak, Soon Hoe Lim +2Probabilistic Forecasting Velocity Field
Georgia Institute of Technology · Lawrence Berkeley National Lab · International Computer Science Institute +2
DiffWAM: A Fast and Efficient Navigation World Action Model
Sep 30, 2026Mo Zhu, Yuze Wu, Xijie Huang +3Aerial Vision-Language Navigation Future Video Prediction
Zhejiang University · Differential Robotics
Foresight at the Event Boundary: Evaluating Physical Prediction in Video World Models
Sep 29, 2026Estela Monserrat Arriaga Santana, Julian Rosas Scull, Ehécatl Sacamch'en Núñez Rico +1Future Video Prediction World Models
National Autonomous University of Mexico · National Autonomous University of Mexico, Mexico · University of Texas at El Paso +1
Lagrangian--Hamiltonian Flows for Video Prediction and Image Generation: A Symplectic Perspective
Sep 28, 2026Jiawei HuInvertible Flows Future Video Prediction
Department of Mathematics and Statistics, Boston University
ViBR-WM: Visual Bayesian Regression for World Modeling
Sep 27, 2026Jifan Li, Ning NingWorld Models Future Video Prediction
Department of Statistics, Texas A&M University College Station, TX 77843
MinkowskiPE: Minkowski Positional Encoding for Spatiotemporal Perception
Sep 27, 2026Yuhao Li, Louie Hong Yao, Tianyi Shi +4Positional Encoding Spatio-Temporal Reasoning
Wave Intelligence Lab · Department of Computer Science and Engineering, The Chinese University of Hong Kong · Shanghai Artificial Intelligence Laboratory
CausalWM: Causal Chain-of-Thought Reasoning for Embodied World Model
Sep 19, 2026Ziming Xu, Shuang Liang, Ruobing Han +10Efficient World-Action Model Future Video Prediction
Aether AI · University of California, San Diego · Vanderbilt University
RiVaT-Fuse: Reliability-Calibrated Variational Tensor Fusion with Matrix-Valued Trust for Multimodal Prediction under Modality Uncertainty
Sep 9, 2026Yingfan Xu, Tieming Liu, Ye LiangMultimodal Classification Future Video Prediction
School of Industrial Engineering and Management Oklahoma State University · Department of Statistics, Oklahoma State University
SV-WAM: An Efficient Surround-View World-Action Model for End-to-End Autonomous Driving
Sep 3, 2026Jinyang Wang, Shiwei Li, Junjian Wang +12Efficient World-Action Model Autonomous Driving
Institute of Automation, Chinese Academy of Sciences · 2Chongqing Changan Technology Co., Ltd. · 3Civil Aviation University of China +2
GeoRoute: Geometry-Aware Hybrid Inference for Traffic Future-Frame Prediction
Aug 10, 2026Khang Minh Le, Hieu Dinh Trung Pham, Luu Thanh Danh +8Future Video Prediction Autonomous Driving
PAMI Lab, Vietnamese-German University, Vietnam · University of Science, Ho Chi Minh City, Vietnam · GenAI4E Lab +2
4D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fields
Aug 8, 2026Lishan Yang, Wenxuan Song, Xi Wang +14Efficient World-Action Model Faster-Wam
Adelaide University · HKUST(GZ) · Tsinghua University +3
HOPE: Hand-Object Pressure Estimation from Monocular Videos
Aug 6, 2026Subin Jeon, Byungjun Kim, Hanbyul JooMonocular Video Motion Capture
Seoul National University · RLWRLD
Adaptive-WAM: Quality-Guided Early-Exit Planning from Intermediate Video-Diffusion Features
Aug 6, 2026Sining Ang, Yuguang Yang, Yan WangDiffusion Planning World Model Planning
Institute for AI Industry Research (AIR), Tsinghua University · Department of Automation, University of Science and Technology of China · School of Electronic Information Engineering, Beihang University
HERA: Historical Evidence Routing Adapter for Physical Prediction in Latent World Models
Aug 6, 2026Yuanruyi, Yue Cao, Haojia Gao +7Future Video Prediction Latent World Models
Chongqing University · Everwise-Tech Co., Ltd. · Research Institute of Tsinghua University in Shenzhen +2
Predict, Then Retrieve: Cross-Instance Future-State Retrieval from Video Prefixes
Aug 5, 2026Quynh Vo, Thong Nguyen, Vinh-Hien Do +2Future Video Prediction Next-State Prediction
Centre for AI Research, VinUniversity · National University of Singapore
Multi-Horizon Consistency as Geometry: When Latent Dynamics Contract, and When They Do Not
Jul 21, 2026Kavya Bhand, Aadi JoshiLatent Dynamics Long-Horizon Inference
Department of Computer Engineering Vishwakarma Institute of Technology, Pune, India
MotionForesight: Re-purposing Video Models for Future 3D Scene-Flow Prediction
Jul 17, 2026Homanga Bharadhwaj, Yash JangirHuman Motion Prediction Future Video Prediction
Department of Computer Science, Johns Hopkins University
Learning Physics-Guided Residual Dynamics for Deformable Object Simulation
Jul 15, 2026Shivansh Patel, Kaifeng Zhang, Sanjay Pokkali +2Deformable Linear Objects Physics Simulation
UIUC · Columbia University
LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Models
Jul 9, 2026Cheng-De Fan, Chun-Wei Tuan Mu, Chen-Wei Chang +4Video Diffusion Models Future Video Prediction
National Yang Ming Chiao Tung University, Taiwan
SUNTA: Hierarchical Video Prediction with Surprise-based Chunking
Jul 2, 2026Tomoshi Iiyama, Masahiro Suzuki, Yutaka MatsuoLong-Horizon Forecasting Future Video Prediction
The University of Tokyo
Learning Video Dynamics with Predictive Differentiable Rendering
Jun 30, 2026Yujin Tang, Tian Zhou, Xin Lin +5Future Video Prediction Differentiable Rendering
1Dartmouth College, USA · 2DAMO Academy, Alibaba Group, China · 6Ant Group, China +3
MaskWAM: Unifying Mask Prompting and Prediction for World-Action Models
Jun 11, 2026Hanyang Yu, Haitao Lin, Jingbo Zhang +4Efficient World-Action Model Faster-Wam
1The Hong Kong University of Science and Technology · ‡Work done during an internship at Tencent Robotics X · 2Tencent Robotics X +1
Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imagination
Jun 8, 2026Jiajun Li, Tiecheng Guo, Yifan Ye +9Efficient World-Action Model Faster-Wam
1The University of Hong Kong · 2Peking University · 3Muka Robotics +2
Momentum-Guided Semantic Forecasting (MoFore) for Self-Supervised Video Representation Learning
Jun 8, 2026Qinwu XuSelf-Supervised Representations Future Video Prediction
∗This work was independently developed during Early Feb –Mid April 2026.
Video-Based Prediction of In-Flight Particle Characteristics in Atmospheric Plasma Spraying
Jun 5, 2026Abhijeet Praveen, Sareh Soleimani, Cormac Cureton +4Future Video Prediction Aerial Navigation
Department of Electrical and Computer Engineering, McGill University, Montreal, QC H2X 2G6, Canada · Mila – Quebec AI Institute, Montreal, QC H2S 3H1, Canada · National Research Council of Canada, Boucherville, QC J4B 6G4, Canada
What Makes Video World Model Latents Action-Relevant: Prediction over Reconstruction
Jun 5, 2026Jewon Yeom, Hanseul Kim, Jeongjae Park +3Future Video Prediction World
Graduate School of Data Science, Seoul National University
Imagine Before You Predict: Interleaved Latent Visual Reasoning for Video Event Prediction
Jun 4, 2026Tianxiang Jiang, Linquan Wu, Sheng Xia +5Future Video Prediction Latent Visual Reasoning
University of Science and Technology of China · Shanghai AI Laboratory · City University of Hong Kong +4
Reinforcement Learning from Cross-domain Videos with Video Prediction Model
Jun 2, 2026Zhao Yang, Xinrui Zu, Jacob E. Kooi +5Future Video Prediction Long Videos
VU Amsterdam, The Netherlands · ISAE-SUPAERO, France
Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulation
Jun 1, 2026Shahram Najam Syed, Arthur Jakobsson, Haoran Hao +1Future Video Prediction Latent World Models
Robotics Institute, Carnegie Mellon University, Pittsburgh, USA
FlowTime: Towards Continuous Generative Watch Time Prediction via Flow-based Personalized Priors
May 31, 2026Hongxu Ma, Han Zhou, Chenghou Jin +5Future Video Prediction Short Video Bursts
Fudan University Shanghai, China · Kuaishou Technology Beijing, China · Shanghai University of Finance and Economics Shanghai, China +1
Towards Effective Long-Video Event Prediction via Multi-Level Event Semantics Mining
May 29, 2026Bo Peng, YuanJie Lyu, PengGang Qin +1Future Video Prediction Video-Language Models
University of Science and Technology of China
Nano World Models: A Minimalist Implementation of Future Video Prediction
May 17, 2026Siqiao Huang, Partha Kaushik, Michael Chen +5Video World Models Future Video Prediction
Tsinghua University · Carnegie Mellon University · University of Bristol +2
Latent Video Prediction for World Modeling: An Evaluation Uncovering Intriguing Favorable Evidence
May 15, 2026Ali J Alrasheed, Aryan Yazdan Parast, Basim Azam +2Future Video Prediction Video Foundation Models
The University of Melbourne · Monash University
Learning Visual Feature-Based World Models via Residual Latent Action
May 8, 2026Xinyu Zhang, Zhengtong Xu, Yutian Tao +3Latent World Models Latent Action Models
1Rutgers University · 2Purdue University · University of Wisconsin-Madison
CollideNet: Hierarchical Multi-scale Video Representation Learning with Disentanglement for Time-To-Collision Forecasting
Apr 17, 2026Nishq Poorav Desai, Ali Etemad, Michael GreenspanSpatio-Temporal Transformers Future Video Prediction
Queen’s University, Canada
Event-based Scene Synthesis via Inter-Frame Residual Alignment
Dec 19, 2025Jiyun Kong, Jun-Hyuk Kim, Jong-Seok LeeOptical Flow Scene Reconstruction
Yonsei University, Korea · Chung-Ang University, Korea
State-Change Learning for Prediction of Future Events in Endoscopic Videos
Oct 14, 2025Saurav Sharma, Chinedu Innocent Nwoye, Didier Mutter +1Surgical Videos Future Video Prediction
University of Strasbourg, CNRS, INSERM, ICube, UMR7357, France · IHU Strasbourg, Strasbourg, France · University Hospital of Strasbourg, France

Oct 1, 2026, cs.LGJ/K move · Enter open · S save

Variational Streaming Flow: Probabilistic Forecasting in Physical Time

Hans Hao-Hsun Hsu, Minseon Gwak, Soon Hoe Lim, Pan Li+1

Georgia Institute of Technology · Lawrence Berkeley National Lab · International Computer Science Institute+2

Probabilistic Forecasting Velocity Field Future Video Prediction Joint-Embedding Predictive Architectures Streaming Single Trajectory

Open paper AskPDF arXiv

Probabilistic forecasting is important for predicting complex dynamical systems because intrinsic randomness and incomplete observations can cause the same observed state to evolve into multiple plausible futures. While flow matching is a flexible approach for probabilistic forecasting, it is computationally expensive. Streaming flow (SF) reformulates this approach to model temporal evolution efficiently by learning a continuous velocity field directly in physical time. However, SF learns a deterministic velocity field. Thus, it provides only a single future trajectory for a given fixed initial state and observation history. To overcome this limitation, we introduce Variational Streaming Flow (VSF). Our approach learns a latent distribution that is conditioned on the dynamics of interest. In turn, this enables probabilistic forecasting. Importantly, we retain the computational efficiency of SF by generating in physical time. Across deterministic and stochastic dynamical systems, VSF demonstrates superior predictive accuracy and distributional fidelity. We demonstrate the advantage for both long-horizon rollouts exceeding 1,000 steps, and settings with bifurcating dynamics. Moreover, VSF can be integrated into existing Joint-Embedding Predictive Architecture (JEPA)-based world models as a plug-and-play predictor to improve temporal dynamics and goal-directed success rate in navigation, motion planning, and manipulation.

Momentum

Related topics

Latest papers 37