Physical Consistency in Video Generation

Overview

This field asks whether generated videos merely look convincing or depict motion and interactions that could happen in the physical world. Approaches include guiding video diffusion with 3D geometry, simulated trajectories, motion priors, and structured event or state reasoning, as well as refining outputs with physics-based rewards or verification. Benchmarks measure properties such as trajectories, collisions, object-state changes, geometric consistency, and conservation laws, often alongside human judgments. Strong appearance and smooth motion still do not guarantee accurate physics, especially for complex interactions, counterfactual changes, and long-horizon state evolution; improving physical fidelity without sacrificing visual quality and prompt alignment remains a central tension.

Latest papers

CardsList

191 papers36 papers in the last four weeks, up 112% on the four weeks before. 0.2% of all new papers.

  1. VOID: Video Object and Interaction Deletion

    Apr 2, 2026Saman Motamed, William Harvey, Benjamin Klein +3Object RemovalVideo Editing

  2. AutoWeather4D: Autonomous Driving Video Weather Conversion via G-Buffer Dual-Pass Editing

    Mar 27, 2026Tianyu Liu, Weitao Xiong, Kunming Luo +43D Scene RelightingVideo Editing

  3. PhysVid: Physics Aware Local Conditioning for Generative Video Models

    Mar 27, 2026Saurabh Pathak, Elahe Arani, Mykola Pechenizkiy +1Physics-Guided Video GenerationPhysical Consistency in Video Generation

  4. DiReCT: Disentangled Regularization of Contrastive Trajectories for Physics-Refined Video Generation

    Mar 26, 2026Abolfazl Meyarian, Amin Karimi Monsefi, Rajiv Ramnath +1Contrastive Flow MatchingPhysical Consistency in Video Generation

  5. Toward Physically Consistent Driving Video World Models under Challenging Trajectories

    Mar 25, 2026Jiawei Zhou, Zhenxin Zhu, Lingyi Du +10Trajectory-Guided Video GenerationWorld Models for Autonomous Driving

  6. RealMaster: Lifting Rendered Scenes into Photorealistic Video

    Mar 24, 2026Dana Cohen-Bar, Ido Sobol, Raphael Bensadoun +5Video-to-Video TranslationSim-to-Real Transfer

  7. OrthoPhys: Physically Plausible Video Generation with Orthogonal-View Geometry Guidance

    Mar 19, 2026Cong Wang, Hanxin Zhu, Xiao Tang +43D-Aware Video GenerationPhysical Consistency in Video Generation

  8. EVA: Aligning Video World Models with Executable Robot Actions via Inverse Dynamics Rewards

    Mar 18, 2026Ruixiang Wang, Qingming Liu, Yueci Deng +3World Models for RoboticsPhysical Consistency in Video Generation

  9. VIGOR: VIdeo Geometry-Oriented Reward for Temporal Generative Alignment

    Mar 17, 2026Tengjiao Yin, Jinglei Shi, Heng Guo +1Diffusion Model AlignmentMulti-View Consistency

  10. Seeking Physics in Diffusion Noise

    Mar 15, 2026Chujun Tang, Lei Zhong, Fangqiang DingPhysical Consistency in Video GenerationVideo Diffusion Models

  11. PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignment

    Mar 14, 2026Zhexiao Xiong, Yizhi Song, Liu He +4Physical Consistency in Video GenerationImage-to-Video Generation

  12. Out of Sight, Out of Mind? Evaluating State Evolution in Video World Models

    Mar 13, 2026Ziqi Ma, Mengzhan Liufu, Georgia GkioxariVideo World ModelsWorld Model Evaluation

  13. OSCBench: Benchmarking Object State Change in Text-to-Video Generation

    Mar 12, 2026Xianjing Han, Bin Zhu, Shiqi Hu +4T2V GenerationVideo Generation Evaluation

  14. Event-Driven Video Generation

    Mar 12, 2026Chika Maduabuchi, Jindong WangPhysical Consistency in Video GenerationVideo Diffusion Models

  15. Motion Forcing: A Decoupled Framework for Robust Video Generation in Motion Dynamics

    Mar 11, 2026Tianshuo Xu, Zhifei Chen, Leyi Wu +2Physical Consistency in Video GenerationControllable Video Generation

  16. Chain of Event-Centric Causal Thought for Physically Plausible Video Generation

    Mar 10, 2026Zixuan Wang, Yixin Hu, Haolan Wang +4Causal Video GenerationVideo Generation

  17. Physical Simulator In-the-Loop Video Generation

    Mar 6, 2026Lin Geng Foo, Mark He Huang, Alexandros Lattas +3Physics-Guided Video GenerationPhysical Consistency in Video Generation

  18. Place-it-R1: Unlocking Environment-aware Reasoning Potential of MLLM for Video Object Insertion

    Mar 6, 2026Bohai Gu, Taiyi Wu, Dazhao Du +5Video Object InsertionVideo Editing

  19. GenHOI: Towards Object-Consistent Hand-Object Interaction with Temporally Balanced and Spatially Selective Object Injection

    Mar 6, 2026Xuan Huang, Mochu Xiang, Zhelun Shen +9HOI GenerationPhysical Consistency in Video Generation

  20. RealWonder: Real-Time Physical Action-Conditioned Video Generation

    Mar 5, 2026Wei Liu, Ziyu Chen, Zizhang Li +3Physics-Guided Video GenerationAction-Conditioned Video Generation

  21. Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion

    Mar 3, 2026Haoran Lu, Shang Wu, Songling Liu +9Physical Consistency in Video GenerationVideo Diffusion Models

  22. DreamWorld: Unified World Modeling in Video Generation

    Feb 28, 2026Boming Tan, Xiangdong Zhang, Ning Liao +73D-Aware Video GenerationVideo World Models

  23. 3DSPA: A 3D Semantic Point Autoencoder for Evaluating Video Realism

    Feb 23, 2026Bhavik Chandna, Kelsey R. AllenVideo Quality AssessmentVideo Generation Evaluation

  24. PISCO: Precise Video Instance Insertion with Sparse Control

    Feb 9, 2026Xiangbo Gao, Renjie Li, Xinghao Chen +4Physical Consistency in Video GenerationVideo Diffusion Models