Physical Consistency in Video Generation

Overview

This field asks whether generated videos merely look convincing or depict motion and interactions that could happen in the physical world. Approaches include guiding video diffusion with 3D geometry, simulated trajectories, motion priors, and structured event or state reasoning, as well as refining outputs with physics-based rewards or verification. Benchmarks measure properties such as trajectories, collisions, object-state changes, geometric consistency, and conservation laws, often alongside human judgments. Strong appearance and smooth motion still do not guarantee accurate physics, especially for complex interactions, counterfactual changes, and long-horizon state evolution; improving physical fidelity without sacrificing visual quality and prompt alignment remains a central tension.

Latest papers

CardsList

207 papers18 papers in the last four weeks, down 40% on the four weeks before. 0.1% of all new papers.

  1. Coda-DaVinci: Reimagining Video Generation with Code2Video

    Nov 19, 2026Yiyan Ji, Qixun Wang, Yang Shi +20Agentic Video Generation3D-Aware Video Generation

  2. PhysResponse: Probing the Physics of Video Generation with Controlled Interventions

    Nov 18, 2026Yuhan Li, Shuran Zhang, Haixin Tian +12Physical Consistency in Video GenerationPhysical Reasoning in Video

  3. StrideWorld: Benchmarking Scene Rigidity and Action Consistency in Interactive Video World Model

    Nov 18, 2026Chuang Wang, Rui Nie, Jie Song +9World Model EvaluationInteractive World Models

  4. TelePhysica: Agentic Reconstruction of Physically Interactive Scenes

    Nov 13, 2026Ruiqi Shu, Xufeng Zhan, Yuanzhi Liang +3Physical Consistency in Video GenerationPhysics-Aware 3D Scene Reconstruction

  5. K2V: Generative Keyframing For Physically Plausible Video Generation

    Nov 12, 2026Felix O'Mahony, Daniel Olmeda Reino, Roberto Cipolla +1Physical Consistency in Video GenerationVideo Diffusion Models

  6. PhysLoop: Harnessing LLMs' Physics Awareness for Self-Improving Video Generation Models

    Nov 12, 2026Yuxuan Chen, Xiaojie Li, Hao Chen +11Video GenerationPhysical Consistency in Video Generation

  7. WorldDraft: If Code Builds the World, Can Video Models Just Render It?

    Nov 12, 2026Zhiyu Hou, Wen-Jie Shu, Harold Haodong Chen +7Video GenerationPhysical Consistency in Video Generation

  8. PhyRubric: Rubric-Grounded Diagnostic Evaluation of Physical Commonsense in Text-to-Video Generation

    Nov 10, 2026Huiyi Chen, Weitai Kang, Shicheng Fan +5Physical Consistency in Video GenerationVideo Generation Evaluation

  9. PhysOPSD: Code as Privilege for Physically Plausible Video Generation

    Nov 9, 2026Harold Haodong Chen, Rui Peng, Lingteng Qiu +3Physical Consistency in Video GenerationControllable Video Generation

  10. MotionCore: A Latent Neural Simulator for Video Generation with Rigid-Body Dynamics

    Nov 6, 2026Zheng Wang, Zhengwei Gong, Yuanzhi Liang +2Physical Consistency in Video GenerationTrajectory-Guided Video Generation

  11. IMPACT: Image-Conditioned Motion with Physics-Aware Collision and Trajectory Guidance for Video Generation

    Nov 1, 2026Shiwei Yang, Yunlong Yu, Zhao Wang +1Physical Consistency in Video GenerationImage-to-Video Generation

  12. Seeing the Unseen: Unified Visible--Invisible Motion for Physically Consistent Video Generation

    Oct 30, 2026Mingyang Bao, Fangda Ye, Xihao Chen +3Physical Consistency in Video GenerationTrajectory-Guided Video Generation

  13. GeoFlip Preview: Benchmarking Geometry-Sensitive Physics in Video Generation

    Oct 30, 2026Yuqi Li, Junming Liu, Bowen Hu +5Physical Consistency in Video GenerationGeometric Consistency in Video Generation

  14. Looking Ahead: Modeling Future Evolution in Autoregressive Video Generation

    Oct 21, 2026Ruopeng Gao, Yukun Huang, Jiarui Hu +4Autoregressive Video GenerationVideo Diffusion Models

  15. RoboJudge: Multimodal Language Models as Judges for Embodied Video Generation

    Oct 20, 2026Siyuan Ma, Yu Qi, Cheng Ye +8Vision-Language Model-as-a-JudgeVideo Generation Evaluation

  16. PVBench: Quantifying Physical Plausibility in Video Generation with Object-Level Physical Measurements

    Oct 19, 2026Kaiwei Chen, Moran Li, Zhenye Gan +5Physical Consistency in Video GenerationVideo Generation Evaluation

  17. Risk Decomposition for Hallucination-Aware Video Sampling

    Oct 19, 2026Chenyan Zheng, Fan Wu, Ruibo Li +4Physics-Guided Video GenerationPhysical Consistency in Video Generation

  18. MotionShift: Environment-Compatible Motion Transfer via Planner-Evaluator Synergistic Adaptation

    Oct 18, 2026Yanchen Liu, Junyao Gao, Yanan Sun +3Physical Consistency in Video GenerationTrajectory-Guided Video Generation

  19. Agentic Physics-Grounded Video Generation via Memory-Augmented In-Context Reasoning

    Oct 16, 2026Xikang Guan, Shaocong Yang, Yanqi Bao +6Physical Consistency in Video GenerationVideo Generation

  20. PhyMetric: Diagnosing Physical Plausibility in Text-to-Video Generation via Scene-Level QA

    Oct 14, 2026Siwei Meng, Xuerou Cai, Rui Hu +1Video Generation EvaluationPhysical Consistency in Video Generation

  21. MiMaAlign: Hierarchical Micro-Macro Alignment for Physically Plausible Video Generation

    Oct 12, 2026Yansong Liu, Litong Gong, Weijie Li +2Physical Consistency in Video GenerationVideo Diffusion Models

  22. A Plausible Future Is Not a Causal Future: Can Video Models Generate How the World Unfolds?

    Oct 11, 2026Jialiang Li, Zhengning Xu, Zongyang Ma +1Causal Video GenerationVideo Generation