Physical Reasoning in Video

Overview

Physical reasoning in video asks whether systems can infer objects’ states, forces, interactions, and causal consequences from changing images, then predict or generate what happens next. Common approaches include video-language models, explicit scene graphs or spatial codes, learned dynamics and differentiable simulators, and retrieval or reasoning modules that test physical laws. Evaluation increasingly uses controlled clips, counterfactuals, temporal and spatial grounding, and measurable criteria such as trajectories, conservation, and event timing, rather than visual quality alone. Current systems often recognize plausible events better than they explain anomalies or sustain accurate causal dynamics, leaving open whether their apparent gains reflect grounded physics or semantic priors and benchmark-specific cues.

Latest papers

CardsList

78 papers7 papers in the last four weeks, down 63% on the four weeks before. 0.1% of all new papers.

  1. Probing Where Surprise Happens: Localized Violation-of-Expectation Evaluation of Video World Models

    Nov 13, 2026Yanbin Xu, Ming bo CaiWorld Model EvaluationPhysical Reasoning in Video

  2. PhysCapBench: A Cross-Domain Benchmark for Physically Grounded Video Captioning

    Nov 12, 2026Haofeng Wang, Xuanyi Liu, Pengcheng Wen +12Video CaptioningVideo Caption Evaluation

  3. CounterSketch: Physics-Grounded Counterfactual Reasoning for Sketch-to-Video Generation

    Nov 3, 2026Hien Trinh, Tan-Hiep To, Dinh-Khoi Vo +3Video GenerationPhysical Reasoning in Video

  4. When Does Latent Prediction Error Support Physical Surprise Claims in Video World Models?

    Nov 1, 2026Anton Hristov, Aleksandar Slavov, Vasil VasilevVideo World ModelsWorld Model Evaluation

  5. PhysEvolve: Verifier-grounded Self-evolution for Physical Reasoning with Executable Worlds

    Oct 26, 2026Jinyuan Hu, Yilei Jiang, Chen Tang +3Reasoning for VLMsCausal Reasoning

  6. Risk Decomposition for Hallucination-Aware Video Sampling

    Oct 19, 2026Chenyan Zheng, Fan Wu, Ruibo Li +4Physics-Guided Video GenerationPhysical Consistency in Video Generation

  7. HAPACT: A Benchmark For Human-Centric Physical Impact Localization in Movies

    Oct 16, 2026Youngrae Kim, Yejin Jang, Eunho Kim +4Physical Reasoning in VideoTemporal Video Grounding

  8. PhyMetric: Diagnosing Physical Plausibility in Text-to-Video Generation via Scene-Level QA

    Oct 14, 2026Siwei Meng, Xuerou Cai, Rui Hu +1Video Generation EvaluationPhysical Consistency in Video Generation

  9. Time-JEPA: Grounding Video World Models with Physical Time Series

    Oct 14, 2026Shenyi Li, Ziyang Zhang, Wen Wu +2Video World ModelsPhysical Reasoning in Video

  10. PhysCodeGym: Benchmarking Coding Agents for Physically Verifiable 4D Reconstruction

    Oct 12, 2026Shuai Shao, Jinchen He, Cunxin Fan +10Coding Agent Benchmarks4D Reconstruction

  11. MiMaAlign: Hierarchical Micro-Macro Alignment for Physically Plausible Video Generation

    Oct 12, 2026Yansong Liu, Litong Gong, Weijie Li +2Physical Consistency in Video GenerationVideo Diffusion Models

  12. PhySimCode: A Benchmark and Evaluation Method for Physics Video to Code Generation

    Oct 11, 2026Souraja Kundu, Aditya Gupta, Joel Julin +3Physical Reasoning in VideoLLM Code Generation

  13. World Models' Last Exam in Physics

    Oct 6, 2026Mingju Gao, Qingle Liu, Yuzhao Peng +8Physical Consistency in Video GenerationWorld Model Evaluation

  14. How Does Geometry Enter Generated Motion?

    Oct 4, 2026Weihan Li, Junhao Wu, Yuhan Song +2Physical Consistency in Video GenerationImage-to-Video Generation

  15. World Embedding Benchmark

    Oct 2, 2026Yiqi Liu, Ruifeng Yuan, Yang Wang +7Physical Reasoning in VideoVideo Representation Learning

  16. Does Physics Live in the Activations? Localizing Physical Quantities in Video Diffusion Models

    Oct 2, 2026Jonas Kneifl, Jakub Skalski, Bartłomiej Twardowski +1Video Diffusion ModelsPhysical Reasoning in Video

  17. PhysicsLENS: Diagnosing Physical Property Blindness in Video Generation Models

    Oct 1, 2026Isaiah Milkey, Som Sagar, Aditya Taparia +3Physical Consistency in Video GenerationPhysical Reasoning in Video

  18. On Parameters of Nonlinear Scalar Dynamics from Video: Invariants, Calibration, and Identifiability

    Sep 30, 2026Wenjie Wang, Yuanyuan Wang, Zixiang Jiang +2Parameter EstimationParameter Identifiability

  19. Scaling Video Generation for Reasoning: At What Cost?

    Sep 29, 2026Weihang Guo, Xiaoyu Wu, Yifei Wang +2Video ReasoningAutoregressive Video Generation

  20. Foresight at the Event Boundary: Evaluating Physical Prediction in Video World Models

    Sep 29, 2026Estela Monserrat Arriaga Santana, Julian Rosas Scull, Ehécatl Sacamch'en Núñez Rico +1Physical Consistency in Video GenerationWorld Model Evaluation

  21. VideoPhysEdit: Physical Counterfactual Video Editing via Rigid-Body Physical Scene Reconstruction

    Sep 28, 2026Conghan Yue, Yuanjie Chen, Yue Han +4Physical Consistency in Video GenerationVideo Editing

  22. Training Object Permanence in World Models

    Sep 23, 2026Haotian Zhang, Fengyuan Yu, Dezhi Luo +28Object PermanencePhysical Reasoning in Video

  23. OmniFysics-Captioner Technical Report: Grounding Omni-Modal Understanding in the Physical World for Better Captioning

    Sep 21, 2026Kaixiang Qiu, Minghao Han, Keliang Liu +7Audio-Visual UnderstandingMultimodal Grounding

  24. Human-Level Accuracy, Non-Human Strategies: Revealing Model-Human Divergence in Video Physical Reasoning

    Sep 19, 2026Fanhong Li, Shurui Zheng, Zi Yin +3Physical Reasoning in VideoPhysical Foundation Models

  25. PIVOT: Physics-Grounded Verification for AI-Generated Audio-Video Detection

    Sep 14, 2026Bo Zheng, Kangran Zhao, Xiaoyu Zhang +7Explainable Deepfake DetectionDeepfake Detection

  26. Principia: Relational Physics Tests for Video Models

    Sep 3, 2026Varun Varma Thozhiyoor, Shivam Tripathi, Venkatesh Babu Radhakrishnan +1VLM EvaluationPhysical Consistency in Video Generation