cs.CVNov 18, 2026

PhysResponse: Probing the Physics of Video Generation with Controlled Interventions

Authors: Yuhan Li, Shuran Zhang, Haixin Tian, Baonuo Rao, Weipeng Li, Yujia Hou, Zhenyu Wang, Zijun Wang, 

Organizations: Sun Yat-sen University · The Hong Kong University of Science and Technology · Mohamed bin Zayed University of Artificial Intelligence

Abstract

Video generation models are increasingly viewed as world simulators, which requires not only plausible motion but dynamics that respond correctly to specified physical parameters. Existing models, datasets and benchmarks, however, largely target physical plausibility, leaving this physical parameter responsiveness insufficiently explored. We introduce PhysResponse, a benchmark that measures it at two levels: scene-conditioned simulator inversion recovers the effective gravity, friction and initial speed of generated motion, and event evaluation tests outcomes near and across critical transitions. Evaluating ten image-to-video models, we find that even the lowest parameter errors exceed those of physically correct videos by over an order of magnitude, that models rarely reproduce both outcomes of a transition pair, and that the two levels expose complementary failures that visual metrics such as PSNR miss. To supply the missing training signal, we construct 72,000 simulated videos of 20 multi-object interaction types with controlled parameters; fine-tuning on them lowers parameter errors, even on held-out interaction types, and transfers to real videos and an external physics benchmark. Continued training with a numerical encoder further lowers all three errors on held-out types. PhysResponse provides a foundation for world simulators that follow physical conditions, not just appearances.

Figures & tables

Explore similar work

CardsList
  1. PhyGround: Benchmarking Physical Reasoning in Generative World Models

    May 11, 2026Juyi Lin, Arash Akbari, Yumei He +13Physical Consistency in Video GenerationWorld Model Evaluation

  2. PhyWorld: Physics-Faithful World Model for Video Generation

    May 19, 2026Pu Zhao, Juyi Lin, Timothy Rupprecht +10Physics-Informed Generative ModelingPhysical Consistency in Video Generation