cs.CVNov 12, 2026

K2V: Generative Keyframing For Physically Plausible Video Generation

Authors: Felix O'Mahony, Daniel Olmeda Reino, Roberto Cipolla, Ayush Tewari

Organizations: University of Cambridge, Cambridge, UK · Toyota Motor Europe, Brussels, Belgium

Abstract

Video diffusion models are able to generate samples with high-quality appearance and textural qualities. However, content produced by these methods is known to exhibit significant physical errors. This is because, in a classical video generation setting, all physical reasoning must take place simultaneously and exclusively within the diffusion process.We propose to resolve these issues by redistributing the task of physical reasoning onto a language model-backed keyframe generation module, which allows for explicit reasoning in language, and fine-grained control over the appearance of the video at important moments in the video. We then condition a video generation model with these keyframes, reducing the role of the diffusion model to the simpler task of interpolating between physically-correct intermediate states, rather than inferring an entire sequence with diffusion. Results demonstrate that our approach significantly outperforms existing approaches, achieving state-of-the-art performance on the Physics-IQ Verified benchmark and PhyGenBench.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. PhyCo: Learning Controllable Physical Priors for Generative Motion

    Apr 30, 2026Sriram Narayanan, Ziyu Jiang, Srinivasa Narasimhan +1Physics-Informed Generative ModelingPhysical Consistency in Video Generation

  2. PhysVid: Physics Aware Local Conditioning for Generative Video Models

    Mar 27, 2026Saurabh Pathak, Elahe Arani, Mykola Pechenizkiy +1Physics-Guided Video GenerationPhysical Consistency in Video Generation

  3. DeforM: Reasoning-Guided Physics-Aware Video Generation via Spatial-Temporal Masking

    Jul 21, 2026Yunyi Li, Yu Qiao, Yaohui Wang +1Physics-Informed Generative ModelingPhysical Consistency in Video Generation