cs.CVNov 10, 2026

PhyRubric: Rubric-Grounded Diagnostic Evaluation of Physical Commonsense in Text-to-Video Generation

Authors: Huiyi Chen, Weitai Kang, Shicheng Fan, Xinshuo Wang, Zhixiang Shen, Yan Yan, Philip S. Yu, Baoxin Li

Organizations: Department of Computer Science, University of Illinois Chicago

Abstract

As text-to-video (T2V) models are increasingly positioned as world simulators, it is essential to evaluate whether their videos conform to physical commonsense. However, existing benchmarks rely on annotators who rate each video with a single score based on intuition, yielding ratings that are subjective and do not tell which physical principle is violated. We introduce PhyRubric, a rubric-grounded diagnostic framework for evaluating physical commonsense in T2V generation. For each caption, PhyRubric constructs a caption-specific rubric before any video is seen, decomposing the caption into semantic and physical items, and derives scores from item-level verdicts grounded in timestamped evidence. We instantiate this framework as PhyRubric-Bench, which spans 34 categories across five physical domains, and scale it up to PhyRubric-Train with 3,788 videos, on which we fine-tune the open-source PhyRubric-Judge. Empirical results across ten T2V models show that physical commonsense remains far from solved, and that PhyRubric-Judge correlates more closely with human judgments than existing open-source judges while matching the frontier proprietary Gemini 4 Argon. Further analysis provides actionable insights for T2V models.

Figures & tables

Appendix figures & tables26 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. PhysVidBench: Language-Grounded Evaluation of Physical Commonsense in Text-to-Video Models

    Jul 21, 2025Enes Sanli, Baris Sarper Tezcan, Aykut Erdem +1Physical Consistency in Video GenerationPhysical Reasoning in Video

  2. PhyMetric: Diagnosing Physical Plausibility in Text-to-Video Generation via Scene-Level QA

    Oct 14, 2026Siwei Meng, Xuerou Cai, Rui Hu +1Video Generation EvaluationPhysical Consistency in Video Generation