A Plausible Future Is Not a Causal Future: Can Video Models Generate How the World Unfolds?
Organizations: DeepDelta Lab, School of Artificial Intelligence, Shanghai Jiao Tong University · Xi’an Jiaotong-Liverpool University
Abstract
Large-scale video generation models are increasingly viewed as a promising path toward world models, yet their ability to capture causally coherent physical dynamics remains poorly understood. Existing evaluations largely emphasize visual quality, prompt adherence, or broad physical plausibility, leaving open whether a model can faithfully realize a complete causal cascade, in which an initiating event propagates through causally dependent interactions to a terminal outcome. We introduce CausalCascade, a simulator-grounded benchmark centered on 50 event-rich Blender scenes with structured event graphs, graph-grounded diagnostic VQA, three levels of future-event specification, and 2,832 controlled counterfactual variants, and use it to evaluate nine image-to-video models with complementary motion-, event-, and counterfactual-level diagnostics. Across the evaluated models, generated motion is more reliably localized spatially than realized with correct spatiotemporal evolution, while richer future-event specification improves event recovery but leaves physical realization limited. Counterfactual evaluation further reveals weak selective responsiveness to physical interventions, while most audited failures are foundational, arising at scene consistency or event occurrence. Together, these results position causal cascade generation as a process-level test of world modeling and highlight the need to jointly recover the intended future, faithfully realize its physical evolution, selectively respond to physical interventions, and maintain a coherent physical world over time. Code and dataset are available at https://github.com/SJTU-DeepDeltaLab/CausalCascade .
Figures & tables
| Benchmark | Video Generator Eval. | Reference Rollout | Controlled Intervention | Paired CF Eval. | Localized CF Effect | Ref.-based Motion Metric | Structured Event Graph | Event-level Diagnostics |
| WorldBench ( Upadhyay et al., 2026 ) | ✓ | ✓ | ✗ | ✗ | ✗ | ✓ | ✗ | ✗ |
| CLEVRER-Humans ( Mao et al., 2022 ) | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✓ | ✓ |
| CoPhy ( Baradel et al., 2020 ) | ✗ | ✓ | ✓ | ✓ | ✗ | ✗ | ✗ | |
| CRONOS ( Begiristain et al., 2026 ) | ✓ | ✓ | ✓ | ✓ | ✗ | |||
| What-If World ( Cai et al., 2026 ) | ✓ | ✗ | ✓ | ✓ | ✗ | ✗ | ||
| CausalCascade (Ours) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
Appendix figures & tables20 assets
Supplementary material from the paper’s appendix.
Appendix
| Diagnostic dimension | # Questions |
| Event occurrence | 152 |
| Temporal ordering | 179 |
| Causal pathway | 226 |
| Outcome and termination | 115 |
| Scene consistency | 200 |
| Total | 872 |
| Tool | Inputs and sampling | Evidence supplied to the judge |
| observe | Generated or reference video | A contact sheet of 20 uniformly spaced frames, including the first and final frames. Cells are rendered at 336 pixels before the sheet is capped at 1680 pixels, and each cell carries its frame index and physical timestamp. |
| zoom | Video, interval, optional box | A high-resolution crop of up to 12 requested times; without explicit times, approximately ten samples cover the interval. The box accepts normalized or pixel coordinates. |
| temporal_pair | Video, exact times, optional box | A two-column before/after comparison from one rollout, used for subtle changes in identity, support, orientation, and terminal state. |
| paired_zoom | Interval or exact times | Generated and reference crops at the same nominal times, arranged in two rows; eight times are used by default. It identifies the intended object or endpoint but does not compute a verdict. |
| flow_info | Generated or reference video | A global motion timeline from OpenCV DIS optical flow (medium preset) at spatial scale, including the 95th-percentile magnitude and candidate active windows. |
| segments | Generated or reference video | Active intervals whose flow exceeds the within-video 0.30 quantile for at least 0.25 seconds, used to select focused inspection windows. |
| Subdimension | Fixed violation signals | Exact-option projection |
| Entity persistence | Persistent multi-component mask, reliable sparse-re-detection birth, or terminal non-boundary death. | Neither signal — consistent; death only — unexplained disappearance; birth only — unexplained duplication; both — combined. |
| Identity and geometry integrity | A mask is split in at least two sampled frames, or a propagated identity is lost away from the boundary. | No signal maps to the first (preserved) option; any violation maps to the designated integrity-violation option. |
| Trajectory continuity | At least one compensated track satisfies the state-revisit test, or one semantic object has simultaneous multi-component paths. | No signal maps to spatial continuity; any violation maps to the multiple-discontinuity option. Jump and reversal statistics remain available for diagnosis. |
| Static scene/camera stability | Broad-motion signal and anchored-region signal . | Neither — stable; anchored only — structure change; broad motion only — viewpoint change; both — combined. |
| Diagnostic dimension | Agreement | Accuracy |
| Event occurrence | 17/20 | 85% |
| Causal pathway | 19/20 | 95% |
| Temporal ordering | 16/20 | 80% |
| Outcome and termination | 20/20 | 100% |
| Scene consistency | 17/20 | 85% |
| Overall | 89/100 | 89% |
| Model | Checkpoint | Resolution | Frames | FPS | Steps | Guidance / schedule |
| CogVideoX-Fun-V1.5 | CogVideoX-Fun-V1.5-5b-InP | 85 | 8 | 50 | guidance 6.0 | |
| Cosmos3-Nano | Cosmos3-Nano | 189 | 24 | 35 | shift 10.0; guidance 6.0 | |
| HunyuanVideo-I2V | HunyuanVideo-I2V | 129 | 24 | 50 | shift 7.0; embedded CFG 6.0 | |
| LTX-Video-13B | LTX-Video-13B | 121 | 16 | scheduled CFG/STG † | ||
| MAGI-1-4.5B | MAGI-1-4.5B-base | 120 | 24 | 64 | multi-stage text/prev.-chunk guidance | |
| SkyReels-V2-I2V | SkyReels-V2-I2V-14B-720P | 121 | 24 | 50 | shift 3.0; guidance 5.0 |
| Model | Spatial IoU | Strict ST-IoU | Weighted Spatial IoU | mMSE | SSIM | VQA Overall |
| CogVideoX-Fun-V1.5 | 0.147 | 0.037 | 0.067 | 0.0539 | 0.771 | 0.095 |
| Cosmos3-Nano | 0.252 | 0.043 | 0.137 | 0.0579 | 0.903 | 0.357 |
| HunyuanVideo-I2V | 0.178 | 0.027 | 0.085 | 0.0645 | 0.608 | 0.174 |
| LTX-Video-13B | 0.182 | 0.037 | 0.087 | 0.0583 | 0.727 | 0.189 |
| MAGI-1-4.5B | 0.128 | 0.031 | 0.072 | 0.0673 | 0.697 | 0.153 |
| SkyReels-V2-I2V | 0.193 | 0.047 | 0.105 | 0.0597 | 0.738 | 0.177 |
| Spatial IoU | Strict ST-IoU | VQA Overall | |||||||
| Model | L1 | L2 | L3 | L1 | L2 | L3 | L1 | L2 | L3 |
| CogVideoX-Fun-V1.5 | 0.147 | 0.174 | 0.191 | 0.037 | 0.042 | 0.062 | 0.095 | 0.128 | 0.186 |
| Cosmos3-Nano | 0.252 | 0.273 | 0.387 | 0.043 | 0.061 | 0.080 | 0.357 | 0.358 | 0.568 |
| HunyuanVideo-I2V | 0.178 | 0.202 | 0.172 | 0.027 | 0.035 | 0.034 | 0.174 | 0.171 | 0.167 |
| LTX-Video-13B | 0.182 | 0.180 | 0.217 | 0.037 | 0.042 | 0.057 | 0.189 | 0.213 | 0.227 |
| MAGI-1-4.5B | 0.128 | 0.142 | 0.154 | 0.031 | 0.038 | 0.045 | 0.153 | 0.171 | 0.229 |
| Model | CF Spatial Effect IoU | CF Weighted Effect IoU | CF Preserve Spatial IoU | CF Preserve Weighted IoU |
| CogVideoX-Fun-V1.5 | 0.0261 | 0.0461 | 0.1190 | 0.0507 |
| Cosmos3-Nano | 0.0410 | 0.0488 | 0.1983 | 0.1223 |
| HunyuanVideo-I2V | 0.0365 | 0.0389 | 0.1577 | 0.0895 |
| LTX-Video-13B | 0.0324 | 0.0362 | 0.1471 | 0.0800 |
| MAGI-1-4.5B | 0.0353 | 0.0372 | 0.1067 | 0.0829 |
| SkyReels-V2-I2V | 0.0321 | 0.0468 | 0.1687 | 0.0946 |
| Model | CF Spatial Effect IoU | CF Weighted Effect IoU | CF Preserve Spatial IoU | CF Preserve Weighted IoU |
| CogVideoX-Fun-V1.5 | 0.0278 | 0.0349 | 0.1235 | 0.0537 |
| Cosmos3-Nano | 0.0451 | 0.0576 | 0.1879 | 0.1360 |
| HunyuanVideo-I2V | 0.0367 | 0.0385 | 0.1720 | 0.0979 |
| LTX-Video-13B | 0.0457 | 0.0400 | 0.1274 | 0.0704 |
| MAGI-1-4.5B | 0.0231 | 0.0283 | 0.1096 | 0.0665 |
| SkyReels-V2-I2V | 0.0243 | 0.0389 | 0.1729 | 0.0935 |
| Model | CF Spatial Effect IoU | CF Weighted Effect IoU | CF Preserve Spatial IoU | CF Preserve Weighted IoU |
| CogVideoX-Fun-V1.5 | 0.0180 | 0.0278 | 0.1136 | 0.0547 |
| Cosmos3-Nano | 0.0482 | 0.0525 | 0.1879 | 0.1215 |
| HunyuanVideo-I2V | 0.0256 | 0.0264 | 0.1535 | 0.0749 |
| LTX-Video-13B | 0.0333 | 0.0367 | 0.1654 | 0.0860 |
| MAGI-1-4.5B | 0.0193 | 0.0263 | 0.1024 | 0.0566 |
| SkyReels-V2-I2V | 0.0308 | 0.0357 | 0.1661 | 0.0856 |
| Model | CF Spatial Effect IoU | CF Weighted Effect IoU | CF Preserve Spatial IoU | CF Preserve Weighted IoU |
| CogVideoX-Fun-V1.5 | 0.0229 | 0.0344 | 0.1182 | 0.0494 |
| Cosmos3-Nano | 0.0341 | 0.0397 | 0.1847 | 0.1099 |
| HunyuanVideo-I2V | 0.0360 | 0.0387 | 0.1596 | 0.0950 |
| LTX-Video-13B | 0.0108 | 0.0222 | 0.1502 | 0.0855 |
| MAGI-1-4.5B | 0.0250 | 0.0331 | 0.1020 | 0.0636 |
| SkyReels-V2-I2V | 0.0278 | 0.0425 | 0.1745 | 0.0922 |
| Failure manifestation | All cases | Level 1 | Level 2 | Level 3 |
| Spontaneous motion | 51/90 (56.7%) | 20/36 (55.6%) | 16/27 (59.3%) | 15/27 (55.6%) |
| Incorrect physical response | 47/90 (52.2%) | 20/36 (55.6%) | 17/27 (63.0%) | 10/27 (37.0%) |
| Identity or attribute corruption | 26/90 (28.9%) | 10/36 (27.8%) | 8/27 (29.6%) | 8/27 (29.6%) |
| Motion recurrence or state replay | 23/90 (25.6%) | 11/36 (30.6%) | 6/27 (22.2%) | 6/27 (22.2%) |
| Topology corruption | 21/90 (23.3%) | 8/36 (22.2%) | 5/27 (18.5%) | 8/27 (29.6%) |
| Structural-role misinterpretation | 15/90 (16.7%) | 7/36 (19.4%) | 4/27 (14.8%) | 4/27 (14.8%) |
| Model | Topology | Unsupported motion | Identity error | Physical response | Duplication | Structural role | Viewpoint drift | State replay |
| CogVideoX-Fun-V1.5 | 10 | 6 | 3 | – | – | – | – | – |
| Cosmos3-Nano | – | 5 | – | 7 | 5 | – | – | – |
| HunyuanVideo-I2V | – | 9 | 4 | 4 | – | – | – | – |
| LTX-Video-13B | – | 3 | – | 8 | – | 5 | – | – |
| MAGI-1-4.5B | – | – | 5 | 3 | – | – | 5 | – |
| SkyReels-V2-I2V | 3 | 9 | – | 5 | – | – | – | – |
| Earliest primary failure | Cases | Proportion |
| Event occurrence | 43 | 47.8% |
| Causal pathway | 8 | 8.9% |
| Temporal ordering | 4 | 4.4% |
| Outcome and termination | 2 | 2.2% |
| Scene consistency | 33 | 36.7% |