The Trinity of Consistency as a Defining Principle for General World Models
Abstract
The construction of World Models capable of learning, simulating, and reasoning about objective physical laws constitutes a foundational challenge in the pursuit of Artificial General Intelligence. Recent advancements represented by video generation models like Sora have demonstrated the potential of data-driven scaling laws to approximate physical dynamics, while the emerging Unified Multimodal Model (UMM) offers a promising architectural paradigm for integrating perception, language, and reasoning. Despite these advances, the field still lacks a principled theoretical framework that defines the essential properties requisite for a General World Model. In this paper, we propose that a World Model must be grounded in the Trinity of Consistency: Modal Consistency as the semantic interface, Spatial Consistency as the geometric basis, and Temporal Consistency as the causal engine. Through this tripartite lens, we systematically review the evolution of multimodal learning, revealing a trajectory from loosely coupled specialized modules toward unified architectures that enable the synergistic emergence of internal world simulators. To complement this conceptual framework, we introduce CoW-Bench, a benchmark centered on multi-frame reasoning and generation scenarios. CoW-Bench evaluates both video generation models and UMMs under a unified evaluation protocol. Our work establishes a principled pathway toward general world models, clarifying both the limitations of current systems and the architectural requirements for future progress.
Figures & tables
| Symbol | Description | Symbol | Description |
|---|---|---|---|
| World Model | 3D Position | ||
| State & Action Space | Camera Pose at | ||
| State & Action Instance | Intrinsic Matrix | ||
| Policy | Projection Operator | ||
| Trajectory | Keyframe Set | ||
| Dynamics Function | Geometric Manifold |
| Paradigm | Objective (The Soul) | Error | Topology |
|---|---|---|---|
| Discrete AR | Exp. | Discrete | |
| Flow Matching | Linear | Euclidean |
| Generation Paradigm | Rep. Model | Temporal Consistency | Physics Compliance | Causal Reasoning | Freq. Fidelity (VCD) |
|---|---|---|---|---|---|
| (VBench Norm.) | (Physics-IQ) | (Task Success Rate) | (Reward Penalty) | ||
| Temporal Inflation | AnimateDiff | N/A ( ) | High ( ) | ||
| Discrete AR | VideoPoet | Low ( ) | Medium ( ) | ||
| Native DiT | HunyuanVideo | Medium ( ) | Low ( ) | ||
| World Model Priors | Google Veo 3 | 0.95 ∗ | 0.86 ∗ | High ( ) † | Minimal ( ) |
| Task | Sub-tasks | ||
|---|---|---|---|
| I. Basic / Atomic | II. Structured / Dynamic | III. Complex / Constraint | |
| Single-Consistency Dimensions | |||
| M | Style/Material transfer | Fine-grained control | Multi-constraint composition |
| S | Planar layout | Hierarchical occlusion | Multi-view 3D structure |
| T | Worldline persistence | Rule-guided evolution | Ordered stage transitions |
| Cross-Consistency Synergies | |||
| Mode | Task | Sub-Task | Scene | Diff | Complexity Metrics (Avg.) | ||||
|---|---|---|---|---|---|---|---|---|---|
| Prmpt | ImgR | Act | Elem | ||||||
| Single | Modal | Subj-Attr | 91 | Obj | Easy | 7.1 | 13.3 | 22.0 | 2.1 |
| Minor-Ctrl | 87 | Obj | Med | 37.4 | 37.4 | 37.1 | 1.6 | ||
| Multi-Req | 81 | Mix | Hard | 74.8 | 13.6 | 64.7 | 1.6 | ||
| Space | 2D-Layed | 89 | Mix | Med | 38.2 | 24.7 | 32.8 | 2.4 | |
| 2D-Rel | 91 | Obj | Easy | 42.7 | 17.1 | 52.8 | 1.7 | ||
| ID | Atomic check | Operational definition |
|---|---|---|
| A1 | Identity lock | The intended target entity remains unchanged; no identity swap, duplication, or replacement occurs. |
| A2 | Attribute binding | Key attributes remain bound to the same entity; no attribute migration occurs. |
| A3 | Constraint non-relaxation | Specified constraints are not weakened or substituted with more common but non-equivalent variants. |
| A4 | Evidence clarity | Evidence supporting each constraint judgment is clear and unambiguous. |
| A5 | Mutual exclusivity | Mutually incompatible properties do not co-occur on the same target. |
| A6 | Locality of change | Changes are confined to the designated region or attribute without boundary spillover. |
| Metric family | A1 | A2 | A3 | A4 | A5 | A6 | A7 | A8 | A9 | A10 | A11 | A12 | A13 | A14 | A15 | A16 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Attribute Fidelity (M1) | ✓ | ✓ | ✓ | ✓ | ✓ | |||||||||||
| Local Edit Precision (M2) | ✓ | ✓ | ✓ | ✓ | ||||||||||||
| Multi-constraint Satisfaction (M3) | ✓ | ✓ | ✓ | ✓ | ✓ | |||||||||||
| Worldline Persistence (T1) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ||||||||||
| Evolutionary Dynamics (T2) | ✓ | ✓ | ✓ | ✓ | ✓ | |||||||||||
| Ordered Stage Transitions (T3) | ✓ | ✓ | ✓ | ✓ |
| Model | Modal | Temporal | Spatial | Modal-Temporal | Modal-Spatial | Temporal-Spatial | AVG | ||||||||||||
| SUAT | LCED | MCON | WLIN | SLEV | STOR | SEPL | OCCO | MV3D | TREV | LOHO | ATDY | SEPL | OCCO | SEMV | 3DLO | OCMO | MAZE | ||
| Closed-Source Video-Generation Models | |||||||||||||||||||
| Sora [ 27 ] | 5.16 | 8.35 | 8.38 | 9.32 | 5.80 | 6.22 | 8.41 | 6.19 | 8.51 | 6.96 | 8.12 | 5.25 | 8.64 | 5.97 | 9.49 | 8.40 | 9.25 | 4.17 | 73.66 |
| Kling [ 314 ] | 4.11 | 8.19 | 5.63 | 9.10 | 5.17 | 5.53 | 8.72 | 7.88 | 9.32 | 7.08 | 8.71 | 6.58 | 8.20 | 6.79 | 9.44 | 8.08 | 9.30 | 5.30 | 73.96 |
| Closed-Source Image-Generation Models | |||||||||||||||||||
| GPT-image-1 [ 247 ] | 7.37 | 8.96 | 7.96 | 9.14 | 7.75 | 5.68 | 8.09 | 7.43 | 9.26 | 6.95 | 9.28 | 7.22 | 9.00 | 6.83 | 9.79 | 8.46 | 8.22 | 7.24 | 80.35 |
World Models
World models represent and predict how environments change, helping agents plan, act, and reason about possible futures.
See all 366 papers