World Models Need a Physical Registry: Learning Internal Predictive States for Physically Plausible World Models
Organizations: Yonsei University · Microsoft Research Asia
Abstract
Video world models must generate physically plausible futures, not just realistic frames. Existing approaches typically use semantic, physical, or predictive information to guide the visual generation stream, leaving a fundamental question: where inside the generator should predictions of scene evolution live? Standard video tokens jointly encode appearance and dynamics, but provide no distinct state for learning and reading predictive dynamics. We answer this question with the Physical Registry: temporally grounded registry slots inside a video DiT that are initialized from an observation-conditioned forecast, co-evolve with video tokens, and receive future-representation supervision, making predictive dynamics an explicit, readable state of the generator. In a controlled comparison of predictive-state interfaces on Physics-IQ Verified, Physical Registry improves vanilla fine-tuning by 9.9/8.7 points on I2V/V2V, the largest gain among the interfaces we compare. Across all Cosmos and WAN backbones, Physical Registry improves Physics-IQ Verified scores. With only 0.45% additional parameters, it enables Cosmos 3 Nano 16B to surpass the published I2V score of Cosmos 3 Super 64B (43.56 vs. 42.7). On WorldModelBench, it also improves physical adherence and the total score for all four evaluated backbones. Because the registry becomes candidate-specific while remaining readable, the Physical Registry Selector (PRS) ranks emerging futures by how far their intermediate registry readouts depart from the shared forecast before full denoising is complete. Across four backbones, this selection improves I2V scores by 5.6-15.9% without completed-video external scoring. Together, these results support a broader principle: dynamics prediction should live as an explicit model state that co-evolves with the video representation. Project page: https://grainsack.github.io/physical-registry/
Figures & tables
| Variant | Mechanism | Registry | Alignment | Readout | I2V | V2V | ||
| Vanilla fine-tuning | – | – | – | |||||
| REPA ( Yu et al., 2025 ) | Feature alignment | +0.5 | +0.5 | |||||
| Cross-attention ( Peebles & Xie, 2023 ) | External context | +1.8 | +2.8 | |||||
| AdaLN ( Peebles & Xie, 2023 ) | Feature modulation | +3.8 | +1.9 | |||||
| Joint generation ( Kouzelis et al., 2025 ) | Joint denoising | +3.8 | +1.6 | |||||
| Registry only | Dedicated predictive state | +3.7 | +3.9 |
| Model | I2V | V2V | ||||
|---|---|---|---|---|---|---|
| Plain | PRS | Plain | PRS | |||
| Cosmos 3 Nano 16B ( NVIDIA et al., 2026 ) | 30.18 ± 0.84 | – | 38.78 ± 0.78 | – | ||
| + Physical Registry | 36.01 ± 0.95 | +5.83 | 40.27 (+4.26) | 45.12 ± 0.94 | +6.34 | 46.78 (+1.66) |
| Cosmos 3 Nano 16B † ( NVIDIA et al., 2026 ) | 37.3 ± 0.9 * | – | 46.45 ± 0.76 | – | ||
| + Physical Registry † | 43.56 ± 0.95 | +6.26 | 45.81 (+2.25) | 49.54 ± 0.63 | +3.09 | 52.06 (+2.52) |
| Cosmos v2.5 2B ( NVIDIA et al., 2025b ) | 30.65 ± 0.37 | – | 37.40 ± 0.53 | – | ||
| Model | Instruction following (0–3) | Physical adherence (0–5) | Common sense (0–2) | Total (0–10) |
|---|---|---|---|---|
| Cosmos 3 Nano 16B ( NVIDIA et al., 2026 ) | 2.20 ± 0.02 | 4.50 ± 0.08 | 1.43 ± 0.06 | 8.13 ± 0.13 |
| + Physical Registry | 2.20 ± 0.002 (–) | 4.82 ± 0.03 (+0.32) | 1.81 ± 0.02 (+0.38) | 8.83 ± 0.04 (+0.69) |
| Cosmos v2.5 2B ( NVIDIA et al., 2025b ) | 2.14 ± 0.03 | 4.43 ± 0.07 | 1.55 ± 0.05 | 8.12 ± 0.14 |
| + Physical Registry | 2.07 ± 0.01 (-0.07) | 4.54 ± 0.03 (+0.11) | 1.58 ± 0.04 (+0.03) | 8.19 ± 0.01 (+0.07) |
| WAN 2.2 I2V-A14B ( Wan Team, 2025 ) | 2.23 ± 0.03 | 4.45 ± 0.04 | 1.60 ± 0.03 | 8.28 ± 0.02 |
| + Physical Registry | 2.30 ± 0.04 (+0.07) | 4.53 ± 0.04 (+0.07) | 1.60 ± 0.02 (+0.004) | 8.43 ± 0.05 (+0.15) |
Appendix figures & tables30 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | Pretrained | Registry modules | Batch/update | GPUs |
|---|---|---|---|---|
| Cosmos 3 Nano 16B | 16B | 72.63M | 16 | H100 |
| Cosmos v2.5 2B | 2B | 35.93M | 16 | A100 40 GB |
| WAN 2.2 I2V-A14B | B | 129.39M | 16 | H100 |
| WAN 2.2 TI2V-5B | 5B | 105.02M | 16 | A100 40 GB |
| Model | Steps | Guidance | Shift | Sampler | Resolution | Gen. frames @ fps |
|---|---|---|---|---|---|---|
| Cosmos 3 Nano 16B | 35 | 6.0 | 10.0 | UniPC | 120 @ 24 | |
| Cosmos 3 Nano 16B † | 50 | 3.0 | 4.75 | UniPC | 120 @ 24 | |
| Cosmos v2.5 2B | 35 | 7.0 | 5.0 | UniPC | 92 / 80 @ 16 | |
| WAN 2.2 I2V-A14B | 40 | 3.5 / 3.5 | 5.0 | UniPC | 80 @ 16 | |
| WAN 2.2 TI2V-5B | 50 | 5.0 | 5.0 | UniPC | 120 @ 24 |
| Model | Arm | Sequence (tokens) | s / sampler step | Peak (GiB) |
|---|---|---|---|---|
| Cosmos v2.5 2B | Backbone | 84,480 | 6.514 | 6.20 |
| Physical Registry | 112,640 | 10.909 | 7.00 | |
| Cosmos 3 Nano 16B | Backbone | 28,607 / 31,364 | 1.384 | 11.44 |
| Physical Registry | 35,967 / 38,724 | 2.148 | 11.94 |
| I2V | Spatial | Spatiotemp. | Weighted | Inv. MSE | Verified | Original |
|---|---|---|---|---|---|---|
| Nano 16B + PR | 46.63 | 31.01 | 32.76 | 33.63 | 36.01 | 35.00 |
| Nano 16B † + PR | 60.70 | 33.56 | 42.46 | 37.53 | 43.56 | 42.95 |
| Cosmos v2.5 2B + PR | 44.46 | 34.44 | 30.29 | 25.65 | 33.71 | 34.00 |
| WAN I2V-A14B + PR | 44.77 | 42.06 | 32.67 | 34.19 | 38.44 | 38.90 |
| WAN TI2V-5B + PR | 36.82 | 30.81 | 22.33 | 26.99 | 29.24 | 27.87 |
| V2V | Spatial | Spatiotemp. | Weighted | Inv. MSE | Verified | Original |
| Model | Instruction following (0–3) | Physical adherence (0–5) | Common sense (0–2) | Total (0–10) |
|---|---|---|---|---|
| Cosmos 3 Nano 16B ( NVIDIA et al., 2026 ) | 2.20 ± 0.02 | 4.50 ± 0.08 | 1.43 ± 0.06 | 8.13 ± 0.13 |
| + Physical Registry | 2.20 ± 0.002 (–) | 4.82 ± 0.03 (+0.32) | 1.81 ± 0.02 (+0.38) | 8.83 ± 0.04 (+0.69) |
| Cosmos v2.5 2B ( NVIDIA et al., 2025b ) | 2.14 ± 0.03 | 4.43 ± 0.07 | 1.55 ± 0.05 | 8.12 ± 0.14 |
| + Physical Registry | 2.07 ± 0.01 (-0.07) | 4.54 ± 0.03 (+0.11) | 1.58 ± 0.04 (+0.03) | 8.19 ± 0.01 (+0.07) |
| WAN 2.2 I2V-A14B ( Wan Team, 2025 ) | 2.23 ± 0.03 | 4.45 ± 0.04 | 1.60 ± 0.03 | 8.28 ± 0.02 |
| + Physical Registry | 2.30 ± 0.04 (+0.07) | 4.53 ± 0.04 (+0.07) | 1.60 ± 0.02 (+0.004) | 8.43 ± 0.05 (+0.15) |
| Scene | Motion | Semantics | Diversity | |||||
| Model | Consist. | HSD | NDTW | DYN | BLEU | CLIP | Logic | Div. |
| Cosmos 3 Nano 16B ( NVIDIA et al., 2026 ) | 0.855 | 0.328 | 0.305 | 0.383 | 0.242 | 0.884 | 0.921 | 0.029 |
| Physical Registry | 0.895 | 0.351 | 0.378 | 0.459 | 0.244 | 0.897 | 0.921 | 0.018 |
| (+0.040) | (+0.023) | (+0.073) | (+0.076) | (+0.002) | (+0.013) | (-0.011) | ||
| EnerVerse-FT * ( Huang et al., 2025 ) | 0.943 | 0.536 | 0.596 | 0.536 | 0.180 | 0.864 | 0.978 | 0.069 |
| LTX-FT * ( HaCohen et al., 2024 ) | 0.944 | 0.476 | 0.521 | 0.620 | 0.174 | 0.855 | 0.967 | 0.016 |
| I2V | Plain | WMReward | PRS | Oracle |
|---|---|---|---|---|
| Cosmos 3 Nano 16B | 30.18 ± 0.84 | 31.69 | 41.48 | |
| + Physical Registry | 36.01 ± 0.95 | 38.85 | 40.27 | 51.88 |
| Cosmos 3 Nano 16B † | 37.3 ± 0.9 * | 44.28 | 50.59 | |
| + Physical Registry † | 43.56 ± 0.95 | 45.41 | 45.81 | 54.72 |
| Cosmos v2.5 2B | 30.65 ± 0.37 | 30.61 | 36.07 | |
| + Physical Registry | 33.71 ± 1.11 | 37.74 | 39.08 | 49.37 |
| Backbone | Policy | Candidate-steps | Decodes | Wall-clock (s) | Speed-up |
|---|---|---|---|---|---|
| Cosmos v2.5 2B | Complete BoN WMReward | 350 | 10 | 4,031 | 1.00 |
| PRS ( of ) | 125 | 1 | 1,420 | ||
| Cosmos 3 Nano 16B † | Complete BoN WMReward | 500 | 10 | 1,985 | 1.00 |
| PRS ( of ) | 140 | 1 | 614 | ||
| WAN 2.2 I2V-A14B | Complete BoN WMReward | 400 | 10 | 10,748 | 1.00 |
| PRS ( of ) | 130 | 1 | 3,289 |
| Configuration | Valid frames | Vertical span | Upward return | Path length |
|---|---|---|---|---|
| A: Native forecast | 121/121 | 289.7 | 80.1 | 526.9 |
| B: Transfer | 121/121 | 281.1 | 3.6 | 290.9 |
Video World Models
Video world models generate and predict action-conditioned visual futures to simulate changing scenes for embodied agents.
See all 257 papers