QCC-WM: Linking Macro-State Dynamics and Visual Generation via Quotient Causal Construction
Organizations: School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054, China · Department of Radiology, Huzhou Maternity & Child Health Care Hospital, Huzhou, 313000, China · Department of Radiology, Huzhou Maternity & Child Health Care Hospital Affiliated to Huzhou Normal University, Huzhou, 313000, China · School of Health and Wellbeing, University of Glasgow, Glasgow, G12 8TB, United Kingdom ·
Abstract
A key challenge in action-conditioned world modeling is to construct macro-states from high-dimensional observations that support recursive prediction under actions, while keeping their predicted evolution consistent with visual changes in generated observations. We propose QCC-WM, a visual world model based on Quotient-based Causal Construction. QCC-WM uses action responses to guide macro-variable construction for recursive action-conditioned prediction. A shared reference quotient measurement constrains the consistency between predicted states and observed changes, allowing macro-level predictions to provide structured constraints for future visual generation. Using translational and rotational actions and their predicted responses, the model aggregates local visual features into macro-nodes with spatial correspondence through causal abstraction, and recursively predicts node content and motion under a shared reference measurement. Macro-level predictions guide future observation generation, while predicted motion transports historical appearance information. Node-level errors between generated observations and macro-level targets are then mapped back to the corresponding spatial regions for correction, improving consistency between visual generation and macro-level predictions. On the US-VLA dataset, QCC-WM achieves an ROI-MSE of 0.01861 for four-step prediction. Compared with the best baseline at each prediction horizon, it reduces LPIPS by 48.59%, 41.68%, and 30.23% for four-step prediction and eight- and sixteen-step recursive extrapolation, respectively. Ablation studies and mechanism analyses show that motion-guided reference transport mainly improves pixel reconstruction, while node-level error feedback further improves perceptual quality and consistency between generated observations and macro-level predictions.
Figures & tables
| Setting | ROI-MSE | PSNR | SSIM | LPIPS | Temporal MSE |
|---|---|---|---|---|---|
| Direct | |||||
| Single QCC: T-only | |||||
| Single QCC: R-only | |||||
| Dual QCC: T and R | |||||
| Method | ROI-MSE | PSNR | SSIM | LPIPS | Temporal MSE |
|---|---|---|---|---|---|
| PredRNN-Act [ 22 ] | |||||
| PredRNN-V2-Act [ 23 ] | |||||
| SimVP+Act [ 5 ] | |||||
| IRASim-S/4 [ 29 ] | |||||
| DINO-WM+Dec. [ 28 ] | |||||
| Method | ROI-MSE | PSNR | SSIM | LPIPS | Temporal MSE |
|---|---|---|---|---|---|
| PredRNN-Act [ 22 ] | |||||
| PredRNN-V2-Act [ 23 ] | |||||
| SimVP+Act [ 5 ] | |||||
| IRASim-S/4 [ 29 ] | |||||
| DINO-WM+Dec. [ 28 ] | |||||
| Method | ROI-MSE | PSNR | SSIM | LPIPS | Temporal MSE |
|---|---|---|---|---|---|
| PredRNN-Act [ 22 ] | |||||
| PredRNN-V2-Act [ 23 ] | |||||
| SimVP+Act [ 5 ] | |||||
| IRASim-S/4 [ 29 ] | |||||
| DINO-WM+Dec. [ 28 ] | |||||
| Horizon | Method | ROI-MSE | PSNR/dB | SSIM | LPIPS | Temporal MSE |
|---|---|---|---|---|---|---|
| PredRNN-Act [ 22 ] | ||||||
| PredRNN-V2-Act [ 23 ] | ||||||
| SimVP-Act [ 5 ] | ||||||
| IRASim-S/4 [ 29 ] | ||||||
| DINO-WM [ 28 ] | ||||||
| MAU-Act [ 3 ] |
Action-Conditioned World Models
Action-conditioned world models predict how environments change under actions to support planning, control, and simulation.
See all 371 papers