Seeing Through the Illusion: Test-Time Scaling for World Action Models
Organizations: Huawei Technologies Canada · University of British Columbia
Abstract
World action models (WAMs) jointly generate actions and imagined futures, but a plausible prediction need not be realized by its co-generated action. We introduce WISE (World Action Inference Scaling through Evaluation), a pre-execution selector that scores each sampled rollout on action validity and temporal regularity, inverse-dynamics consistency between the proposed action and the imagined motion, and instruction-conditioned task progress, and executes the highest-scoring candidate while keeping the WAM frozen. With four candidates per decision, WISE raises closed-loop success from 6.0% to 24.0% on RoboLab with Cosmos~3 Edge and from 75.1% to 78.3% mean success on LIBERO with DreamZero, and exceeds the best existing selector in aggregate by 4.0 and 0.9 points. Component ablations and agreement analyses show that the three scores rank candidates differently and that task progress carries the largest weight in the fused decision.
Figures & tables
| Criterion | Compared quantities | Work |
|---|---|---|
| Future consensus | One predicted future vs. alternative futures | [ 7 ] |
| Cross-view geometry | Multiple views of a predicted future | [ 8 ] |
| Action distribution | Candidate action vs. conditional action distribution | [ 9 ] |
| Conditioning fidelity | Input action vs. action recovered from its rollout | [ 19 ] |
| Cross-output coherence | Co-generated action vs. motion in co-generated future | WISE |
World Models for Robotics
World models for robotics predict how scenes and robot states change under actions to support planning, control, and learning.
See all 399 papers