Video world models are used as simulators, so when a first frame leaves several physical outcomes open, repeated generations should produce each outcome as often as it occurs in the data. Physics post-training scores every generation against the single recorded future of its history, which makes single videos more faithful, but the expected score is linear in the model distribution and is maximized by always producing the most likely outcome. The log-likelihood of the recorded outcome is maximized by the data distribution, and its gradient weights agreement with the record by the inverse of how often the model produces the generated outcome, a frequency that other generations of the same history with independent noise, its siblings, can estimate. To train with this weight from a finite group, we propose SibPO, which performs Sibling-paired Policy Optimization: siblings estimate a truncated inverse-frequency weight for agreement with the record, and a second term subtracts the same weight times the agreement with the siblings, which makes the expected objective a strictly proper divergence over outcome cells at every group size. On PisaBench, SibPO lowers the KS distance to simulated landing times by 9.1-10.2% relative to the strongest method outside its reward family on three of four video models without degrading single videos, and it lowers the error of estimated robot policy success rates by 13%.
Figures & tables
Figure 1: What each generation is compared with decides the outcome frequencies after post-training. The frame leaves open whether the red cloth will touch the yellow object, and 60% of such futures show contact. Each block is the readout of one generated video, and five samples per method are only illustrative. Flow-GRPO compares each generation only with the recorded future, so the no-contact outcome loses on average and disappears. SibPO also compares each generation with its siblings, the other generations of the same input. Its reward, in the simplest form, subtracts the mismatch with the record ( − ) and adds the mismatch with the siblings ( + ), so the rare outcome is kept.
Figure 2: Overview of SibPO on one training group. All G=8 generations xg share the history h and draw their own noise εg (shared noise is only a comparison setting in Section 6.3 ). A frozen readout maps each video to a two-cell outcome vector, contact (orange) or no contact (teal). The matrix pairs the eight generations, grouped by outcome, with each other and with the record (left column): a cell takes the outcome color when the two agree ( κ=1 ) and stays white when they differ. The reward rg of Eq. ( 4 ) weights agreement with the record by ωg , which grows with the white cells of row g , and subtracts the sibling term ρg . The baseline bg recomputes the rewards without xg .
Figure 3: Group standard-deviation normalization erases the sibling term, and the leave-one-out advantage of SibPO keeps it. Advantages of three estimators for one Physion group of eight generations whose record shows contact (filled dots: contact). Flow-GRPO compares each generation only with the record. GRPO + sibling term adds the sibling term −ρg of Eq. ( 4 ) , which lowers the reward of a generation the more often its siblings share its outcome, but group mean and standard-deviation normalization returns the Flow-GRPO advantages (Part 3 of Proposition 2 ). SibPO uses the leave-one-out baseline of Eq. ( 5 ) . Averaged over records with contact probability 0.6 , the no-contact generation receives −0.35 under both normalized estimators and +0.51 under SibPO, which raises its frequency toward 0.4 .
Method
Trained mechanisms
Held-out mechanisms
Single-video quality
GPU-h
PisaBench
Physion
Kubric ‡
Pisa.
Physion
PAW.
Cali.
PisaBench
Phys.-IQ
VBench
KS ↓
IQR →1
Brier ↓
Pear. ↑
κ↑
Acc. ↑
KS ↓
KS ↓
Brier ↓
TVD ↓
mnTV ↓
L2 ↓
IoU ↑
Score ↑
Dyn. ↑
Base model
0.585
0.71
0.255
0.352
0.189
60.2
0.412
0.585
0.255
30.5
0.606
12.0
9.3
25.3
40.7
0.0
SFT
0.302
0.81
0.250
0.375
0.201
60.9
0.301
0.503
0.253
29.4
0.628
9.4
11.0
25.4
42.0
21.6
Rewards against the recorded future
RLVR-World [ 49 ]
0.331
0.56
0.276
0.361
0.185
59.9
0.322
0.524
0.272
31.9
0.641
9.0
11.5
24.3
39.3
21.1
Table 1: Comparison with post-training methods on Cosmos-Predict2.5-2B [ 32 ] . Same base weights, data, 150 updates and generation count. Held-out columns retrain without the falling family (Physion: all-but-one). ‡ Our split. † Spread-matched deployment. L2 and IoU ×10−2 , TVD ×100 . ORO: PISA-ORO. Pear.: correlation with humans. Dyn.: VBench-I2V dynamic degree. GPU-h: A100 training hours. Bold: best per column.
Figure 4: Rewards against the recorded future collapse an ambiguous landing, and SibPO keeps its minority outcome. Five generations per method on Cosmos-Predict2.5-2B at frame 12 of one PisaBench input, where the simulator places 70% of objects on the ground.
Reward
M
λ
Theory
PisaBench / Physion
p⋆
Rest. ↑
KS ↓
IQR →1
Pear. ↑
Single comparison
0
0
1
−0.50
0.334
0.54
0.352
EBFT features [ 16 ]
0
1
n/a
n/a
0.268
0.76
0.371
Success count [ 43 ]
7
0
0.658
2.79
0.249
0.81
0.379
SibPO, M=0
0
1
0.650
1.00
0.256
0.80
0.377
SibPO, group mean
6
1
0.651
3.52
0.243
0.85
0.384
Table 2: Members of the sibling-paired reward family on Cosmos-Predict2.5-2B. Theory: binary outcome, q=0.65 , G=8 , stationary frequency p⋆ and restoring update (Rest.) at p=0.95 relative to M=0 , λ=1 . EBFT has no outcome-level p⋆ (n/a).
Figure 5: The pairing effect in two further model families. Four generations at frame 14 for a falling toaster, which lands by this frame in 67% of simulations.
Appendix figures & tables19 assets
Supplementary material from the paper’s appendix.
Appendix
Reward
KS ↓ at group size
IQR →1 after restart
G=4
G=8
G=16
10 upd.
25 upd.
50 upd.
Flow-GRPO (single comparison)
0.326
0.329
0.334
0.55
0.54
0.53
Success count [ 43 ]
0.287
0.249
0.244
0.61
0.67
0.74
SibPO, M=0
0.259
0.256
0.254
0.59
0.62
0.67
SibPO
0.246
0.241
0.239
0.63
0.71
0.79
Appendix
Table S1 : Reward-family members across group sizes and from a collapsed start on Cosmos-Predict2.5-2B. Left: PisaBench KS distance at 32 generations per update (default G=8 ). Right: IQR ratio when training continues from the Flow-GRPO checkpoint (IQR ratio 0.55 ).
Figure S1 : Why a PisaBench first frame admits many landing times. For each first frame, the curves mark where the object would first touch the ground if it were placed at depths between 2 and 18 m with the camera height of the generator, and the color gives the frame of contact. The recorded video (star) realizes one of these depths, so the analytic distribution of landing times has a width that the frame cannot resolve.
Method
Wan2.2-5B
CogVideoX-5B
Cosmos-14B
KS ↓
IQR
Brier ↓
KS ↓
IQR
Brier ↓
KS ↓
IQR
Brier ↓
Base model
0.653
0.64
0.269
0.537
0.75
0.254
0.537
0.59
0.262
SFT
0.348
0.74
0.264
0.294
0.85
0.251
0.296
0.72
0.255
Rewards against the recorded future
RLVR-World
0.371
0.51
0.287
0.312
0.61
0.279
0.352
0.47
0.281
Flow-GRPO
0.368
0.50
0.290
0.309
0.62
0.276
0.361
0.45
0.286
Appendix
Table S2 : Trained-mechanism comparison on two further model families and at 14B scale. Same methods, data, 150 updates, three seeds and protocol as Table 1 , plus EBFT and the quadratic member of the family under the same budget. KS and IQR ratio (ideally 1) are PisaBench, Brier is Physion. Held-out and single-video metrics are in Table S4 and Table S5 .
Method
RT-1 ( ×10−2 )
Real2Sim
MSE ↓
LPIPS ↓
Disp.
MAE ↓
ρ↑
Brier ↓
Base model
0.659
14.8
3.53
17.2
0.71
0.214
SFT
0.602
14.2
3.29
15.4
0.74
0.207
RLVR-World (released) [ 49 ]
0.486
13.4
2.41
14.6
0.76
0.219
RLVR-World (retrained)
0.491
13.6
2.47
14.3
0.76
0.217
DynamicsBoost [ 22 ]
0.561
14.0
3.02
13.8
0.80
0.209
Appendix
Table S3 : Robot policy evaluation with an autoregressive world model. iVideoGPT [ 48 ] on RT-1. Disp. is the mean pairwise L1 distance of 32 generations, and Real2Sim compares world-model with real-robot success rates [ 24 ] , with MAE ×10−2 . The variant row uses the L1+LPIPS distance.
Figure S2 : Transfer to untrained mechanisms on PAWBench. Six generations per model for a bowling scene, labeled with the number of knocked-down pins, and a tablecloth pull, labeled with the fate of the tableware. Flow-GRPO repeats a few outcomes more often than the base model, and SibPO keeps a spread similar to the base model. Input frames are the official PAWBench source images of scenes BC-03 and BS-03, and the corner mark is part of the distributed files.
Method
Wan2.2-TI2V-5B
CogVideoX1.5-5B-I2V
Physion
Kub. ‡
Pisa.
Ph.-IQ
VBench
PAW.
Cali.
Physion
Kub. ‡
Pisa.
Ph.-IQ
VBench
PAW.
Cali.
Pear. ↑
Acc. ↑
KS ↓
L2 ↓
Score ↑
Dyn. ↑
TVD ↓
mnTV ↓
Pear. ↑
Acc. ↑
KS ↓
L2 ↓
Score ↑
Dyn. ↑
TVD ↓
mnTV ↓
Base model
0.330
59.3
0.437
12.8
23.1
46.0
31.2
0.587
0.303
60.8
0.389
13.4
27.1
33.0
29.9
0.641
SFT
0.361
59.6
0.322
10.0
23.8
46.5
29.9
0.596
0.338
59.6
0.288
10.0
27.8
35.4
31.1
0.642
Rewards against the recorded future
RLVR-World [ 49 ]
0.337
58.8
0.352
9.3
22.0
44.1
32.4
0.611
0.331
59.0
0.319
9.4
27.4
31.8
32.5
0.618
Appendix
Table S4 : Held-out and single-video metrics on Wan2.2-TI2V-5B and CogVideoX1.5-5B-I2V. Complements Table S2 with the remaining metrics of Table 1 under the same protocol. Pear. is the Physion correlation with humans, Acc. the Physion accuracy, L2 the PisaBench real-video trajectory error ( ×10−2 ), Dyn. the VBench-I2V dynamic degree, and PAWBench TVD ( ×100 ) and CaliBench mnTV score held-out mechanisms. ‡ Our Kubric distributional split.
Method
Physion
Kub. ‡
Pisa.
Ph.-IQ
VB.
PAW.
Cali.
Pear. ↑
Acc. ↑
KS ↓
L2 ↓
Score ↑
Dyn. ↑
TVD ↓
mnTV ↓
Base model
0.371
62.0
0.384
11.2
27.9
38.6
29.4
0.592
SFT
0.389
62.3
0.284
8.9
28.4
39.5
29.0
0.598
RLVR-World
0.372
61.5
0.326
8.3
27.9
37.1
31.7
0.619
Flow-GRPO
0.366
61.2
0.331
8.2
28.9
37.8
32.0
0.624
ORO (Seg)
0.359
61.4
0.318
8.3
29.8
38.4
32.2
0.615
Appendix
Table S5 : Held-out and single-video metrics for Cosmos-Predict2.5-14B. Complements Table S2 under the same protocol, with the metrics of Table S4 .
Figure S3 : Single-video quality on Physics-IQ. Generations one second after the conditioning frame of four real scenes, next to the recorded continuation. Flow-GRPO and SibPO produce physically similar continuations, consistent with their close Physics-IQ scores.
Figure S4 : Landing-time spread of released PISA checkpoints. Boxes mark the central 80% of first-contact frames over 128 generations for the simulator (green), the supervised checkpoint (gray) and the ORO checkpoint (red) on four first frames. The star marks the first contact of the recorded video, shown as a film strip. On every frame the ORO window is the narrowest of the three and contains the recorded contact, while the supervised checkpoint stays closer to the simulated width.
Variant
PisaBench
Physion
KS ↓
IQR →1
S→1
Acc. ↑
Pear. ↑
κ↑
SibPO (default)
0.241
0.86
0.90
61.0
0.386
0.198
Mean-of-others baseline
G=4
0.249
0.82
0.86
60.8
0.380
0.194
G=8
0.243
0.85
0.89
61.0
0.384
0.197
G=16
0.242
0.86
0.89
61.1
0.387
0.197
Appendix
Table S6 : Interventions on the pairing of SibPO on Cosmos-Predict2.5-2B. Each row changes one design of SibPO (gray: leave-one-out baseline, independent noise, G=8 , with the sibling weight varied in Table 2 ) and keeps the rest fixed, on trained mechanisms, with three seeds per row.
Figure S5 : Partners from other histories keep the pooled rate and collapse each history. Two Physion inputs for which 29% and 70% of people predict contact, six generations each.
Figure S6 : Generated contact frequencies follow the ambiguity of the first frame only under SibPO. Four generations per Physion frame, with the share of people predicting contact on the left. Flow-GRPO commits to one outcome even when people are split ( 48% and 49% ), while SibPO keeps both outcomes there and largely agrees with people on the clear-cut frames.
Figure S7 : Contact frequencies across the range of human agreement. Twelve generations from the base model, Flow-GRPO and SibPO for Physion frames with about 25% , 70% and 95% of people predicting contact, in four scenarios. Each dot is the official readout of one generation, filled for contact. Flow-GRPO converts ambiguous frames into near-unanimous outcomes, while the base model and SibPO keep both outcomes on them.
Figure S8 : Repeated generations of Flow-GRPO and SibPO on PisaBench and Physion. Six independent generations per input. For a PisaBench drop with 74% simulated landings at frame 16 and Physion frames with 71% and 29% human contact predictions, Flow-GRPO produces the majority outcome in five or six of six generations, and SibPO produces the minority outcome more often, in proportions closer to the reference.
Sampler noise
Dfree
Dtied
Γu
Share
Cosmos-Predict2.5-2B [ 32 ]
Training value
0.194
0.087
0.107
0.55
Half
0.188
0.063
0.125
0.66
Wan2.2-TI2V-5B [ 44 ]
Training value
0.180
0.071
0.109
0.61
Half
0.181
0.052
0.129
0.71
Appendix
Table S7 : Dispersion hidden by shared initial noise. Disagreement rates of landing by frame 16 for replays of the base models with free and tied initial noise, from 16 replay groups on each of the 50 PisaBench frames, at the training sampler noise and at half of it. Share is Γu/Dfree .
Figure S9 : Tying the initial noise removes most of the outcome spread. Object outlines at first ground contact for twelve generations from each of three PisaBench frames, compared with a reference generation (black). The input frame on the left marks the enlarged region. With independent initial noise (orange) the contacts spread widely, with the initial noise of the reference shared (purple) they stay close to it, and halving the sampler noise tightens them further.
η
ε
PisaBench
Physion
KS ↓
IQR →1
S→1
Acc. ↑
Pear. ↑
κ↑
Flow-GRPO (single comparison)
0
0.071
0.329
0.55
0.62
59.6
0.349
0.178
0.15
0.207
0.315
0.61
0.68
60.0
0.343
0.177
0.30
0.339
0.308
0.66
0.73
60.3
0.357
0.183
SibPO (sibling pairing)
Appendix
Table S8 : Judge accuracy sweep on Cosmos-Predict2.5-2B. Training readouts are flipped with probability η on generated and recorded videos alike. ε is the measured readout error on generated videos after flipping.
Figure S10 : A more accurate judge narrows Flow-GRPO and widens SibPO toward the data. Time slices along a vertical scan line through the falling object, with 16 generations overlaid, after 25, 75 and 150 updates with an exact judge and with 30% judge error. Green lines mark the 10th and 90th percentiles of the simulated trajectory. Under the exact judge the trajectories of Flow-GRPO narrow steadily with training, judge error slows this narrowing, and SibPO covers most of the simulated band under both judges.
Method
Setting
PisaBench
Physion
KS ↓
IQR →1
S→1
Pear. ↑
κ↑
Sampler at deployment (guidance w0 )
Base model
ODE
0.597
0.70
0.77
0.359
0.182
Flow-GRPO
ODE
0.351
0.54
0.61
0.350
0.179
SibPO
ODE
0.272
0.79
0.84
0.381
0.195
Guidance scale (stochastic sampler)
Appendix
Table S9 : Deployment sampler and guidance on Cosmos-Predict2.5-2B. Post-training always uses the stochastic sampler at the default guidance scale w0 , whose results are those of Table 1 .