InfiniteWorld: Separating Visual Evidence from Familiar Physics
Organizations: Fudan University · The Chinese University of Hong Kong, Shenzhen
Abstract
Physical reasoning requires adapting familiar expectations to the dynamics of the observed world. Existing benchmarks establish broad physical capabilities, yet an overall score leaves unclear whether answers follow visual evidence when familiar rules no longer apply. We introduce InfiniteWorld, a benchmark that pairs physical-reasoning questions with simulator videos whose physical parameters are systematically altered. Its generation pipeline connects simulation, scene screening, paired video translation, question construction, and input checks. Five tasks assess law identification, parameter estimation, temporal reasoning, analytic counterfactual comparison, and law induction. The evaluation defines five matched input settings for each question, comprising text-only evaluation and ordered or shuffled observations from simulator and translated videos. We evaluate a diverse set of video-language models under these matched settings. The results expose a persistent preference for familiar physical rules. Frames improve performance for most models, but gains differ across tasks. Strong accuracy on Earth-normal questions coexists with poor recognition of altered dynamics, and Earth-normal answers remain common when the observed physics changes. Task scores and semantic agreement further distinguish matching physical factors from matching their amount, and correct answers from repeated errors. InfiniteWorld makes these behaviors measurable through paired changes in the evidence supplied for the same question, separating visual evidence from familiar physics.
Figures & tables
| Task | Questions | Earth-normal | Reference answer |
|---|---|---|---|
| Law identification | 6,764 | 2,396 | One listed altered factor or no alteration. |
| Parameter estimation | 1,230 | 599 | A physical quantity or bounce-height ratio. |
| Temporal reasoning | 3,024 | 1,095 | Relative height at two times within the video. |
| Analytic counterfactual comparison | 2,715 | 1,198 | Height or distance under an analytic reference. |
| Law induction | 1,496 | 0 | Whether a query and two references share a generator category. |
| Total | 15,229 | 5,288 | 3,382 distinct simulator videos. |
Appendix figures & tables19 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | Setting | LI | TR | AC | PE | IN | Macro |
|---|---|---|---|---|---|---|---|
| Qwen3-VL-32B | Text only | 25.78 | 33.63 | 46.45 | 25.85 | 50.00 | 36.34 |
| Simulator ordered | 45.40 | 51.39 | 51.31 | 36.79 | 51.47 | 47.27 | |
| Simulator shuffled | 44.40 | 42.79 | 51.86 | 36.02 | 50.67 | 45.15 | |
| Translated ordered | 41.40 | 34.85 | 52.56 | 36.83 | 51.20 | 43.37 | |
| Translated shuffled | 40.18 | 37.04 | 53.59 | 34.02 | 50.87 | 43.14 | |
| Qwen3-VL-30B-A3B | Text only | 21.58 | 35.35 | 40.11 | 25.85 | 50.00 | 34.58 |
| Setting | Agree (%) | Correct ( ) | Wrong ( ) | Disagree ( ) | Invalid ( ) |
|---|---|---|---|---|---|
| Text only | 51.09 | 425 | 1,303 | 1,654 | 0 |
| Simulator ordered | 67.45 | 1,072 | 1,209 | 1,101 | 0 |
| Simulator shuffled | 67.92 | 990 | 1,307 | 1,085 | 0 |
| Task | Public-text prediction rule | Credit / | Score |
|---|---|---|---|
| Temporal reasoning | Always same height | 1425 / 3,024 | 47.12 |
| Analytic counterfactual comparison | Lower for height; same for total distance | 1598 / 2,715 | 58.86 |
| Parameter estimation | Gravity ratio 1.0; upward fraction 0.25; bounce ratio 0.25 | 718.5 / 1,230 | 58.41 |
| Model | Exclude AC | Exclude AC and TR | ||||
|---|---|---|---|---|---|---|
| Simulator ordered | Visual gain | Order effect | Simulator ordered | Visual gain | Order effect | |
| Qwen3-VL-8B | 44.43 | +13.33 | +3.98 | 44.20 | +12.48 | +2.80 |
| Qwen3.8-27B | 44.64 | +4.91 | +2.05 | 44.85 | +7.67 | +1.73 |
| Gemma4-12B | 35.65 | +7.83 | -0.10 | 33.64 | +7.50 | -0.89 |
| GPT-5.4 Mini | 38.27 | +6.45 | +2.23 | 36.57 | +3.05 | -0.85 |
| GPT-5.6 Sol | 53.12 | +19.77 | +11.54 | 55.24 | +21.61 | +11.33 |
| Model | Text only | Simulator ordered | Difference (pp) | Accuracy |
|---|---|---|---|---|
| Qwen3-VL-8B | 28.37 | 34.62 | 31.23 | |
| Qwen3.8-27B | 94.76 | 63.69 | 21.29 | |
| Gemma4-12B | 39.40 | 33.15 | 26.14 | |
| GPT-5.4 Mini | 54.37 | 20.88 | 33.79 | |
| GPT-5.6 Sol | 44.25 | 10.05 | 59.07 | |
| GPT-5.6 Luna | 2.77 | 4.65 | 52.93 |
| Model | Setting | Match (Yes) | Different factors (No) | Earth-normal (No) | Different amount (No) | All |
|---|---|---|---|---|---|---|
| Mini | Text only | 1.60 | 98.01 | 97.93 | 99.35 | 49.93 |
| Mini | Simulator ordered | 14.71 | 89.49 | 85.12 | 89.61 | 51.40 |
| Mini | Simulator shuffled | 14.17 | 88.92 | 87.60 | 83.77 | 50.80 |
| Sol | Text only | 0.67 | 98.86 | 98.76 | 98.70 | 49.73 |
| Sol | Simulator ordered | 86.23 | 65.34 | 85.54 | 31.82 | 75.60 |
| Sol | Simulator shuffled | 88.10 | 39.20 | 64.05 | 20.13 | 65.71 |
Physical Reasoning
Physical reasoning studies how AI systems infer object properties, forces, and causal dynamics to predict and act in the physical world.
See all 69 papers