How Does Geometry Enter Generated Motion?
Organizations: The University of Tokyo · RWTH Aachen University · Harbin Institute of Technology, Shenzhen
Abstract
Under a fixed physical law, the visible geometry of a scene determines how motion must change. We ask how video generators realize this relationship. We fix the law and the initial state and change only the geometry drawn in the first frame, within matched families of tracks and deflectors, and compare each generated trajectory with the simulator prediction for that geometry. Paired interventions change one thing at a time: a local bump, the height of a barrier, the words of the prompt, the length of the clip. Across nine image-to-video models, geometry is preserved and shapes the motion: the speed of the ball follows the drawn undulation of a track. A physical state would carry this response forward, and here the generated motion parts from the law. The mean slope barely accelerates the ball, successive contacts fail to compose through a consistent state, an edit ahead of the ball alters its motion before it arrives, and the ball climbs over barriers higher than its release point. Two global conditions organize the global trajectory: text strongly controls the destination, while clip length strongly controls timing in the open-weight models tested. The pattern persists with photographed first frames. Current video generation thus behaves as geometry-conditioned motion synthesis whose evolution of state differs systematically from that of a fixed physical law.
Figures & tables
| ramp pairs | barriers | chutes | ||||||||||
| ascent | turn (s) | ratio | travel (mm) | ratio | outcome | time (s) | speed (m/s) | pass | (m -1 ) | exit, land (s) | landing (m) | |
| 60 ∘ ∗ | 0.54 | 0.980 | 35 (33–37) | 0.70 | pass | 0.78 | 0.51 (0.53) | 64 | 0 ∗ | 0.31, 0.53 | 0.82 | 0.714–0.744 |
| 30 ∘ | 0.64 | 0.975 | 92 (84–96) | 0.85 ∗ | pass | 0.83 | 0.34 (0.35) | 64 | +4 | 0.29, 0.51 | 0.82 | 0.714–0.742 |
| 15 ∘ ∗ | 0.87 | 0.965 | 183 (162–193) | 0.95 | pass | 0.90 | 0.14 (0.15) | 27 | −4 ∗ | 0.34, 0.56 | 0.61 | 0.714–0.741 |
| 5 ∘ | 1.74 | 0.929 | 509 (411–572) | 0.971 | pass | 1.03 | 0.03 (0.03) | 10 | +8 ∗ | 0.26, 0.48 | 0.49 | 0.715–0.741 |
| 0 ∘ ∗ | stop 1.36 | – | – | 1.05 ∗ | turn back | 0.86 | – | 0 | ||||
| photograph | scene | as-built against design | ensemble | nominal band | control |
| straight | −16.3/+52.3 mm, +0.07 ∘ ; 0.093 0.092 | stable | outside, 4% faster | twin | |
| −14.9/+42.5 mm, −1.36 ∘ ; 0.055 0.076; 15 17.5 mm | stable | outside, 19% faster | twin | ||
| −10.8/+28.6 mm, −1.03 ∘ ; 0.048 0.077; 15 14.7 mm | stable | outside 20% of the time | twin | ||
| broadband | −13.8/+47.7 mm, −0.62 ∘ ; 0.069 0.078; 10.6/11.5/10.2 mm | stable | outside, 15% faster | twin | |
| single, 30 ∘ | deflector 31.7 ∘ , mm; exit 0.815 m/s | 1.00 / 1.00 | inside | main-set render | |
| single, 60 ∘ | deflector 61.1 ∘ , mm; exit 0.872 m/s | 1.00 / 1.00 | contact 17 ms late | twin |
| level | fps | phase | kin. | acc. | |||
| 16 | 0.09 | 6.8 ∘ | 0.21 | 0.09 | 0.049 | 0.81 | |
| 24 | 0.11 | 7.5 ∘ | 0.15 | 0.06 | 0.027 | 0.86 | |
| 30 | 0.06 | 6.0 ∘ | 0.13 | 0.05 | 0.059 | 0.86 | |
| 16 | 0.08 | 4.5 ∘ | 0.16 | 0.09 | 0.038 | 0.93 | |
| 24 | 0.07 | 5.6 ∘ | 0.15 | 0.08 | 0.026 | 0.90 | |
| 30 | 0.04 | 4.1 ∘ | 0.10 | 0.05 | 0.032 | 0.94 |
| fps | size | order | residual max | p90 max | |
| 16 | 100% | 4.8 ∘ | 2.9 ∘ | 0.83–0.88 | |
| 100% | 8.6 ∘ | 4.2 ∘ | 0.81–0.89 | ||
| 24 | 100% | 2.8 ∘ | 2.1 ∘ | 0.82–0.89 | |
| 100% | 4.3 ∘ | 3.2 ∘ | 0.68–0.91 | ||
| 30 | 100% | 3.0 ∘ | 1.5 ∘ | 0.81–0.88 | |
| 100% | 4.4 ∘ | 2.3 ∘ | 0.79–0.90 |
| reading | simulator | exact renders | at tempo 2.5 |
| local edit, bump: / | −11.4 / +2.8% | −10.9 to −11.8 / +2.7 to +3.0% | −11.1 to −11.4 / +2.6 to +3.0%; p95 2.4–3.9 / 1.1–1.5% |
| local edit, dip: / | +7.8 / −0.8% | +7.3 to +8.1 / −0.6 to −1.3% | +7.5 to +8.2 / −0.5 to −1.1%; p95 2.8–5.6 / 1.3–1.6% |
| local edit: of the bump over its simulated value | 1 | 1.07–1.10 | 0.94–1.06 |
| null edit minus base: / | 0 | / | p95 3.0–4.6 / 1.0–1.6% ; flagged in 0 of 120 runs |
| path RMS before the edit | 0 | p95 0.07–0.09 mm | p95 4.2–4.8 mm |
| shared front: phase slope; front dispersion | 1; 0 | 1.00; 0.03–0.05 mm | 0.92–1.02 (single-video phase p95 19–32 ∘ ) ; 1.6–1.7 mm |
| track | deflector | local edit, | ramps, barriers, | trays, | clip length | ||||
| model | main set | main set | shared front | chutes | prompt pairs | 3 s | 8 s | photographed | regeneration |
| LTX-2.3 | 104/107 (120) | 1/14 (72) | 155/167 (216) | 28/32 (45) | 20/33 (120) | 17/19 (24) | 8/9 (24) | 18/19 (45) | not run |
| LTX-2.5 (distilled) | 120/120 (120) | 54/57 (72) | 216/216 (216) | 36/39 (45) | 56/67 (120) | 22/22 (24) | 18/20 (24) | 35/39 (45) | 63/68, 68/68, 58/60 (72) |
| LTX-2.5 | 99/100 (120) | 4/ – (72) | 209/209 (216) | 20/20 (33) | not run | not run | not run | 13/13 (24) | not run |
| Cosmos 3 Nano | 106/106 (120) | 48/48 (72) | 174/174 (216) | 33/33 (45) | 49/57 (120) | not run | not run | 40/40 (45) | not run |
| MiniMax-H3 | 120/120 (120) | 63/68 (72) | 216/216 (216) | 45/45 (45) | 119/119 (120) | 21/21 (24) | 23/23 (24) | 42/42 (45) | not run |
| example | form | model | where and how often |
| struck deflector rotates at or after impact | Seedance 2.0, Seedance mini | deflector main set, apparatus 14/72 and 7/72; one deflector turned 26 ∘ and moved 17 mm for 92 frames | |
| tray tilts or shifts after the landing | LTX-2.3, MiniMax-H3 | deflector main set (LTX-2.3: 13–24 mm and 6.6–8.5 ∘ ); MiniMax-H3 apparatus 9/72, mostly after the landing | |
| launch ramp rotates to another angle | LTX-2.5 dist. | deflector main set, 3–9 ∘ , 13 of its 18 flagged videos, 9 of them after the ball has left the ramp; trays and prompt pairs 62/120 | |
| deflectors move as loose objects | LTX-2.3 | apparatus on 71/72 deflector main-set and 100/120 tray and prompt videos; on photographs a deflector is knocked 125 mm and turned 124 ∘ , on twins it ends in the tray; chute trays move 7–27 mm in 12/12 | |
| rails shift against the board | LTX-2.3 | tracks: 16/120 in the main set, 58/180 local-edit videos (4.5–5.2 mm, about 1 ∘ ), in every arm including the null edit | |
| camera dollies in | LTX-2.5 | fiducial drift on 64/72 deflector videos, 12/120 track videos, 9/12 photographed track videos against 0/12 rendered twins |