DynThinker: Unifying Static 3D and Dynamic 4D Spatial Reasoning
Organizations: 1Nanyang Technological University · 2Shenzhen campus of Sun Yat-sen University · 3Yinwang Intelligent Technology Co. Ltd · 4MBZUAI
Abstract
Achieving general spatial intelligence requires a unified understanding of both static 3D and dynamic 4D. However, we find that existing models struggle to excel at both: 3D post-training can weaken dynamic understanding, while 4D-specialized models often lack strong static 3D reasoning. Our analysis reveals that this spatial--dynamic interference is highly non-uniform across parameter groups, with the balance between static and dynamic capabilities particularly sensitive to changes in late-layer MLPs. To address this interference, we propose DynThinker, a unified framework for jointly strengthening static and dynamic spatial reasoning. Decoupled Exponential Moving Average (D-EMA) applies configurable group-wise averaging to constrain drift in interference-sensitive pretrained parameters while preserving flexibility for capability enhancement. Spatial-Dynamic Fusion (SDF) complements D-EMA by selectively integrating spatial and temporal priors from a dynamic geometry encoder into intermediate VLM representations under semantic guidance. Across ten metrics spanning nine static 3D and dynamic 4D benchmarks, DynThinker achieves the highest average score among all evaluated models. Notably, DynThinker achieves 56.0 on ReVSI, 67.2 on DSR-Bench, and 51.2 and 40.1 under the sample-wise and group-wise evaluation protocols of DSI-Bench, respectively, setting new state-of-the-art results among the compared open-source models across all four evaluations within a unified model.
Figures & tables
| Models | AVG. | Spatial statics | Temporal dynamics | ||||||||
| VSI | MMSI | MindCube | ViewSpatial | SITE | CV-Bench | VLM4D | DSR | DSI-S | DSI-G | ||
| Human | - | 79.2 | 97.2 | 94.5 | - | 67.5 | - | 98.8 | - | - | - |
| Random Choice | - | 34.0 | 25.0 | 33.0 | 26.3 | 0.0 | - | 24.1 | - | 25.0 | 0.1 |
| Proprietary Models | |||||||||||
| Seed-1.6 ( ByteDance Seed, 2025 ) | - | 49.9 | 38.3 | 48.7 | 43.8 | 54.6 | 85.2 | - | - | 41.3 | 16.1 |
| Gemini-2.5-Pro ( Comanici et al., 2025 ) | 50.6 | 53.5 | 38.0 | 57.6 | 46.0 | 57.0 | 85.9 | 62.0 | 31.7 | 46.9 | 27.1 |
| Methods | Frames | Avg. | Numerical Answer | Multiple-Choice Answer | |||||
| Obj.Count | Abs. Dist. | Obj. Size | Room Size | Rel. Dist. | Rel. Dir. | Route Plan | |||
| Proprietary Models | |||||||||
| GPT-5.2 ( OpenAI, 2025b ) | 64 | 50.9 | 56.2 | 41.5 | 73.9 | 63.0 | 48.4 | 34.9 | 38.2 |
| Gemini 3 Flash ( Google DeepMind, 2025 ) | 1 FPS | 57.6 | 65.7 | 53.1 | 77.6 | 52.8 | 64.6 | 47.9 | 41.8 |
| Gemini 3 Pro ( Gemini, 2025 ) | 1 FPS | 60.9 | 60.1 | 54.7 | 79.3 | 51.9 | 68.1 | 56.0 | 56.4 |
| Open-source Models | |||||||||
| Model | Components | Results | |||||
| SFT | D-EMA | VDPM | Static | Tem. | VSI | VLM4D | |
| Qwen3-VL-4B | ✗ | ✗ | ✗ | ✗ | ✗ | 54.90 | 57.10 |
| GeoThinker Qwen3-VL-4B | ✓ | ✗ | ✗ | ✗ | ✗ | 51.31 | 45.20 |
| DynThinker Qwen3-VL-4B | ✓ | ✓ | ✗ | ✗ | ✗ | 53.14 | 53.57 |
| ✓ | ✓ | ✓ | ✗ | ✗ | 53.60 | 54.01 | |
| ✓ | ✓ | ✓ | ✓ | ✗ | 56.19 | 58.64 | |
Appendix figures & tables18 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | Benchmark | # Frames | |||
| 16 | 32 | 64 | 128 | ||
| GeoThinker Qwen3-VL-8B-32frame | VSI | 69.2 | 72.6 | 73.4 | 73.4 |
| VSI-Debiased | 64.3 | 66.3 | 67.7 | 68.1 | |
| ReVSI | 52.6 | 53.9 | 54.8 | 55.9 | |
| DynThinker Qwen3-VL-8B-32frame | VSI | 64.0 | 69.3 | 70.7 | 72.1 |
| VSI-Debiased | 57.1 | 63.1 | 64.4 | 66.5 | |
| Training Configuration | Target D-EMA Drift | Avg. | Spatial Statics | Temporal Dynamics | ||||||||
| VSI | MMSI | MindCube | ViewSpatial | SITE | CV-Bench | VLM4D | DSR | DSI-S | DSI-G | |||
| Base mixture, 8-frame training | 12.5% | 50.28 | 61.5 | 31.9 | 42.7 | 42.9 | 57.1 | 86.6 | 62.9 | 46.6 | 45.2 | 25.4 |
| 25% | 54.77 | 64.8 | 30.7 | 67.1 | 46.7 | 56.8 | 87.4 | 61.8 | 61.2 | 45.2 | 26.0 | |
| Base mixture, 32-frame training | 25% | 53.73 | 66.2 | 30.4 | 61.2 | 45.6 | 58.0 | 87.0 | 61.3 | 59.5 | 44.3 | 23.9 |
| 50% | 57.24 | 69.2 | 29.1 | 87.3 | 47.4 | 56.7 | 87.4 | 57.0 | 66.1 | 45.2 | 27.0 | |
| + MLLM4D: | 50% | 59.87 | 70.1 | 31.4 | 90.2 | 48.0 | 57.0 | 86.3 | 58.6 | 67.7 | 50.5 | 39.0 |
| Models | Rank | Avg. | Static Understanding | Dynamic Understanding | ||||||
| Dim. Meas. | Spatial Relation | 3D Video Grounding | Disp. & P.L. | Speed & Acc. | Ego Orient. | Traj. Desc. | Pose Est. | |||
| Proprietary Models (API) | ||||||||||
| GPT-4o | 10 | 34.8 | 27.1 | 51.8 | 29.0 | 23.2 | 35.4 | 33.7 | 32.0 | 53.6 |
| Gemini-2.0-Flash | 6 | 38.7 | 31.9 | 50.0 | 31.8 | 27.7 | 32.1 | 10.8 | 38.5 | 61.3 |
| Claude-3.7-Sonnet | 3 | 40.5 | 29.8 | 45.5 | 35.7 | 28.9 | 38.8 | 40.0 | 47.4 | 62.6 |
| Gemini-2.5-Pro | 1 | 41.4 | 38.7 | 53.8 | 36.9 | 33.9 | 33.1 | 52.5 | 47.4 | 50.4 |
| Model | Real(%) | Synthetic(%) | Format(%) | Overall | |
| Empty | Valid | ||||
| MLLM4D Official | |||||
| Qwen3-VL-8B | 52.1 | 52.4 | – | – | 52.2 |
| MLLM4D Qwen2.5-VL-7B | 59.4 | 49.7 | – | – | 57.0 |
| MLLM4D Qwen3-VL-8B | 63.1 | 54.4 | – | – | 61.0 |
| MLLM4D-SFT | 59.7 | – | – | – | – |
| Methods | Avg. | Numerical Answer | Multiple-Choice Answer | ||||||
| Obj.Count | Abs. Dist. | Obj. Size | Room Size | Rel. Dist. | Rel. Dir. | Route Plan | Appr. Order | ||
| Baseline | |||||||||
| Chance Level (Random) | – | – | – | – | – | 25.0 | 36.1 | 28.3 | 25.0 |
| Chance Level (Frequency) | 34.0 | 62.1 | 32.0 | 29.9 | 33.1 | 25.1 | 47.9 | 28.4 | 25.2 |
| Proprietary Models (API) | |||||||||
| GPT-4o ( Hurst et al., 2024 ) | 34.0 | 46.2 | 5.3 | 43.8 | 38.2 | 37.0 | 41.3 | 31.5 | 28.5 |
| Strategy | Target Drift Budget | VSI-Bench | VLM4D | |
| MLP ( ) | Others | |||
| Qwen2.5-VL-7B | ||||
| Pretrain | – | – | 29.34 | 43.80 |
| D-EMA | 12.5% | 12.5% | 34.44 (+5.10) | 55.17 (+11.37) |
| 100% | 100% | 49.65 (+20.31) | 46.64 (+2.84) | |
| 12.5% | 100% | 50.37 (+21.03) | 48.56 (+4.76) | |
| Training Configuration | VSI-Bench | VLM4D |
| Qwen2.5-VL-7B | ||
| Pretrained | 29.34 | 43.80 |
| Static 3D SFT | 49.37 | 46.80 |
| Static 3D SFT + D-EMA | 49.73 | 47.57 |
| Static 3D SFT + D-EMA + SDF | 50.37 | 48.56 |
| Qwen3-VL-4B | ||
| Strategy | Update interval | VSI-Bench | VLM4D |
| Baseline | |||
| Pre-train Model | – | 54.90 | 57.10 |
| Direct SFT | – | 52.61 | 46.75 |
| Frozen MLP | |||
| Frozen All MLP | – | 51.41 | 50.27 |
| Weight Pulling | |||
| Model | Benchmark | # Frames | ||||
| 8 | 16 | 32 | 64 | 128 | ||
| With token compression | ||||||
| DynThinker Qwen3-VL-4B | VSI | 47.72 | 49.37 | 53.14 | 56.37 | 57.24 |
| VLM4D | 57.65 | 53.41 | 53.41 | 53.02 | 51.87 | |
| DynThinker Qwen3-VL-8B | VSI | 49.93 | 53.52 | 57.11 | 58.87 | OOM |
| VLM4D | 62.33 | 61.56 | 60.51 | 60.51 | OOM | |
| Model | Interpolate | VSI | VLM4D |
| ratio | |||
| Baseline | |||
| GeoThinker Qwen3-VL-8B ( ) | 100% | 72.6 | 42.40 |
| Qwen3-VL-8B-Instruct ( ) | 0% | 57.75 | 60.07 (60.07) |
| Interpolate all | |||
| 75% + 25% | 75% | 71.70 | 45.95 |
| Model | Interpolate | VSI | VLM4D |
| ratio | |||
| Baseline | |||
| DynThinker Qwen3-VL-4B w/o D-EMA ( ) | 100% | 71.06 | 50.33 |
| Qwen3-VL-4B-Instruct ( ) | 0% | 54.90 | 57.10 (1.87) |
| Interpolate all | |||
| 75% + 25% | 75% | 71.32 | 48.84 |
| Model | Steps | Spatial | Object | Goal | Long | Avg |
| Baseline | ||||||
| +FAST ( Pertsch et al., 2025 ) | - | 96.4 | 96.8 | 88.6 | 60.2 | 85.5 |
| ( Black et al., 2024 ) | - | 96.8 | 98.8 | 95.8 | 85.2 | 94.1 |
| OpenVLA-OFT-7B ( Kim et al., 2025 ) | 175K | 97.6 | 98.4 | 97.9 | 94.5 | 97.1 |
| GR00T-N1.5 ( Bjorck et al., 2025 ) | 20K | 92.0 | 92.0 | 86.0 | 76.0 | 86.5 |
| Qwen3-VL-4B | ||||||
Spatiotemporal Reasoning
Spatiotemporal reasoning studies how systems connect objects, events, locations, and changes across space and time.
See all 70 papers