Spatial Representation Distillation and Knowledge Routing for Vision-Language-Action Models
Organizations: DGIST, South Korea. · Yonsei University, South Korea. · Queen Mary University of London, UK.
Abstract
Understanding three-dimensional physical structure has become essential for vision-language-action models (VLAs). However, existing approaches either rely on explicit geometric inputs at inference time or adopt a single visual pathway, potentially compromising the visual-semantic knowledge inherited from pre-trained models. We present SPARK-VLA, Spatial Representation distillation and Knowledge routing for VLAs, a preserve-specialize-route framework for spatially adapting VLAs without requiring external 3D inputs or experts at inference. SPARK-VLA consists of two key components: (1) spatial representation distillation, which transfers 3D understanding from a frozen 3D expert to a LoRA-adapted visual branch by aligning attention responses while preserving the original visual pathway, and (2) a lightweight knowledge router, which selectively forwards action-relevant visual tokens to the language model using routing supervision derived from action-loss gradients. Across LIBERO, LIBERO-Plus, CALVIN, and real-world manipulation, SPARK-VLA achieves strong performance with only a 0.5B language backbone and approximately 53M trainable parameters, providing an effective and parameter-efficient approach to 3D-aware VLA learning. Code is available at https://github.com/park-jungin/spark-vla.
Figures & tables
| Method | Spatial | Object | Goal | Long | Average | LLM Size | Train. Params. |
| SR (%) | SR (%) | SR (%) | SR (%) | SR (%) | |||
| Large-scale models 7B | |||||||
| Octo ( Ghosh et al., 2024 ) | 78.9 | 85.7 | 84.6 | 51.1 | 75.1 | - | 93M |
| OpenVLA ( Kim et al., 2024 ) | 84.9 | 88.4 | 79.2 | 53.7 | 76.5 | 7B | 111M |
| OpenVLA-OFT ( Kim et al., 2025 ) | 97.6 | 98.4 | 97.9 | 94.5 | 97.1 | 7B | 111M |
| Spatial Forcing ( Li et al., 2025a ) | 99.4 | 99.6 | 98.8 | 96.0 | 98.5 | 7B | 291M |
| Method | Suite | Camera | Robot | Language | Light | Background | Noise | Layout | Total | LLM Size | Train. Params. |
| SR (%) | SR (%) | SR (%) | SR (%) | SR (%) | SR (%) | SR (%) | SR (%) | ||||
| Large-scale models 7B | |||||||||||
| OpenVLA ( Kim et al., 2024 ) | Avg. | 0.8 | 3.5 | 23.0 | 8.1 | 34.8 | 15.2 | 28.5 | 15.6 | 7B | 111M |
| OpenVLA-OFT ( Kim et al., 2025 ) | Avg. | 56.4 | 31.9 | 79.5 | 88.7 | 93.3 | 75.8 | 74.2 | 69.6 | 7B | 111M |
| UniVLA ( Wang et al., 2026b ) | Avg. | 1.8 | 46.2 | 69.6 | 69.0 | 81.0 | 21.2 | 31.9 | 42.9 | 7B | 8B |
| 1B Small-scale models 7B | |||||||||||
| Method | Task | Tasks Completed in a Row | Avg. Len | LLM Size | Train. Params. | ||||
| 1 | 2 | 3 | 4 | 5 | |||||
| MCIL ( Lynch and Sermanet, 2020 ) | ABCD D | 0.377 | 0.027 | 0.002 | 0.000 | 0.000 | 0.40 | - | - |
| RT-1 ( Brohan et al., 2022 ) | ABCD D | 0.844 | 0.617 | 0.438 | 0.323 | 0.227 | 2.45 | - | - |
| Robo-Flamingo ( Li et al., 2024 ) | ABCD D | 0.964 | 0.896 | 0.824 | 0.740 | 0.660 | 4.09 | 7B | 1.4B |
| GR-1 ( Wu et al., 2024 ) | ABCD D | 0.949 | 0.896 | 0.844 | 0.789 | 0.731 | 4.21 | - | - |
| UP-VLA ( Zhang et al., 2025b ) | ABCD D | 0.962 | 0.921 | 0.879 | 0.842 | 0.812 | 4.42 | - | 1.5B |
Appendix figures & tables14 assets
Supplementary material from the paper’s appendix.
Appendix
| Hyperparameter | Value |
| GPUs | NVIDIA RTX A6000 48GB 4 |
| Batch size per GPU | 16 |
| Initial learning rate / Final learning rate | 5e-5 / 5e-8 |
| Warm-up with Equation 13 | 2k steps |
| Learning rate scheduler | Cosine annealing lr scheduler |
| Input images | 1 exo-view + 1 wrist view |
| Method | Spatial | Object | Goal | Long | Average | Train. Params. |
| SR (%) | SR (%) | SR (%) | SR (%) | SR (%) | ||
| (a) only LLM LoRAs | - | - | - | - | < 5% | 31.4M |
| (b) + Vision LoRAs | - | - | - | - | < 5% | 60.1M |
| (c) + Projector | 82.6 | 84.4 | 77.4 | 45.0 | 72.4 | 64.9M |
| (d) - SigLIP | 62.4 | 76.8 | 58.4 | 37.2 | 58.7 | 48.8M |
| (e) + Attention Distill. | 95.8 | 96.0 | 94.0 | 90.6 | 94.1 | 48.8M |
| Spatial supervision | Success rate (%) |
| Action loss only | 81.6 |
| Feature matching | 94.8 |
| Relational matching | 95.6 |
| Attention-map matching | 96.4 |
| SPARK-VLA (ours) | 98.0 |
| Fusion strategy | Success rate (%) |
| Direct all-token concatenation | 94.0 |
| FiLM-based branch fusion | 94.8 |
| Action-driven knowledge router (ours) | 98.0 |
| Momentum | 0.0 | 0.9 | 0.99 | 0.999 | 0.9999 |
| Avg. SR (%) | 94.0 | 98.0 | 97.6 | 97.2 | 97.0 |
| Method | Suite | Camera | Robot | Language | Light | Background | Noise | Layout | Total | LLM Size | Train. Params. |
| SR (%) | SR (%) | SR (%) | SR (%) | SR (%) | SR (%) | SR (%) | SR (%) | ||||
| Large-scale models 7B | |||||||||||
| OpenVLA-OFT ( Kim et al., 2025 ) | Spatial | 88.3 | 40.0 | 80.5 | 98.3 | 97.3 | 96.3 | 93.9 | 84.0 | 7B | 111M |
| Object | 38.9 | 25.4 | 99.0 | 73.7 | 97.6 | 72.3 | 71.8 | 66.5 | |||
| Goal | 62.0 | 25.2 | 53.2 | 93.9 | 92.5 | 75.2 | 59.1 | 63.0 | |||
| Long | 38.7 | 38.2 | 87.0 | 89.4 | 86.8 | 63.5 | 76.9 | 66.4 | |||
| Object | Condition | SPARK-VLA | w/o VGGT |
| Red cup | Training object | 80% | 60% |
| Blue cup | Unseen color | 40% | 40% |
| Black cup | Unseen color | 60% | 40% |
| Green handleless paper cup | Unseen color and geometry | 40% | 40% |
| Small milk carton | Unseen category and geometry | 60% | 60% |
| Hand-cream bottle | Unseen category and geometry | 80% | 40% |
| Language instruction | SPARK-VLA | w/o VGGT |
| “Pick the cup in the sink.” | Complete | Complete |
| “Move the cup to the sink.” | Complete | Failure |
| “Pick the cup and place it in the right-side area.” | Complete | Failure |
| “Move the red object to the right-side area.” | Partial | Complete |
| “Get the cup ready to wash in the sink.” | Partial | Failure |
| “Pick up the handleless green cup and put it in the sink.” | Complete | Complete |
Vision-Language-Action Models
Vision-language-action models turn visual observations and natural-language instructions into actions for robots and other embodied agents.
See all 1,242 papers