cs.RONov 16, 2026

Stochastic Self-Distillation for Flow-Based Vision-Language-Action Models

Authors: Jingru Guo, Alessandra Russo, Joey Bose, Christos Ziakas

Organizations: Imperial College London

Abstract

Flow-based vision-language-action (VLA) models achieve strong performance in robotics through imitation learning, yet fine-tuning them with on-policy reinforcement learning (RL) is limited. In group-based RL methods like Group Relative Policy Optimization (GRPO), every rollout step requires multi-step ODE integration, and the sampler's limited stochasticity leads to rollout groups with low variance. We propose VLA-SSD, which addresses both high inference latency and limited stochasticity. In particular, our method self-distills a pretrained flow-matching action head into a stochastic one-step policy by conditioning a single-jump generator on a Brownian path. We derive a conditional action density via our stochastic one-step policy, enabling efficient post-training via likelihood-ratio RL algorithms. We show that distilling VLA-SSD from the π0π_0 VLA reduces the action head's forward-pass time by a factor of 7.7, at the cost of a 5.5% relative decrease in the success rate on the LIBERO benchmark. However, by leveraging the increased sample diversity of VLA-SSD during group generation, post-training a π0.5π_{0.5} VLA using GRPO yields a 20.6% relative improvement.

Figures & tables

Appendix figures & tables15 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. SnapFlow: One-Step Action Generation for Flow-Matching VLAs via Progressive Self-Distillation

    Apr 7, 2026Wuyang Luan, Junhui Li, Weiguang Zhao +2Efficient VLA InferenceVision-Language-Action Models

  2. StairVLA: Stage-Aware Hierarchical Action Generation for Vision-Language-Action Models

    Oct 6, 2026Shangyuan Yuan, Xinda Qi, Yujiang Pu +2Efficient VLA InferenceVision-Language-Action Models

  3. Multi-Teacher On-Policy Distillation for Flow-Based Vision-Language-Action Models

    Oct 15, 2026Lichao Ni, Yuhan Liu, Pengfei Li +1Flow-Based VLAsVision-Language-Action Models