Vision-language-action (VLA) models have demonstrated exceptional performance in natural language-driven perception and control. However, the high computational cost of VLA models poses significant efficiency challenges, particularly for resource-constrained edge platforms in real-world deployments. However, since different stages of VLA (observation, action generation and execution) must proceed sequentially, and wait for the completion of the preceding stage, the system suffers from frequent halting and high latency. To address this, We conduct a systematic analysis to identify the challenges for fast and fluent generation, and propose enabling VLAs with the ability to asynchronously parallelize across VLA stages in a "streaming" manner. First, we eliminate the reliance on action chunking and adopt action flow matching, which learns the trajectory of action flows rather than denoising chunk-wise actions. It overlaps the latency of action generation and execution. Second, we design an action saliency-aware adaptive observation mechanism, thereby overlapping the latency of execution and observation. Without sacrificing performance, StreamingVLA achieves substantial speedup and improves the fluency of execution. It achieves a 2.4 × latency speedup and reduces execution halting by 6.5 ×.
Figures & tables
Figure 1: StreamingVLA explores streaming execution of VLA models by enabling different stage to be runned in a asynchronous manner. By overlapping the latency for stages, without sacrificing performance, it achieves 2.4 × end-to-end speedup, and 6.5 × execution halting time reduction, enabling fast and fluent execution.
Figure 2: The overall methodology framework for StreamingVLA: We conduct a systematic timeline analysis and conclude the optimization target for fast and fluent execution. We present two key techniques: action flow matching and adaptive early observation, to overlap the latency of action execution with of action generation and VLM observation, respectively.
Figure 3: The Illustration of state-based modeling of action flow matching: It reformulates the action modeling from predicting actions as absolute values to predicting actions as updates to a feature-space state accumulated by prior actions. Extended formulation and architectural adjustment is adopted for larger scaled VLA model and mainstream benchmarks.
Figure 4: The Illustration of action saliency aware adaptive early observation: We highlight the importance of diverse action saliency, and adopt a lightweight predictor to implement an adaptive early observation scheme.
Method
Success Rate (%) ↑
Time per Action (ms) ↓
Halting Gap (ms) ↓
Spatial
Object
Goal
Long
Average
Taction
Thalt
π0.5 ( h=5 )
98.8
98.2
98.0
92.4
96.9
74.5
232.3
π0.5 ( h=10 )
97.4
98.2
96.2
88.6
95.1
49.9 ( 1.49 × )
230.8 ( 1.01 × )
RTC (d=1) [ 4 ]
96.2
19.8
93.0
25.2
58.55
50.2 ( 1.48 × )
203.6 ( 1.14 × )
SmolVLA [ 33 ]
97.0
99.0
97.0
90.0
95.8
51.1 ( 1.45 × )
180.7 ( 1.28 × )
VLASH [ 35 ]
97.5
99.2
97.3
94.6
97.1
40.6 ( 1.83 × )
-
Table 1: Main results on the LIBERO benchmark. We present the performance and efficiency of StreamingVLA and baseline methods. The Taction and Thalt are adopted to measure the speed and fluency of execution. The “AFM” and “AEO” represent the “action flow matching” and “adaptive early observation” technique. The “NEO” stands for the “naive early observation”. The “ANAO” stands for the “action norm based adaptive observation” as mentioned in Sec. 4.2
AFM
NM
SA
Horizon
EO
Success Rate(%)
Taction (ms)
Thalt (ms)
-
-
-
10
-
95.1
49.9
230.78
✓
-
-
10
-
-
-
-
✓
✓
-
10
-
61.8
-
-
✓
✓
✓
10
-
97.1
33.7
76.1
✓
✓
✓
10
Naive (2)
86.2
29.3
23.0
✓
✓
✓
10
Random (1.4)
90.875
32.125
38.3
Table 2: Ablation studies for StreamingVLA techniques validate the effectiveness of our Action Flow Matching(AFM) formulation w/o state-based alignment modeling(SA), normalization modification(NM) mentioned in Sec. 4.1 , as well as adaptive early observation(EO) schemes. The “2” and “1.45” represents the average number of early observed actions. The "Random" represents employing early observation randomly.
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
Figure 5: Real-world Setup. The real-world evaluation platform includes a tabletop workspace, a Franka Panda robotic manipulator fixed to the table, and a RGB camera for visual observation. All objects are positioned on the table surface.
Figure 6: The runtime breakdown based on actual profiling of π0.5 and StreamingVLA. The three colored blocks correspond to the “observation”, "gen-action" and "execution" stage in the VLA workflow. The length of each block reflects the measured time.
Figure 7: Architecture of the predictor for adaptive early observation. During training, the model receives the early-frame embedding and the pending action sequence as conditions and predicts a residual embedding Δembedding that estimates the latent change toward the future frame. The model is trained using an MSE loss between the ground-truth late-frame embedding and the reconstructed representation ( embeddingearly+Δembedding ). At inference time, the L2 norm of Δembedding serves as a visual-variance indicator, which is compared with a threshold to determine whether early observation should be triggered.
Figure 8: Screenshots of our video simulation results. The images in each row are spaced 4 seconds apart. Top two rows: open the top drawer and put the bowl inside. StreamingVLA completes the task in under 16 seconds, whereas pi0.5 has not yet picked up the bowl at the 20-second mark. Bottom two rows: put both the alphabet soup and the tomato sauce in the basket. At 20 seconds, StreamingVLA has already finished the pick-and-place operations for both objects, while pi0.5 is still on its way to picking up the second item.
Vision-Language-Action (VLA) models are increasingly promising for robotic manipulation, yet their real-world deployment remains bottlenecked by high inference latency and unstable asynchronous execution. This challenge is particularly pronounced in flow-matching-based VLA models, where action decoding requires multiple iterative steps conditioned on the VLM context. While efficient inference methods improve control frequency and asynchronous methods reduce execution idle time, existing approaches often fail to jointly achieve low-latency inference and accurate, temporally consistent asynchronous execution. We introduce FlashVLA, a streaming action decoding framework that addresses both challenges in a unified formulation. FlashVLA maintains a streaming action buffer with multiple chunks at different noise levels and decodes them using chunk-wise causal attention. This design allows FlashVLA to produce one executable action chunk per inference step. Moreover, its chunk-wise autoregressive formulation implicitly preserves action continuity, enabling smooth asynchronous execution without extra future-state conditioning. Across extensive simulated and real-world experiments, FlashVLA substantially improves inference speed while maintaining strong task performance. It can achieve ≥30,Hz control frequency on a single GPU with smooth asynchronous inference in real-world deployment.
Vision-Language-Action (VLA) models, built upon Vision-Language Models (VLMs), have significantly enhanced robotic capabilities by leveraging internet-scale knowledge and multimodal reasoning. However, the intensive computational overhead of VLAs constrains on-device deployment, hindering real-time responses to environmental changes. While various acceleration techniques have been proposed, they often rely on fine-tuning or access to training datasets, which are frequently unavailable due to privacy and proprietary concerns. Moreover, although flow-matching-based VLAs have emerged as efficient alternatives to standard diffusion models, current acceleration efforts largely target VLM inference costs, failing to address the iterative ODE solving process inherent in flow matching inference. To address these limitations, we propose AdaVLA, an online, training-free adaptive framework for fast yet accurate flow-matching-based Vision-Language-Action models. We introduce a novel metric derived from the flow matching trajectory curvature to quantify action generation confidence during inference. This metric enables the dynamic reduction of inference steps and the adaptive adjustment of MLP pruning ratios through an efficiently computed importance evaluation, requiring no access to training data. Experimental results on the LIBERO benchmark using a Jetson AGX Orin device demonstrate that our method achieves 1.87× and 2.24× speedups for π0.5 and X-VLA, respectively, with negligible degradation in success rates. Furthermore, we validate the robustness of our approach on real-world robotic tasks using SmolVLA.
Sunghwan Han, Youngtae Han, Youngmin Yi
Dept. of Artificial Intelligence, Sogang University, Seoul, 04107, Republic of Korea
Test-time sampling can improve Vision-Language-Action (VLA) policies, but only if the model can efficiently select a good action from multiple candidates. Prior work often relies on separately trained external verifiers, adding extra models and inference overhead. We propose Token Probability Bucketing (TokenPB), a self-verification approach that discretizes continuous action chunks into bucket tokens and co-trains a single VLA checkpoint with a joint objective: a flow-matching loss for action generation and an auxiliary bucket loss Lbucket that teaches the VLM backbone to model observation-conditioned distributions over bucket-token sequences. At inference, TokenPB samples M candidates, scores each via teacher-forced evaluation under the learned distribution, and selects the best---enabling efficient batched scoring with observation-prefix KV-cache reuse. We provide theory connecting the training objective to a monotonic ranking property and bounds on expected selection regret that separate candidate-set effects from calibration. Across multiple backbones and benchmarks, TokenPB yields consistent success-rate improvements over single-sample inference from the same checkpoint (+2.7 in simulation, +17.1 in real-world, +16.4 under out-of-distribution shifts), and further improves over external-verifier baselines under the same sampling budget. The code is publicly available at https://github.com/RUCKBReasoning/TokenPB.
Chen Zhao, Zhuoran Wang, Haoyang Li +6
School of Information, Renmin University of China · Key Laboratory of Data Engineering and Knowledge Engineering, Beijing, China · Beijing University of Posts and Telecommunications +1