Accelerating VLA Inference with Perturbation Informed Execution
Organizations: Seoul National University
Abstract
Action-chunking vision-language-action (VLA) models predict sequences of future robot actions. Under fixed-horizon execution, the robot executes a fixedlength prefix of each predicted chunk before invoking the policy again, leaving the remaining predictions unused. For a given number of executed actions, short execution horizons require more policy calls. Extending the execution horizon amortizes policy inference cost over more actions. However, uniformly applying long horizons across episodes can limit opportunities for precise corrections. To address this limitation, we propose PICES (Perturbation-Informed Chunk and Execution Horizon Selection), a training-free method that jointly selects an action chunk and the number of actions executed before the next policy call. Within a single policy call, the action expert generates a batch of action chunks from multiple initial noise samples and their locally perturbed counterparts, using the same conditioning features across all samples. PICES exploits differences between corresponding actions in each nominal chunk and its counterpart to determine candidate-specific execution horizons and select a nominal chunk for execution. Experiments on simulation benchmarks and real-world manipulation tasks demonstrate that PICES achieves speedup by up to 2.3x in wall-clock policy inference time on Jetson Orin and Thor relative to fixed horizon baselines while improving the success rate.
Figures & tables
| Method | Success rate (%) | Policy calls | Jetson Orin | Jetson Thor | ||||||||
| Pick Coke can | Pick object | Move near | Open drawer | Close drawer | Place in closed drawer | Average | Single call (ms) | Speedup | Single call (ms) | Speedup | ||
| Fixed ( ) | 99 | 83 | 97 | 54 | 65 | 13 | 68.5 | 46.8 | 209.9 | 1.0 | 101.1 | 1.0 |
| Fixed ( ) | 99 | 80 | 92 | 57 | 67 | 15 | 68.3 | 26.6 | 1.8 | 1.8 | ||
| Fixed ( ) | 82 | 64 | 72 | 52 | 77 | 18 | 60.8 | 19.4 | 2.4 | 2.4 | ||
| Fixed ( ) | 66 | 48 | 55 | 47 | 77 | 14 | 51.2 | 14.3 | 3.3 | 3.3 | ||
| Fixed ( ) | 65 | 42 | 44 | 35 | 78 | 8 | 45.3 | 8.6 | 5.4 | 5.4 | ||
| GR00T N1.5 | ||||||||||||
| Method | Avg. SR (%) | Avg. Policy Calls | Jetson Orin | Jetson Thor | Avg. SR (%) | Avg. Policy Calls | Jetson Orin | Jetson Thor | ||||
| Single call | Speedup | Single call | Speedup | Single call | Speedup | Single call | Speedup | |||||
| (ms) | (ms) | (ms) | (ms) | |||||||||
| Fixed ( ) | 96.5 | 30.2 | 297.2 | 1.0 | 126.7 | 1.0 | 92.9 | 30.1 | 149.3 | 1.0 | 62.8 | 1.0 |
| AAC | 96.4 | 20.6 | 359.2 | 1.2 | 152.4 | 1.2 | 93.3 | 24.2 | 282.5 | 0.7 | 107.2 | 0.7 |
| AAC ∗ | 96.0 | 21.4 | 316.0 | 1.3 | 137.4 | 1.3 | 92.8 | 25.8 | 185.9 | 0.9 | 77.7 | 0.9 |
| Method | Success rate (%) | Policy calls | Jetson Orin | Jetson Thor | ||||||||
| Tape | Stapler | Cube | Average | Tape | Stapler | Cube | Average | Single call (ms) | Speedup | Single call (ms) | Speedup | |
| Fixed ( ) | 97.2 | 77.8 | 58.3 | 77.8 | 614.8 | 236.8 | 485.9 | 445.8 | 298.5 | 0.39 | 126.7 | 0.39 |
| Fixed ( ) | 86.1 | 94.4 | 91.7 | 90.7 | 222.9 | 104.8 | 196.9 | 174.9 | 1.00 | 1.00 | ||
| Fixed ( ) | 88.9 | 80.6 | 88.9 | 86.1 | 120.8 | 74.4 | 111.1 | 102.1 | 1.71 | 1.71 | ||
| Fixed ( ) | 77.8 | 66.7 | 86.1 | 76.9 | 95.8 | 68.6 | 74.8 | 76.4 | 2.29 | 2.29 | ||
| PICES | 88.9 | 94.4 | 97.2 | 93.5 | 148.9 | 72.6 | 134.5 | 118.7 | 314.7 | 1.39 | 137.3 | 1.36 |
| Method | Avg. SR (%) | Avg. Policy Calls | Jetson Orin | Jetson Thor | ||
| Single call | Speedup | Single call | Speedup | |||
| (ms) | (ms) | |||||
| Fixed ( ) | 68.5 | 46.7 | 209.8 | 1.0 | 101.1 | 1.0 |
| PICES , | 67.3 | 23.4 | 214.3 | 2.0 | 106.9 | 1.9 |
| PICES , | 68.6 | 18.5 | 242.6 | 2.2 | 113.4 | 2.3 |
| PICES , | 68.5 | 17.4 | 303.6 | 1.9 | 129.8 | 2.1 |
| Acceleration Method | Success rate (%) | Policy calls | Jetson Orin | Jetson Thor | ||||||||||
| Spatial | Goal | Object | Long | Avg. | Spatial | Goal | Object | Long | Avg. | Single call (ms) | Speedup | Single call (ms) | Speedup | |
| Baseline, Fixed | 99.0 | 97.4 | 97.2 | 92.2 | 96.5 | 20.6 | 21.8 | 27.7 | 50.6 | 30.2 | 297.2 | 1.0 | 126.7 | 1.0 |
| PICES | 99.0 | 98.4 | 99.6 | 92.2 | 97.3 | 13.9 | 14.4 | 18.0 | 33.4 | 19.9 | 311.4 | 1.5 | 131.6 | 1.5 |
| FastV (40%) | 99.0 | 97.4 | 98.0 | 89.6 | 96.0 | 20.6 | 27.7 | 22.3 | 50.1 | 30.2 | 237.5 | 1.3 | 106.3 | 1.2 |
| FastV (40%) + PICES | 98.4 | 99.2 | 97.0 | 92.2 | 96.7 | 14.0 | 18.0 | 14.7 | 33.5 | 20.1 | 247.6 | 1.8 | 111.8 | 1.7 |
| FastV (50%) | 97.6 | 98.8 | 95.2 | 90.6 | 95.6 | 21.2 | 27.6 | 22.3 | 51.2 | 30.6 | 217.1 | 1.4 | 97.3 | 1.3 |
Appendix figures & tables8 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | Jetson Orin | Jetson Thor | ||||||||
| 310.4 | 361.6 | 464.1 | 581.1 | 676.6 | 127.2 | 149.8 | 179.3 | 215.3 | 267.0 | |
| GR00T N1.5 | 149.3 | 162.1 | 192.2 | 230.8 | 273.4 | 62.8 | 67.2 | 73.7 | 82.7 | 90.8 |
| GR00T N1.7 | 209.9 | 235.4 | 301.6 | 361.6 | 401.1 | 101.1 | 111.5 | 124.5 | 148.3 | 166.2 |
| Model | Jetson Orin | Jetson Thor | ||||||||
| 9.03 | 10.25 | 15.37 | 18.05 | 18.31 | 4.90 | 4.53 | 5.21 | 5.87 | 6.99 | |
| GR00T N1.5 | 1.08 | 2.56 | 4.29 | 5.43 | 6.20 | 0.96 | 0.87 | 1.08 | 1.32 | 1.40 |
| GR00T N1.7 | 2.91 | 5.10 | 9.17 | 10.11 | 9.56 | 2.74 | 2.08 | 2.34 | 3.14 | 3.25 |
| Setting | Jetson AGX Orin | Jetson AGX Thor |
| Jetson Linux | R36.5.0 | R38.4.0 |
| CUDA | 12.6 | 13.0 |
| PyTorch | 2.8.0 | 2.13.0+cu130 |
| TensorRT | 10.3.0.30 | 10.13.3.9 |
| Power mode | MAXN | MAXN |
| Clock settings | Fixed GPU: 1300.5 MHz Fixed EMC: 3199 MHz | Fixed GPU: 1575 MHz Fixed EMC: 4266 MHz |
| Hyperparameter / Setting | Value |
| Base checkpoint | -base (OpenPI) |
| # Training GPUs | 4 NVIDIA RTX PRO 6000 Blackwell |
| Total batch size | 128 (32 per GPU) |
| # Train steps | 5,000 steps ( 17.7 epochs) |
| Fine-tuning mode | Full fine-tuning (all parameters) |
| Action chunk horizon | 16 steps |
| Method | Success rate (%) | Policy calls | Jetson Orin | Jetson Thor | ||||||||||
| Spatial | Goal | Object | Long | Average | Spatial | Goal | Object | Long | Average | Single call (ms) | Speedup | Single call (ms) | Speedup | |
| Fixed ( ) | 99.0 | 92.8 | 91.4 | 84.4 | 91.9 | 102.8 | 110.6 | 145.7 | 272.9 | 158.0 | 297.2 | 0.2 | 126.7 | 0.2 |
| Fixed ( ) | 99.0 | 95.4 | 94.8 | 86.6 | 94.0 | 51.2 | 55.3 | 71.7 | 132.1 | 77.6 | 0.4 | 0.4 | ||
| Fixed ( ) | 98.0 | 97.6 | 98.2 | 92.0 | 96.5 | 20.6 | 21.8 | 27.7 | 50.6 | 30.2 | 1.0 | 1.0 | ||
| Fixed ( ) | 99.4 | 98.6 | 98.2 | 93.4 | 97.4 | 13.1 | 13.7 | 17.2 | 31.5 | 18.9 | 1.6 | 1.6 | ||