Efficient VLA Model Inference
VLA: Vision-Language-Action
Overview
This topic studies how to run vision-language-action models fast enough for responsive, reliable robot control, including on edge devices. Common approaches prune or cache visual tokens, quantize or distill models, reduce action-generation steps, and overlap inference with observation and execution. Methods are tested on manipulation benchmarks such as LIBERO and RoboTwin, as well as real robots, using measures like latency, control frequency, memory, energy, and task success. The main tension is that faster inference can undermine closed-loop reliability or motion quality, so gains must be assessed in full task execution rather than by model speed alone.
Latest papers
190 papers56 papers in the last four weeks, up 115% on the four weeks before. 0.3% of all new papers.