cs.RONov 8, 2026

Control-Aware Command Generation for Asynchronous Control and Action Inference with Vision-Based Policies towards Fast Execution

Authors: Takayuki Osa, Kazuki Ota

Organizations: Center for Advanced Intelligence Project RIKEN · Graduate School of Engineering The University of Tokyo

Abstract

Vision-based control policies, including vision-language-action models, have enabled robots to perform increasingly complex tasks. However, their execution speed is often limited by the high computational cost of action inference. In this work, we investigate what can be achieved at the control level without modifying the underlying policy learning process. We introduce an asynchronous inference and control framework that enables fast task execution while maintaining smooth and stable robot motions. By formulating the generation of continuous target positions from discontinuous model predictions as a tracking control problem, our method makes asynchronous inference practical for real robots. We further accelerate execution through adaptive action skipping based on the variance of predicted positions. Experiments with Action Chunking Transformer and OpenVLA-OFT on a bimanual robot demonstrate substantial speedups while preserving high task success rates.

Figures & tables

Explore similar work

CardsList
  1. Action ControlNet: A Lightweight Delay-Aware Adapter for Smooth Asynchronous Control in Vision-Language-Action Models

    Jun 24, 2026Tiecheng Guo, Meng GuoRobotic ControlLanguage-Conditioned Robot Manipulation

  2. FutureRTC: Real-Time Robot Execution with Anticipatory-Conditioned Action Chunking

    Jul 27, 2026Hai Jiang, Yixian Zou, Binbin Liang +3Vision-Language-Action ModelsAction Chunking