cs.LGJun 8, 2026

C^3ache: Accelerating World Action Models with Cross Inference Chunk Cache

Authors: Weisen ZhaoLam NguyenZhicong LuYuzhang Shang

Organizations: George Mason University · University of Central Florida

Abstract

World Action Models (WAMs) generalize better than standard Vision-Language-Action (VLA) policies to novel motions and environments, because a video-modeling objective lets them learn from abundant unlabeled video rather than scarce labeled robot demonstrations. This generalization is computationally expensive. To complete a task, a WAM runs over multiple inference chunks, and each chunk requires a costly denoising process. Existing acceleration methods reduce this cost by caching and reusing computation within a single chunk's denoising trajectory. Our empirical analysis reveals a substantial source of redundancy they overlook: redundancy across chunks. When a robot executes a smooth behavior, the residuals computed at a given denoising step are strongly correlated from one chunk to the next. We introduce C3^3ache, a training-free method that caches and reuses these residuals across inference chunks at the same denoising step. Experiments on benchmarks with a Fast-WAM backbone show that C3^3ache achieves up to a 2.5×2.5\times speedup in total wall-clock inference time, with negligible degradation in task success rate.

Explore similar work

Jul 7, 2026cs.RO

Training-Free Acceleration for Vision-Language-Action Models with Action Caching and Refinement

Vision-Language-Action (VLA) models have emerged as a promising approach for generalizable robotic manipulations. In particular, flow matching-based VLA models have shown remarkable success due to their capability to generate precise and smooth action sequences and capture multimodal distributions. However, the iterative denoising process in the action head acts as a major computational bottleneck, posing a critical challenge for real-time deployment. To address this challenge, we propose ActionCache, a plug-and-play external cache that opportunistically reuses past intermediate actions to warm-start generations from the vicinity of target actions, thereby drastically reducing the inference latency. Specifically, ActionCache stores the intermediate actions with compact multimodal keys, which enables retrieval from similar past contexts across different episodes or even different tasks. Experimental results in simulation and real-world environments demonstrate that ActionCache maintains high task success rates in a low-latency regime, achieving inference acceleration of up to 11.75×11.75\times and 34.43×34.43\times for representative flow-based VLA models, π0.5π_{0.5} and GR00T-N1.6, respectively.
Ryuji Oi, Hikari Otsuka, Kosuke Matsushima +4
Jun 3, 2026cs.LG

Flash-WAM: Modality-Aware Distillation for World Action Models

World-action models (WAMs) jointly generate future video and robot actions through iterative diffusion, achieving strong performance on manipulation benchmarks but requiring tens of denoising steps, a cost that precludes real-time control. Step distillation has emerged as the natural remedy, but off-the-shelf methods break down in the joint video-action setting because video and action streams use different SNR-shifted noise schedules and reach training with substantially different marginal noise distributions, an asymmetry that single-modality distillation methods cannot accommodate. We introduce \textbf{Flash-WAM}, a modality-aware step-distillation framework inspired by consistency distillation that selects the consistency function for each modality to match its noise regime: a linear-gradient-scaling parametrization for the action stream's low-noise regime, paired with a variance-preserving parametrization for the video stream's high-noise regime, grounded in a structural analysis of the consistency-function family that characterizes the achievable gradient scaling under the consistency boundary condition. Instantiated on LingBot-VA, Flash-WAM compresses inference to a single step in each modality. On RoboTwin 2.0, this reduces per-chunk latency from 8.18.1 seconds to 348348 ms on NVIDIA L40S, a 23×23{\times} speedup that enables real-time inference. Flash-WAM preserves task success on simulation benchmarks (85.5%85.5\% RoboTwin 2.0, 95.7%95.7\% LIBERO) and substantially recovers real-world performance (60%60\% average on a Unitree G1 humanoid robot), while naive consistency distillation drops to 24%24\% at the same step budget.
Arman Akbari, Ci Zhang, Arash Akbari +6
Sep 8, 2026cs.CV

ActionSplice: In-Flight Action Editing for Interactive World Models

Chunk-autoregressive video world models typically condition each generated chunk on one action. An action received during sampling must therefore wait for the next chunk, condition future solver evaluations on a state produced under the previous action, or trigger rollback that repeats completed evaluations. We introduce ActionSplice, an inference framework that formulates this problem as Counterfactual State Transport (CST). A lightweight corrector transports the interrupted backbone-native representation toward the matched state induced by the revised action at the same solver step. The world model and sampler remain frozen, and sampling resumes without replaying completed evaluations. The retargeting variant CSTR\mathrm{CST}*{R} updates the entire active chunk, while the temporal-splicing variant CSTT\mathrm{CST}*{T} preserves a temporal prefix and updates only the suffix. Across minWM-Wan Action2V and HY-WM1.5, CSTR\mathrm{CST}*{R} reduces rollback-relative LPIPS by 61.5% and 75.9% relative to direct condition swapping. CSTT\mathrm{CST}*{T} reduces suffix LPIPS by 56.1% and 77.5%, respectively, while providing 2.73×2.73\times and 1.69×1.69\times pixel-ready speedups over waiting. Under the HY-WorldPlay protocol, CSTR\mathrm{CST}_{R} obtains a PSNR of 25.66 dB, an SSIM of 0.6902, and an LPIPS of 0.1337 against the original rollout.
Pardis Taghavi, Tingyu Guo, Jonas Lossner +2