CHASE-VLA: Post-Training Quantization Framework for Vision-Language-Action Models with Chunk-Aware Scale Estimation
Organizations: KAIST, Daejeon, South Korea · POSTECH, Pohang, South Korea
Abstract
Vision-Language-Action (VLA) models map visual observations and language instructions to continuous robot actions, but a diffusion-based action expert (AE) poses a key challenge for low-bit post-training quantization (PTQ). The AE is repeatedly invoked across denoising steps and policy queries, where fixed calibration scales can be mismatched with activation ranges that vary with denoising progress and intended motion. We propose CHASE-VLA, a chunk-aware PTQ method that exploits a VLA-specific signal readily available from the policy: the generated action chunk, including its unexecuted future suffix. Rather than relying only on static scale matching for AE layers, CHASE-VLA combines the previously generated chunk as causal action context with denoising step group information to adapt AE activation scales. This enables W4A4 quantization of both MLP and attention projections in the repeated AE without modifying the pretrained policy. On LIBERO, CHASE-VLA achieves 97.3% average success rate on when both MLP and attention projections in the AE are quantized to W4A4, restoring FP16-level performance. CHASE-VLA also reduces the weight storage of the quantized AE linear layers by 73.4% and their single-chunk memory traffic by 70.9% and 71.2% on and GR00T N1.6, respectively, with a predictor overhead of at most 1.26% of the saved storage.
Figures & tables
| PTQ Category | Scale-Selection Signal | Quantization Scope |
|---|---|---|
| LLM/VLM PTQ | Weight/activation statistics | Transformer encoder/decoder |
| Diffusion PTQ | Denoising step signal | Diffusion denoising blocks |
| VLA PTQ | Static module calibration | AE MLP only |
| CHASE-VLA | Previous action chunk | AE MLP |
| (Proposed) | + denoising step group | + attention projections |
| Method | Precision | AE quant. target | Spa. | Obj. | Goal | Long | Avg. | |
|---|---|---|---|---|---|---|---|---|
| MLP | Attn. proj. | |||||||
| FP16 | FP16 | – | – | 98.5 | 99.0 | 97.5 | 93.5 | 97.1 |
| QuantVLA | W4A8 | ✓ | – | 98.5 | 98.0 | 98.0 | 96.0 | 97.6 |
| QuantVLA (expanded) | W4A4 | ✓ | ✓ | 98.5 | 98.5 | 93.5 | 90.5 | 95.3 |
| Q-DiT | W4A4 | ✓ | ✓ | 97.0 | 97.5 | 95.0 | 88.0 | 94.4 |
| PTQ4DiT | W4A4 | ✓ | ✓ | 97.5 | 94.5 | 94.0 | 88.0 | 93.5 |
| Model | Method | Precision | Spa. | Obj. | Goal | Long | Avg. |
|---|---|---|---|---|---|---|---|
| CogACT | FP16 | FP16 | 87.5 | 98.0 | 95.5 | 91.5 | 93.1 |
| QuantVLA (expanded) | W4A4 | 89.5 | 57.5 | 73.5 | 81.0 | 75.4 | |
| Q-DiT | W4A4 | 81.0 | 73.5 | 83.5 | 73.5 | 77.9 | |
| PTQ4DiT | W4A4 | 87.5 | 77.5 | 80.5 | 73.0 | 79.6 | |
| CHASE-VLA | W4A4 | 86.5 | 97.0 | 88.0 | 90.5 | 90.5 | |
| GR00T N1.6 | FP16 | FP16 | 99.0 | 99.5 | 97.5 | 96.0 | 98.0 |
| Factor | Tested settings | Mean success (%) |
|---|---|---|
| Denoising groups ( ) | 1 / 3 / 5 / 10 | 95.5 / 97.3 / 97.1 / 97.4 |
| Uncertainty margin ( ) | 0 / 1 / 3 / 5 | 96.3 / 96.9 / 97.3 / 94.8 |
| Action context | Prefix / Suffix / Full chunk | 95.9 / 96.3 / 97.3 |
| Predictor sharing | Shared / Per-layer | 96.4 / 97.3 |
| Calibration trajectories | 2 / 4 / 6 | 96.1 / 96.8 / 97.3 |
| Model | FP16 | W4A8 | CHASE-VLA (W4A4) | ||
|---|---|---|---|---|---|
| Latency (ms) | Latency (ms) | Speedup | Latency (ms) | Speedup | |
| 26.957 | 25.585 | 21.069 | |||
| GR00T N1.6 | 43.003 | 41.889 | 37.563 | ||
| Model | AE blocks | Denoising steps | Chunk | Target layers | Breakdown | |
|---|---|---|---|---|---|---|
| MLP | Attn. proj. | |||||
| 18 | 10 | 126 | 54 | 72 | ||
| CogACT | 12 | 10 | 48 | 24 | 24 | |
| GR00T N1.6 | 32 | 4 | 192 | 64 | 128 | |
| Model | Predictors | ||||
|---|---|---|---|---|---|
| 126 | 350 | 64 | 3 | 6 | |
| CogACT | 48 | 112 | 256 | 3 | 6 |
| GR00T N1.6 | 192 | 112 | 256 | 2 | 4 |
| Method | CogACT | GR00T N1.6 | |
|---|---|---|---|
| FP16 | [95.7, 98.1] | [91.2, 94.7] | [96.8, 98.8] |
| QuantVLA (expanded) | [93.6, 96.5] | [72.3, 78.2] | [45.9, 52.8] |
| Q-DiT | [92.6, 95.8] | [74.9, 80.6] | [20.1, 25.9] |
| PTQ4DiT | [91.6, 95.0] | [76.7, 82.3] | [17.4, 22.9] |
| CHASE-VLA | [95.9, 98.2] | [88.3, 92.3] | [89.4, 93.2] |
| Scale adjustment | Spatial | Object | Goal | Long | Avg. |
|---|---|---|---|---|---|
| Prev-query AbsMax | 97.0 | 98.0 | 96.5 | 92.0 | 95.9 |
| AbsMax EMA | 97.5 | 98.5 | 95.5 | 92.5 | 96.0 |
| Motion lookup | 97.0 | 98.5 | 97.5 | 92.5 | 96.4 |
| CHASE-VLA | 97.0 | 99.5 | 98.0 | 94.5 | 97.3 |
| Evaluation setup | FP16 | QuantVLA | CHASE-VLA |
|---|---|---|---|
| Google Robot (VA) | 46.54 | 29.47 | 46.99 |
| Google Robot (VM) | 56.00 | 43.67 | 53.33 |
| WidowX (VM) | 64.86 | 59.71 | 63.14 |