Gaussian Distillation of Flow Policies
Organizations: University of Geneva Geneva, Switzerland · University of Tübingen Tübingen, Germany · University of Technology Nuremberg Nuremberg, Germany · University of Geneva and Meta FAIR Geneva, Switzerland
Abstract
Flow policies are among the strongest robot controllers and are well suited to modelling multimodal action distributions. Our analysis shows that the continuous-action distributions of the studied flow policies are well approximated by Gaussians. We propose the Gaussian Action Readout (GAR), which replaces a flow policy's final layer with a Gaussian readout trained on just 0.02% of eligible states, while keeping the rest of the network frozen. It samples with one action-network pass, gives closed-form likelihoods, and achieves near-teacher task success at up to twice the inference speed.
Figures & tables
| Teacher | Fitting contexts | Mean error (%) | SD error (%) | |
|---|---|---|---|---|
| Diagonal | Full | |||
| Xiaomi | 6,000 | 4.63 [ 3.09 , 7.73 ] | 5.58 [ 3.61 , 9.03 ] | 2.91 [ 1.72 , 5.95 ] |
| Xiaomi | 24,000 | 4.54 [ 3.00 , 7.37 ] | 4.35 [ 2.69 , 7.37 ] | 2.92 [ 1.56 , 5.57 ] |
| GR00T | 6,000 | 8.43 [ 5.98 , 12.91 ] | 9.76 [ 6.51 , 16.42 ] | 8.09 [ 5.36 , 13.42 ] |
| GR00T | 24,000 | 8.29 [ 5.86 , 12.55 ] | 8.47 [ 5.74 , 14.65 ] | 7.61 [ 5.08 , 12.21 ] |
| Teacher | Fitting contexts | Task group | Teacher | Raw one-step | Mean only | Diagonal | Full |
|---|---|---|---|---|---|---|---|
| Xiaomi | 6,000 | Overall | 58.24 | 55.76 | 56.64 | 57.64 | 57.28 |
| Atomic seen | 81.11 | 81.22 | 78.44 | 80.56 | 81.67 | ||
| Composite seen | 58.75 | 52.63 | 58.13 | 58.00 | 57.38 | ||
| Composite unseen | 32.00 | 30.25 | 30.63 | 31.50 | 29.75 | ||
| 24,000 | Overall | 58.24 | 55.76 | 56.44 | 57.72 | 56.44 | |
| Atomic seen | 81.11 | 81.22 | 80.11 | 81.00 | 81.11 |
| GR00T | Xiaomi | |||
| Continuous-motion policy | Success | Difference | Success | Difference |
| Benchmark references from Table 2 : 50 episodes per task | ||||
| Raw one-step | 8.13 | — | 52.63 | — |
| Mean-only GAR, 6,000 contexts | 7.75 | — | 58.13 | — |
| Distribution shape: Gaussian versus teacher sampling | ||||
| Full Gaussian, teacher moments | 11.72 | — | 59.38 | — |
Appendix figures & tables23 assets
Supplementary material from the paper’s appendix.
Appendix
| Teacher | Features | Cosine | (%) | Norm change (%) | Centered cosine | |
|---|---|---|---|---|---|---|
| GR00T | 0.01 | 0.99993 | 1.68 | +1.16 | 0.99958 | |
| 0.01 | 0.99997 | 1.29 | +1.06 | 0.99961 | ||
| 0.10 | 0.99937 | 11.39 | +10.76 | 0.99684 | ||
| 0.10 | 0.99981 | 11.12 | +10.94 | 0.99635 | ||
| Xiaomi | 0.01 | 0.99998 | 1.03 | +0.76 | 0.99979 | |
| 0.01 | 0.99999 | 1.01 | +0.89 | 0.99982 |
| Preparation step | Resources | Time |
|---|---|---|
| Download, extraction and data checks | CPU/network | 2.71 h wall time |
| Feature extraction and teacher sampling | 4 RTX 4090 GPUs | 3.84 GPU-hours total 1.14 h longest parallel job |
| Motion and command target estimation | 12 CPU workers | 6.9 s wall time |
| Full covariance | Diagonal covariance | ||||
|---|---|---|---|---|---|
| Teacher | Action group | Error (%) | Control (%) | Error (%) | Control (%) |
| Xiaomi | Translation | 0.8 | 0.7 | 1.8 | 0.7 |
| Rotation | 1.8 | 1.6 | 3.0 | 1.5 | |
| GR00T | Translation | 4.6 | 3.3 | 9.1 | 3.4 |
| Rotation | 9.5 | 6.3 | 19.9 | 6.4 | |
| Physical error | Relative error, 90th percentile | ||||
|---|---|---|---|---|---|
| Teacher | Covariance | Translation | Rotation | Translation | Rotation |
| Xiaomi | Full | 0.0590 | 0.0071 | 7.6 | 8.8 |
| Diagonal | 0.1207 | 0.0119 | 7.7 | 8.8 | |
| GR00T | Full | 0.4054 | 0.0726 | 14.9 | 19.3 |
| Diagonal | 0.9867 | 0.1316 | 29.2 | 35.4 | |
| Teacher | Fitting contexts | Mean error (%) | SD error (%) | |
|---|---|---|---|---|
| Diagonal | Full | |||
| Xiaomi | 6,000 | 13.63 | 16.19 | 10.65 |
| Xiaomi | 24,000 | 13.40 | 13.90 | 10.34 |
| GR00T | 6,000 | 20.08 | 29.07 | 25.26 |
| GR00T | 24,000 | 19.44 | 25.86 | 24.65 |
| Teacher | Fitting contexts | Estimate | Tail ratio | Tail error (%) |
|---|---|---|---|---|
| Xiaomi | — | Independent teacher | 0.976 | 10.9 |
| Xiaomi | 6,000 | Diagonal | 0.577 | 53.0 |
| Xiaomi | 6,000 | Full | 0.503 | 56.5 |
| Xiaomi | 24,000 | Diagonal | 0.669 | 45.5 |
| Xiaomi | 24,000 | Full | 0.545 | 52.4 |
| GR00T | — | Independent teacher | 1.001 | 7.4 |
| Objective | Seed | SD error (%) | Tail ratio |
|---|---|---|---|
| Original | 17 | 5.58 [3.61, 9.03] | 0.577 |
| 29 | 5.29 [3.30, 8.67] | 0.581 | |
| Variance Huber | 17 | 3.16 [1.78, 5.64] | 0.410 |
| 29 | 3.24 [1.76, 5.71] | 0.411 | |
| Log MSE | 17 | 2.81 [1.49, 5.55] | 0.244 |
| 29 | 2.85 [1.48, 5.42] | 0.248 |
| Model | Covariance contexts | Teacher (ms) | GAR (ms) | Speedup |
| Threadripper PRO 5955WX: three sessions | ||||
| Xiaomi | 6,000 | 220.25 | 115.36 | [1.909, 1.915] |
| GR00T | 6,000 | 68.01 | 43.30 | [1.566, 1.571] |
| EPYC 9554: earlier three sessions | ||||
| Xiaomi | 24,000 | 202.08 | 111.84 | [1.797, 1.807] |
| GR00T | 6,000 | 60.87 | 42.98 | [1.407, 1.421] |
| Component | Teacher (ms) | GAR (ms) |
|---|---|---|
| Vision-language processing | 65.4 | 66.8 |
| Action transformer | 135.4 | 28.3 |
| GAR readout | — | 0.5 |
| Total call latency | 225.9 | 120.7 |
| Teacher | Fitting contexts | Readout | Successes | Difference | 95% interval |
|---|---|---|---|---|---|
| Xiaomi | 6,000 | Mean only | 1,416 | ||
| Diagonal | 1,441 | ||||
| Full | 1,432 | ||||
| 24,000 | Mean only | 1,411 | |||
| Diagonal | 1,443 | ||||
| Full | 1,411 |
| Teacher | Fitting contexts | Difference | 95% interval |
|---|---|---|---|
| Xiaomi | 6,000 | ||
| 24,000 | |||
| GR00T | 6,000 | ||
| 24,000 |
| Teacher | GAR | Fixed | Difference | 95% interval |
|---|---|---|---|---|
| Xiaomi | 57.64 | 55.92 | ||
| GR00T | 21.92 | 20.76 |
| Teacher | Action group (unit) | GAR | Fixed | Reduction [95% interval] |
|---|---|---|---|---|
| Xiaomi | Translation (mm) | 0.566 | 0.987 | |
| Rotation (degrees) | 0.145 | 0.196 | ||
| GR00T | Translation (mm) | 1.560 | 2.647 | |
| Rotation (degrees) | 0.336 | 0.636 |
| Continuous-motion policy | GR00T | Xiaomi |
|---|---|---|
| GAR: predicted diagonal moments | 94 / 800 | 464 / 800 |
| Gaussian: teacher-estimated diagonal moments | 67 / 512 | 300 / 512 |
| Gaussian: teacher-estimated full moments | 60 / 512 | 304 / 512 |
| Teacher sampling, GAR commands | 61 / 512 | 296 / 512 |
| Teacher-estimated mean, no motion noise | 58 / 512 | 283 / 512 |
| Teacher-estimated mean, GAR variances | 75 / 512 | 308 / 512 |
| Task | Teacher | Raw one-step | GAR |
| Soup and tomato sauce into basket | 49 | 47 | 48 |
| Cream cheese and butter into basket | 48 | 47 | 47 |
| Turn on stove and place moka pot | 50 | 50 | 50 |
| Bowl into drawer and close it | 48 | 46 | 48 |
| Two mugs onto plates | 50 | 50 | 50 |
| Book into caddy | 50 | 50 | 50 |
| Scene | Teacher counts | Diagonal counts |
|---|---|---|
| Dishwasher 1 | cup: 19; bowl: 13 | cup: 15; bowl: 17 |
| Dishwasher 2 | dish A: 32 | dish A: 32 |
| Lunches 1 | vegetable A: 2; vegetable B: 30 | vegetable A: 1; vegetable B: 31 |
| Lunches 2 | chicken A: 2; garlic A: 30 | garlic A: 32 |
| Leftovers 1 | chicken drumstick: 4; vegetable: 28 | vegetable: 32 |
| Leftovers 2 | vegetable: 32 | vegetable: 32 |
Robot Policy Learning
Robot policy learning develops controllers that map sensory observations, task goals, and interaction history to actions for embodied robots.
See all 377 papers