Efficient Hybrid SE(3)-Equivariant Visuomotor Flow Policy via Spherical Harmonics for Robot Manipulation
Organizations: University of Electronic Science and Technology of China · Dexmal
Abstract
While existing equivariant methods enhance data efficiency, they suffer from high computational intensity, reliance on single-modality inputs, and instability when combined with fast-sampling methods. In this work, we propose E3Flow, a novel framework that addresses the critical limitations of equivariant diffusion policies. E3Flow overcomes these challenges, successfully unifying efficient rectified flow with stable, multi-modal equivariant learning for the first time. Our framework is built upon spherical harmonic representations to ensure rigorous SO(3) equivariance. We introduce a novel invariant Feature Enhancement Module (FEM) that dynamically fuses hybrid visual modalities (point clouds and images), injecting rich visual cues into the spherical harmonic features. We evaluate E3Flow on 8 manipulation tasks from the MimicGen and further conduct 4 real-world experiments to validate its effectiveness in physical environments. Simulation results show that E3Flow achieves a 3.12% improvement in average success rate over the state-of-the-art Spherical Diffusion Policy (SDP) while simultaneously delivering a 7x inference speedup. E3Flow thus demonstrates a new and highly effective trade-off between performance, efficiency, and data efficiency for robotic policy learning. Code: https://github.com/zql-kk/E3Flow.
Figures & tables
| Task | EquiBot | DP3 | DP | EquiDiff (img) | EquiDiff (voxel) | SDP (DDiM) | SDP (DDPM) | E3Flow (ours) |
| Coffee_D2 | 2.06 | 0.103 | 0.95 | 2.44 | 1.10 | 0.49 | 3.79 | 0.51 |
| Coffee_Preparation_D1 | 2.13 | 0.112 | 0.89 | 2.07 | 1.11 | 0.44 | 3.46 | 0.51 |
| Hammer_Cleanup_D1 | 1.92 | 0.105 | 0.94 | 2.36 | 1.11 | 0.48 | 3.67 | 0.51 |
| Mug_Cleanup_D1 | 1.91 | 0.113 | 1.01 | 3.68 | 1.10 | 0.46 | 3.98 | 0.52 |
| Nut_Assembly_D0 | 1.80 | 0.102 | 0.94 | 2.34 | 1.09 | 0.45 | 3.71 | 0.49 |
| Square_D2 | 2.07 | 0.112 | 0.95 | 2.39 | 1.11 | 0.46 | 3.85 | 0.54 |
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Method | Storing Toys | Bottle Place | Stack Blocks | Assembly | Average SR (%) |
| E3Flow (ours) | 70 | 80 | 95 | 60 | 76 |
| SDP [ 46 ] | 60 | 65 | 85 | 40 | 62 |
| EquiDiff [ 31 ] | 5 | 25 | 45 | 45 | 30 |
| DP [ 2 ] | 0 | 10 | 35 | 20 | 16 |
| E3Flow | SDP(DDPM) | SDP(DDIM) | EquiDiff | EquiBot | DP | DP3 | |
| Batch Size | 64 | 64 | 64 | 128 | 128 | 128 | 128 |
| Image Size | 84 | - | - | - | 84 | - | - |
| Point Clouds | 1024 | 1024 | 1024 | 1024 | 1024 | 1024 | 1024 |
| Prediction Horizon | 16 | 16 | 16 | 16 | 16 | 16 | 16 |
| Action Horizon | 8 | 8 | 8 | 8 | 8 | 8 | 8 |
| Learning Rate | 1e-4 | 1e-4 | 1e-4 | 1e-4 | 1e-4 | 1e-4 | 1e-4 |
| Module | Details |
| Image Encoder | ResNet-18 |
| Point Cloud Encoder | 5-layer ResNet + EquiformerV2 |
| Point Cloud Features | 128-dim |
| FEM Output | 128-dim |
| Equi-Flow U-Net | SDTU w/ spherical Fourier conv |
| Equivariant Layers | Equivariant Linear + FiLM |
Visuomotor Policy Learning
Visuomotor policy learning trains robots to turn camera observations, often with language and proprioception, into actions for manipulation and navigation.
See all 284 papers