GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splatting
Organizations: Key Laboratory of AI Safety of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS, Beijing, 100190, China · University of Chinese Academy of Sciences, Beijing, 100049, China
Abstract
High-fidelity interactive digital assets are essential for embodied intelligence and robotic interaction, yet articulated objects remain challenging to reconstruct due to their complex structures and coupled geometry-motion relationships. Existing methods suffer from instability in geometry-motion joint optimization, while their generalization remains limited on complex multi-joint or out-of-distribution objects. To address these challenges, we propose GEAR, an EM-style alternating optimization framework that jointly models geometry and motion as interdependent components within a Gaussian Splatting representation. GEAR treats part segmentation as a latent variable and joint motion parameters as explicit variables, alternately refining them for improved convergence and geometric-motion consistency. To enhance part segmentation quality without sacrificing generalization, we leverage a vanilla 2D segmentation model to provide multi-view part priors, and employ a weakly supervised constraint to regularize the latent variable. Experiments on multiple benchmarks and our newly constructed dataset GEAR-Multi demonstrate that GEAR achieves state-of-the-art results in geometric reconstruction and motion parameters estimation, particularly on complex articulated objects with multiple movable parts.
Figures & tables
| Method | Simulated (Average) | Real (Average) | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Axis Ang | Axis Pos | Geo Dist | CD-s | CD-m | CD-w | Axis Ang | Axis Pos | Geo Dist | CD-s | CD-m | CD-w | |
| Ditto | 46.22 | 2.11 | 39.87 | 18.94 | 42.20 | 7.12 | 3.80 | 1.84 | 4.41 | 31.55 | 35.48 | 10.29 |
| PARIS | 6.23 | 1.04 | 41.71 | 7.18 | 39.76 | 5.47 | 22.39 | 0.34 | 1.36 | 48.56 | 455.24 | 43.17 |
| DTA | 0.13 | 0.02 | 0.13 | 2.45 | 1.66 | 1.79 | 7.86 | 0.59 | 1.00 | 6.67 | 15.95 | 5.53 |
| ArtGS | 0.02 | 0.00 | 0.02 | 2.63 | 0.67 | 2.15 | 2.78 | 0.47 | 0.99 | 2.29 | 3.47 | 2.26 |
| Ours | 0.02 | 0.00 | 0.02 | 1.99 | 0.70 | 1.87 | 3.50 | 0.38 | 1.18 | 2.60 | 8.35 | 2.99 |
| Object | Method | Axis Ang | Axis Pos | Geo Dist | CD-s | CD-m | CD-w |
|---|---|---|---|---|---|---|---|
| Table (4) | DTA | 24.35 | - | 0.12 | 0.59 | 104.38 | 0.55 |
| ArtGS | 1.16 | - | 0.00 | 0.74 | 3.53 | 0.74 | |
| Ours | 0.08 | - | 0.00 | 0.47 | 0.23 | 0.51 | |
| Table (5) | DTA | 20.62 | 4.2 | 30.8 | 1.39 | 230.38 | 1.00 |
| ArtGS | 0.04 | 0.00 | 0.01 | 1.22 | 3.09 | 1.16 | |
| Ours | 0.04 | 0.00 | 0.02 | 0.77 | 0.26 | 0.98 |
| Storage_47648 | Storage_45271 | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Method | Axis Ang | Axis Pos | Geo Dist | CD-s | CD-m | CD-w | Axis Ang | Axis Pos | Geo Dist | CD-s | CD-m | CD-w |
| Full | 0.07 | 0.01 | 0.10 | 0.61 | 0.32 | 0.60 | 0.03 | 0.00 | 0.03 | 0.50 | 0.10 | 3.92 |
| 2DGS 3DGS | 0.07 | 0.00 | 0.03 | 0.66 | 0.70 | 0.77 | 1.02 | 0.40 | 2.94 | 0.46 | 0.21 | 0.98 |
| w/o self_loss | 22.67 | 0.94 | 30.38 | 1.48 | F | 2.42 | 35.83 | 475.96 | 24.91 | 11.78 | F | 6.16 |
| w/o knn_loss | 0.05 | 0.00 | 0.09 | 0.52 | 20.93 | 0.59 | 0.02 | 0.00 | 0.02 | 0.49 | 32.38 | 0.90 |
| staged optimization | 15.28 | 0.66 | 13.36 | 2.07 | F | 1.43 | 29.61 | 1.29 | 7.04 | 11.72 | 24.34 | 1.05 |
Appendix figures & tables15 assets
Supplementary material from the paper’s appendix.
Appendix
| Category | Parameter | Value |
|---|---|---|
| Initialization | Voxel Size | 0.1 / 0.01 ∗ |
| Morphological Dilation Radius | 1 | |
| Training Loop | Total Iterations | 30,000 |
| E-step Interval | 500 | |
| M-step Interval | 500 | |
| KNN Gaussian Neighbors | 3 |
| Object | Parts | Initialization | training | Total Time |
|---|---|---|---|---|
| Box | 5 | 13 | 35 | 48 |
| Bucket | 3 | 13 | 27 | 40 |
| Clock | 3 | 9 | 16 | 25 |
| Door | 3 | 12 | 17 | 29 |
| EyeGlasses | 3 | 10 | 24 | 34 |
| Faucet | 3 | 9 | 20 | 29 |
| Method | Time (min) | Axis Ang | Axis Pos | Geo Dist | CD-s | CD-m | CD-w |
|---|---|---|---|---|---|---|---|
| ArtGS [ 31 ] | 14.0 | 8.82 | 141.45 | 12.83 | 0.90 | 115.70 | 1.12 |
| Ours ∗ (Fast) | 11.4 | 0.30 | 0.01 | 0.34 | 0.99 | 3.00 | 0.95 |
| Ours (Full) | 34.0 | 0.09 | 0.09 | 0.08 | 0.86 | 0.71 | 1.13 |
| Method | Axis Ang | Axis Pos | Geo Dist | CD-s | CD-m | CD-w |
|---|---|---|---|---|---|---|
| Ours (Joint) | 0.11 | 0.00 | 0.32 | 2.32 | 2.19 | 1.93 |
| Ours (EM) | 0.02 | 0.00 | 0.02 | 1.99 | 0.70 | 1.87 |
| Method | Axis Ang | Axis Pos | Geo Dist | CD-s | CD-m | CD-w |
|---|---|---|---|---|---|---|
| ArtGS | 8.82 | 141.45 | 12.83 | 0.90 | 115.70 | 1.12 |
| ArtGS + EM | 7.77 | 0.86 | 11.33 | 0.80 | 27.46 | 1.37 |
| Method | Storage_47648 | Storage_45271 | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Axis Ang | Axis Pos | Geo Dist | CD-s | CD-m | CD-w | Axis Ang | Axis Pos | Geo Dist | CD-s | CD-m | CD-w | |
| ArtGS | 0.14 | 0.02 | 0.62 | 0.67 | 3.70 | 0.70 | 9.33 | 1268.83 | 5.85 | 1.27 | 102.33 | 1.74 |
| Ours-50 | 0.06 | 0.01 | 0.13 | 0.53 | 0.23 | 0.60 | 0.03 | 0.00 | 0.07 | 0.49 | 0.17 | 0.89 |
| Ours-250 | 0.13 | 0.01 | 0.15 | 0.57 | 0.22 | 0.59 | 0.02 | 0.00 | 0.05 | 0.55 | 0.17 | 0.91 |
| Ours-500 (Default) | 0.07 | 0.01 | 0.10 | 0.61 | 0.32 | 0.60 | 0.03 | 0.00 | 0.03 | 0.50 | 0.10 | 3.92 |
| Ours-2000 | 0.05 | 0.01 | 0.12 | 0.54 | 0.26 | 0.60 | 0.03 | 0.00 | 0.03 | 0.43 | 0.16 | 0.91 |
| Object | Axis Ang | Axis Pos | Geo Dist | CD-s | CD-m | CD-w |
|---|---|---|---|---|---|---|
| Window_102985 | 0.06 | - | 0.00 | 0.77 | 2.10 | 0.68 |
| Refrigerator_10685 | 0.00 | 0.00 | 0.02 | 0.52 | 0.10 | 0.53 |
Articulated Object Reconstruction
Articulated object reconstruction recovers 3D part geometry, joints, and motion from images, video, or depth for digital twins and robot interaction.
See all 60 papers