OMNI-PoseX: A Fast Vision Model for 6D Object Pose Estimation in Embodied Tasks
Organizations: KernalMind Tech Co., Ltd., Shanghai, 201100, China.
Abstract
Accurate 6D object pose estimation is a fundamental capability for embodied agents, yet remains highly challenging in open-world environments. Many existing methods often rely on closed-set assumptions or geometry-agnostic regression schemes, limiting their generalization, stability, and real-time applicability in robotic systems. We present OMNI-PoseX, a vision foundation model that introduces a novel network architecture unifying open-vocabulary perception with an SO(3)-aware reflected flow matching pose predictor. The architecture decouples object-level understanding from geometry-consistent rotation inference, and employs a lightweight multi-modal fusion strategy that conditions rotation-sensitive geometric features on compact semantic embeddings, enabling efficient and stable 6D pose estimation. To enhance robustness and generalization, the model is trained on large-scale 6D pose datasets, leveraging broad object diversity, viewpoint variation, and scene complexity to build a scalable open-world pose backbone. Comprehensive evaluations across benchmark pose estimation, ablation studies, zero-shot generalization, and system-level robotic grasping integration demonstrate the effectiveness of OMNI-PoseX. The OMNI-PoseX achieves SOTA pose accuracy and real-time efficiency, while delivering geometrically consistent predictions that enable reliable grasping of diverse, previously unseen objects.
Figures & tables
| Variant | AUC | VUS | Deg | Sht | time(ms) ∗ | |||
|---|---|---|---|---|---|---|---|---|
| @25 | @50 | @75 | 5°/2cm | 5°/5cm | ||||
| NOCS [ 19 ] | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | - | - | - |
| SGPA [ 21 ] | 10.5 | 2.0 | 0.0 | 4.3 | 6.7 | - | - | - |
| IST-Net [ 23 ] | 28.7 | 10.6 | 0.5 | 2.0 | 3.4 | - | - | - |
| HS-Pose [ 22 ] | 31.6 | 13.6 | 1.1 | 3.5 | 5.3 | - | - | - |
| GenPose++ ∗ (w/o E) [ 25 ] | 31.6 | 12.7 | 0.0 | 7.8 | 12.29 | 34.66 | 1.44 | 112 |
| Category | Variant | AUC | VUS | ||||
|---|---|---|---|---|---|---|---|
| @25 | @50 | @75 | 5°/2cm | 5°/5cm | |||
| Rotation | Continuous representation | 39.2 | 17.25 | 1.89 | 9.88 | 14.23 | |
| SO(3) representation | 41.6 | 20.17 | 2.33 | 11.57 | 15.83 | ||
| Fusion | DINO only | 11.3 | 2.5 | 0.0 | 1.4 | 2.1 | |
| PointNet++ only | 37.3 | 15.3 | 1.7 | 0.0 | 0.0 | ||
| Pointwise Fusion | 41.6 | 20.08 | 2.16 | 10.98 | 15.22 | ||
| Variant | AUC | VUS | Deg | Sht | Time (ms) | |||
|---|---|---|---|---|---|---|---|---|
| @25 | @50 | @75 | 5°/2cm | 5°/5cm | ||||
| SGPA | 10.1 | 1.9 | 0.1 | 2.58 | 5.32 | - | - | - |
| IST-Net | 22.4 | 6.9 | 0.5 | 3.85 | 7.32 | - | - | - |
| HS-Pose | 25.2 | 7.7 | 0.6 | 4.42 | 9.15 | - | - | - |
| GenPose++ | 33.97 | 11.17 | 1.21 | 6.89 | 15.52 | 38.02 | 3.04 | 178 |
| OMNI-PoseX (Ours) | 35.6 | 12.17 | 1.33 | 7.57 | 15.46 | 36.17 | 2.75 | 86 |
Object Pose Estimation
Object pose estimation recovers an object's 3D position and orientation from images, depth, point clouds, or contact sensing.
See all 187 papers