IUP-Pose: Decoupled Iterative Uncertainty Propagation for Real-time Relative Pose Regression via Implicit Dense Alignment v1
Abstract
Relative pose estimation is fundamental for SLAM, visual localization, and 3D reconstruction. Existing Relative Pose Regression (RPR) methods face a key trade-off: feature-matching pipelines achieve high accuracy but block gradient flow via non-differentiable RANSAC, while ViT-based regressors are end-to-end trainable but prohibitively expensive for real-time deployment. We identify the core bottlenecks as the coupling between rotation and translation estimation and insufficient cross-view feature alignment. We propose IUP-Pose, a geometry-driven decoupled iterative framework with implicit dense alignment. A lightweight Multi-Head Bi-Cross Attention (MHBC) module aligns cross-view features without explicit matching supervision. The aligned features are processed by a decoupled rotation-translation pipeline: two shared-parameter rotation stages iteratively refine rotation with uncertainty, and feature maps are realigned via rotational homography H_inf before translation prediction. IUP-Pose achieves 73.3% AUC@20deg on MegaDepth1500 with full end-to-end differentiability, 70 FPS throughput, and only 37M parameters, demonstrating a favorable accuracy-efficiency trade-off for real-time edge deployment.
Figures & tables
| Method | AUC@5 ∘ | AUC@10 ∘ | AUC@20 ∘ | FPS |
| Non-RPR Methods | ||||
| Efficient LoFTR | 56.4 | 72.2 | 83.5 | 37 |
| ROMA | 62.6 | 76.7 | 86.3 | 3 |
| XFEAT | 42.6 | 56.4 | 67.7 | 40 |
| RPR Methods | ||||
| Map-free (Regress-SN) | - | - | <10 | 100 |
| RT-Dec | Iter | IDA | Uncert | Homo | Pre | AUC@5 ∘ | AUC@10 ∘ | AUC@20 ∘ |
|---|---|---|---|---|---|---|---|---|
| 4.1 | 14.2 | 31.3 | ||||||
| ✓ | 8.4 | 19.0 | 37.9 | |||||
| ✓ | ✓ | 10.6 | 23.3 | 42.9 | ||||
| ✓ | ✓ | ✓ | 14.8 | 28.5 | 45.2 | |||
| ✓ | ✓ | ✓ | ✓ | 16.8 | 31.3 | 48.8 | ||
| ✓ | ✓ | ✓ | ✓ | ✓ | 22.5 | 40.9 | 57.6 |
Relative Pose Estimation
Relative pose estimation recovers the rotation and translation between cameras, objects, or robots from visual and other sensor measurements.
See all 66 papers