NS-RGS: Newton-Schulz based Riemannian gradient method for orthogonal group synchronization
Abstract
Group synchronization is a fundamental task involving the recovery of group elements from pairwise measurements. For orthogonal group synchronization, the most common approach reformulates the problem as a constrained nonconvex optimization and solves it using projection-based methods, such as the generalized power method. However, these methods rely on exact SVD or QR decompositions in each iteration, which are computationally expensive and become a bottleneck for large-scale problems. In this paper, we propose a Newton-Schulz-based Riemannian Gradient Scheme (NS-RGS) for orthogonal group synchronization that significantly reduces computational cost by replacing the SVD or QR step with the Newton-Schulz iteration. This approach leverages efficient matrix multiplications and aligns perfectly with modern GPU/TPU architectures. By employing a refined leave-one-out analysis, we overcome the challenge arising from statistical dependencies, and establish that NS-RGS with spectral initialization achieves linear convergence to the target solution up to near-optimal statistical noise levels. Experiments on synthetic data and real-world global alignment tasks demonstrate that NS-RGS attains accuracy comparable to state-of-the-art methods such as the generalized power method, while achieving nearly a 2 speedup.
Figures & tables
| Algorithm | Rel. Err. | Time (s) | Rel. Err. | Time (s) | Rel. Err. | Time (s) |
|---|---|---|---|---|---|---|
| RTR | 4.38E-03 | 8.314 | 2.19E-02 | 8.874 | 4.38E-02 | 9.146 |
| GPM | 4.38E-03 | 0.282 | 2.19E-02 | 0.287 | 4.38E-02 | 0.289 |
| NS-RGS | 4.38E-03 | 0.154 | 2.19E-02 | 0.158 | 4.38E-02 | 0.161 |
| Algorithm | Rel. Err. | Time (s) |
|---|---|---|
| RTR | 1.52E-02 | 0.207 |
| GPM | 1.52E-02 | 0.055 |
| NS-RGS | 1.52E-02 | 0.023 |
Lie Group Methods
Lie group methods use transformation groups and their Lie algebras to model rotations, rigid motions, symmetries, and other structured dynamics.
See all 42 papers