We present minimal solvers for joint homography and radial distortion estimation using affine- or orientation-covariant features. The core contribution is a set of novel constraints that exploit local feature geometry inherent to affine descriptors, enabling solvers that require fewer correspondences than point-based methods. Using modern robust estimation frameworks, we demonstrate that the proposed solvers are advantageous to the current state-of-the-art with a significant speed-up in the presence of outliers while maintaining comparable or superior estimation accuracy. The proposed solvers are tested on both synthetic and real images containing challenging fisheye distortions.
Figures & tables
Figure 5: Grossmünster Church: ( Left: ) Location of extracted SIFT correspondences (blue) of a fisheye-distorted input image. ( Right :) Corresponding 3D points (red) showing the dominant plane including the two church towers. Note that the 3D model is not notably affected by distortion artifacts, as the rectification has been done during the reconstruction phase.
Method
Hom. error
Inlier ratio
Exec. time (ms)
Median
Mean
Max
Median
Mean
Max
Median
Mean
Max
Fitzgibbon [ 15 ]
0.047
0.053
0.085
0.48
0.53
0.62
105.7
88.19
121.4
Nakano [ 30 ]
0.048
0.053
0.085
0.48
0.53
0.62
90.31
80.19
99.98
Wadenbäck et al . [ 49 ]
0.048
0.053
0.085
0.47
0.52
0.62
88.24
78.18
105.4
Proposed (ORI)
0.047
0.053
0.085
0.58
0.59
0.63
60.70
47.47
61.52
Proposed (Affine)
0.046
0.053
0.085
0.73
0.73
0.78
20.39
22.89
35.84
Table 1: Grossmünster Church: Results of the solvers in a LOMSAC framework. Best marked in bold and second best in italic .
Figure 6: Grossmünster Church: Rectified images using the estimated distortion parameter obtained by the proposed affine solver. Note that the edges of the church appear straight. This is a strong indication that the method performs well for real-life images, despite the severe fisheye distortion.