Tightly-Coupled Radar-Visual-Inertial Odometry
Organizations: All authors are with the Department of Engineering Cybernetics, O. S. Bragstads Plass 2D, Norwegian University of Science and Technology (NTNU), Trondheim, Norway.
Abstract
Visual-Inertial Odometry (VIO) is a staple for reliable state estimation on constrained and lightweight platforms due to its versatility and demonstrated performance. However, pertinent challenges regarding robust operation in dark, low-texture, obscured environments complicate the use of such methods. Alternatively, Frequency Modulated Continuous Wave (FMCW) radars, and by extension Radar-Inertial Odometry (RIO), offer robustness to these visual challenges, albeit at the cost of reduced information density and worse long-term accuracy. To address these limitations, this work combines the two in a tightly coupled manner, enabling the resulting method to operate robustly regardless of environmental conditions or trajectory dynamics. The proposed method fuses image features, radar Doppler measurements, and Inertial Measurement Unit (IMU) measurements within an Iterated Extended Kalman Filter (IEKF) in real-time, with radar range data augmenting the visual feature depth initialization. The method is evaluated through flight experiments conducted in both indoor and outdoor environments, as well as through challenges to both exteroceptive modalities (such as darkness, fog, or fast flight), thoroughly demonstrating its robustness. The implementation of the proposed method is available at: https://github.com/ntnu-arl/radvio.
Figures & tables
| Parameter | Value | Unit | |
| Starting Frequency | |||
| Max. | Range | ||
| Doppler | |||
| Res. | Range | ||
| Doppler | |||
| Azimuth/Elevation | |||
| Sequence | Length [ ] | ape [ ] | rpe ( 10\text{,}\mathrm{m}$$ ) [ ] | Final Position Relative Drift [ ] | |||||||||
| RIO | VIO | RadVIO | RRxIO [ 15 ] | RIO | VIO | RadVIO | RRxIO [ 15 ] | RIO | VIO | RadVIO | RRxIO [ 15 ] | ||
| forest1 | 0.722 | 0.068 | 0.187 | ||||||||||
| forest2 | 0.631 | 0.089 | 0.224 | ||||||||||
| forest3 | 1.378 | 0.079 | 0.566 | ||||||||||
| forest4 | 1.568 | 0.118 | 0.415 | ||||||||||
| indoor_dark1 | 0.371 | 0.045 | 0.112 | ||||||||||
Robot Localization
Robot localization estimates a robot’s position and orientation from onboard sensors, maps, and observations of its surroundings.
See all 177 papers