RAGNAROK: Radar-Aided Gravity-Normalized Alignment for Robust Open Keyframe-based Radar-Visual-Kinematic-Inertial SLAM
Authors: Hanjun Kim, Chiyun Noh, Sangwoo Jung, Jaehyung Jung, Simon Boche, Cedric Le Gentil, Stefan Leutenegger, Ayoung Kim
Organizations: Dept. of Mechanical Engineering, SNU, Seoul, S. Korea · Mobile Robotics Lab, School of Computation, Information and Technology (CIT) at the Technical University of Munich (TUM), 80333 Munich, Germany, and with the Munich Institute of Robotics and Machine Intelligence (MIRMI) · Mobile Robotics Lab, ETH Zurich, 80892 Zurich, Switzerland
Legged robots offer superior mobility in unstructured environments, but reliable operation in such conditions requires robust state estimation. To address the vulnerability of proprioceptive estimators in rough terrain, recent methods have incorporated radar to provide velocity measurements. However, their limited yaw observability still leads to drift, and failure-aware fusion for adverse environments remains underexplored. In this letter, we present RAGNAROK, the first radar-visual-kinematic-inertial SLAM designed for robust operation in challenging environments. It integrates slip- and rolling-contact-aware leg velocity estimation, a kinematics-aware radar factor, and degradation-aware image enhancement. We further incorporate a B-spline-based radar-aided proprioceptive backbone, adaptive weighting, and online extrinsic calibration. Extensive experiments on public and self-collected datasets demonstrate that RAGNAROK achieves robust performance under challenging conditions and outperforms state-of-the-art baselines. The source code and dataset are available at https://github.com/hanjun815/RAGNAROK.
Figures & tables
Fig. 1 : Top: Performance comparison with SOTA baselines, with scores computed as ATEmean/(ATEmean+ATE) . Middle: Representative challenging scenarios from the self-collected dataset. Bottom: Overview of the proposed RAGNAROK pipeline.
Fig. 2 : Overview of RAGNAROK: The radar-aided proprioceptive estimator optimizes the splines of velocity, rotation, and local gravity. The exteroceptive estimator performs image enhancement, keypoint matching, landmark triangulation, place recognition, and submapping.
Fig. 3 : Kinematics-aware multi-radar factor. (a) For the horizontal radar, wall points aligned with the azimuth are weighted higher. (b) For the vertical radar, floor and ceiling points aligned with the azimuth are weighted higher. (c) Under harsh motion, increased positional uncertainty lowers the radar Doppler residual weights.
Fig. 4 : Left : Plot of π(Hi)Mi(Hi) . Middle : Before enhancement, features are non-uniformly distributed. Right : After enhancement, more features are extracted and more uniformly distributed.
Fig. 5 : Qualitative comparison of image enhancement results.
Dataset
Platform
Radar
Camera
LiDAR
IMU
GT
Scenarios
RRxIO [ 4 ]
UAV
1 × SoC
1 × Mono
-
✓
Vicon/ VISLAM
Indoor, Outdoor, Dark
HeRCULES [ 13 ]
Car
1 × 4D, 1 × Spinning
2 × Mono
✓
✓
RTK
Outdoor, Dark, Rain, Snow
Co-RaL [ 11 ]
Legged Robot
1 × SoC
-
✓
✓
LIO
Indoor, Outdoor, Hybrid
GaRLILEO [ 20 ]
Legged Robot
1 × SoC
-
✓
✓
TLS
Indoor, Outdoor, Hybrid
GrandTour [ 23 ]
Legged Robot
-
7 × Stereo, 8 × Mono
✓
✓
RTS/ GNSS
Indoor, Outdoor, Dim, Dark, Snow
RAGNAROK
Legged Robot
2 × SoC
1 × Stereo, 2 × Mono
✓
✓
TLS
Indoor, Outdoor, Hybrid, Dark, Dim, Glare
TABLE I : Comparison with Existing Datasets
Sequence
Outdoor
Indoor
Length (m)
Elevation
Self-similarity
# of Loops
Terrace
Dark
-
68.38
-
-
1
TerraceLoop
Dark
-
134.47
-
-
2
Garden
Dark
-
162.54
✓
-
2
Quad
Dim
-
438.28
✓
-
1
Overpass
Glare
-
160.10
✓
-
1
Mountain-Long
✓
-
207.59
✓
-
1
TABLE II : Overview of Sequences
Fig. 6 : System overview of the platform and coordinates of sensors.
Deployment of legged robots for navigating challenging terrains (e.g., stairs, slopes, and unstructured environments) has gained increasing preference over wheel-based platforms. In such scenarios, accurate odometry estimation is a preliminary requirement for stable locomotion, localization, and mapping. Traditional proprioceptive approaches, which rely on leg kinematics sensor modalities and inertial sensing, suffer from irrepressible vertical drift caused by frequent contact impacts, foot slippage, and vibrations, particularly affected by inaccurate roll and pitch estimation. Existing methods incorporate exteroceptive sensors such as LiDAR or cameras. Further enhancement has been introduced by leveraging gravity vector estimation to add additional observations on roll and pitch, thereby increasing the accuracy of vertical pose estimation. However, these approaches tend to degrade in feature-sparse or repetitive scenes and are prone to errors from double-integrated IMU acceleration. To address these challenges, we propose GaRLILEO, a novel gravity-aligned continuous-time radar-leg-inertial odometry framework. GaRLILEO decouples velocity from the IMU by building a continuous-time ego-velocity spline from SoC radar Doppler and leg kinematics information, enabling seamless sensor fusion which mitigates odometry distortion. In addition, GaRLILEO can reliably capture accurate gravity vectors leveraging a novel soft S2-constrained gravity factor, improving vertical pose accuracy without relying on LiDAR or cameras. Evaluated on a self-collected real-world dataset with diverse indoor-outdoor trajectories, GaRLILEO demonstrates state-of-the-art accuracy, particularly in vertical odometry estimation on stairs and slopes. We open-source both our dataset and algorithm to foster further research in legged robot odometry and SLAM. https://garlileo.github.io/GaRLILEO
Chiyun Noh, Sangwoo Jung, Hanjun Kim +3
Dept. of Mechanical Engineering, SNU, Seoul, S. Korea · Robotics and AI Institute, Cambridge, USA
Radar sensing is increasingly used in mobile systems because it operates reliably under poor lighting, adverse weather, and privacy-sensitive settings where cameras and LiDAR often fail. However, most existing radar SLAM systems estimate motion through scan matching on discretized radar heatmaps, which breaks geometric continuity and fails to capture key radar sensing properties, often leading to unstable pose estimation and degraded mapping in regenerate or dynamically changing environments. We present DiffRadar, a real-time radar SLAM system that models radar observations as a differentiable, physics-aware Gaussian field rather than discrete scans. DiffRadar represents the scene as anisotropic Gaussian primitives and renders radar measurements in range-azimuth and Doppler-azimuth spaces through a differentiable radar forward model, enabling joint optimization of robot pose and scene structure directly from radar measurements. We implement DiffRadar on commodity FMCW radar hardware and evaluate it on both the public Radarize benchmark and a controlled stress-test suite that targets common radar SLAM failure modes, including corridor degeneracy, motion regime transitions, dynamic clutter, and long-horizon loop closures. DiffRadar achieves substantial reductions in trajectory error on the benchmark, with especially large gains under feature-poor corridor motion, while more than doubling map consistency and maintaining real-time performance at 70 FPS. These results show that modeling radar observations directly in the signal domain enables substantially more robust and consistent radar-only SLAM for mobile platforms.
This paper introduces Dr-PoGO, a method for Simultaneous Localization And Mapping (SLAM) using a 2D spinning radar. Unlike cameras or lidars that require line-of-sight, millimetre-wave radars can `see' through dust, falling snow, rain, etc. Accordingly, it is a great modality for robust perception regardless of the weather conditions. While most existing radar-based SLAM methods rely on the extraction of point clouds or features to perform ego-motion estimation, Dr-PoGO leverages direct registration techniques for odometry (DRO) and loop-closure registration. An off-the-shelf radar-focused place recognition algorithm, RaPlace, provides loop-closure candidates. As RaPlace does not provide relative transformations, Dr-PoGO introduces a coarse-to-fine registration that uses visual features and descriptors to obtain an initial guess for the direct transformation refinement. The global trajectory is optimized in a pose-graph optimization. Dr-PoGO demonstrates state-of-the-art performance over 300km of data in various real-world automotive environments. Our implementation is publicly available: https://github.com/utiasASRL/dr_pogo.
Cedric Le Gentil, Weican Li, Leonardo Brizi +1
Robotics Institute University of Toronto. · Department of Computer, Control, and Management Engineering “Antonio Ruberti”, Sapienza University of Rome.