HeadIO: Body-Frame Heading Decomposition for Neural Inertial Odometry on Head-Mounted Devices
Organizations: Northwestern University, Evanston, IL, USA. · University of Chicago, Chicago, IL, USA.
Abstract
Inertial odometry (IO) using only Inertial Measurement Units (IMUs) enables camera-free head tracking in head-mounted devices such as VR headsets, AR glasses, and earbuds. Prior IO methods operate in a gravity-aligned world frame, which is not yaw-equivariant. Yaw augmentation improves robustness but does not guarantee equivariance; learned equivariant layers achieve it, but EqNIO's full pipeline costs nearly 3 the FLOPs of ours. While raw body-frame IMU inputs are inherently yaw-invariant, head tilt redistributes both gravity and motion signals across device axes, making the representation tilt-variant. We propose HeadIO, which combines a body-frame heading decomposition with a bidirectional Mamba backbone for head-mounted inertial odometry. Our decomposition achieves tilt invariance by separating gravity-aligned and horizontal components using only the tilt component of device orientation. We evaluate on four head-mounted datasets and find that HeadIO improves RTE-5s by 8.1% (0.260 m 0.239 m) over world-frame methods with learned equivariant layers on Nymeria, the largest benchmark dataset, at nearly 3 lower FLOPs and 8 fewer parameters. HeadIO achieves state-of-the-art performance on our primary metric, RTE-5s, on all Aria-glasses datasets, which natively provide body-frame semantics for our decomposition method. We further evaluate the IMU-only deployment scenario on Nymeria, where HeadIO remains state-of-the-art. We show that our method relies mainly on tilt accuracy, which can be obtained from the gravity signal; for yaw, a single-coefficient gyroscope correction removes 11.6% of the yaw error and improves RTE-5s by 2.5%, and sparse external yaw corrections (for example, one every 30 s) can improve RTE-5s by 12.0%. Our decomposition is lightweight, composes with any backbone, and is suitable for real-time deployment on head-mounted devices.
Figures & tables
| Dataset | Method | RTE-5s | RTE-1s | ATE | Drift% |
|---|---|---|---|---|---|
| Nymeria | TLIO | 0.278 | 0.101 | 4.093 | 2.17 |
| EqNIO | 0.260 | 0.093 | 3.577 | 1.96 | |
| HeadIO | 0.239 | 0.086 | 3.258 | 1.79 | |
| AEA | TLIO | 0.241 | 0.088 | 0.811 | 5.24 |
| EqNIO | 0.220 | 0.081 | 0.797 | 5.14 | |
| HeadIO | 0.213 | 0.077 | 0.819 | 5.81 |
| Backbone | Frame | Prep. | Prior | Ground truth | Mahony (IMU-only) | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| RTE-5s | RTE-1s | ATE | Drift% | RTE-5s | RTE-1s | ATE | Drift% | ||||
| ResNet | World | – | TLIO | 0.278 | 0.101 | 4.093 | 2.17 | 0.310 | 0.108 | 4.514 | 2.20 |
| VN | EqNIO | 0.260 | 0.093 | 3.577 | 1.96 | 0.297 | 0.102 | 4.118 | 2.05 | ||
| Body | – | AirIO | 0.285 | 0.103 | 4.806 | 2.68 | 0.314 | 0.109 | 5.493 | 2.88 | |
| Ours | Ours | 0.260 | 0.095 | 3.448 | 1.84 | 0.294 | 0.103 | 3.987 | 1.96 | ||
| Mamba | World | – | TLIO | 0.277 | 0.096 | 5.159 | 3.00 | 0.309 | 0.104 | 5.570 | 3.03 |
| Orientation | Method | RTE-5s | RTE-1s | ATE | Drift% |
|---|---|---|---|---|---|
| Ground truth | TLIO | 0.278 | 0.101 | 4.093 | 2.17 |
| EqNIO | 0.260 | 0.093 | 3.577 | 1.96 | |
| HeadIO | 0.239 | 0.086 | 3.258 | 1.79 | |
| Mahony (0.35 / 4.21) | TLIO | 0.310 | 0.108 | 4.514 | 2.20 |
| EqNIO | 0.297 | 0.102 | 4.118 | 2.05 | |
| HeadIO | 0.275 | 0.094 | 3.914 | 1.96 |
Inertial Odometry
Inertial odometry estimates position and orientation over time from motion sensors, often combining inertial data with other measurements.
See all 54 papers