cs.CVJul 29, 2026

From Keypoints to Predictive Distributions: Post-Hoc Uncertainty for YOLO-Pose Models

Authors: Alexej KlushynJuan Rivero SesmaFlorian SeligmannRichard KurleKinh TieuJayant Sen Gupta

Organizations: Airbus Central Research & Technology · Airbus Commercial Aircraft · Karlsruhe Institute of Technology · Mistral AI · Acubed

Abstract

YOLO-Pose models provide efficient keypoint localization, but do not quantify the associated spatial uncertainty. We introduce a lightweight post-hoc probabilistic extension that augments a trained YOLO-Pose model with calibrated bivariate predictive distributions over keypoint locations, centered at the model's original predictions. Concretely, we train additional probabilistic heads with an importance-weighted negative log-likelihood to predict an input-dependent 2×22\times2 dispersion matrix for each keypoint, followed by Gaussian calibration for broad downstream compatibility or Student-tt calibration for distributional fidelity. Complementing this, we propose an evaluation protocol that combines a suite of distributional calibration diagnostics with average keypoint precision (AKP), a keypoint-level extension of the COCO AP protocol for assessing reliability rankings. Experiments on COCO show that the learned uncertainty estimates enable effective keypoint-level reliability ranking, Student-tt calibration best captures the empirical residual distribution, and uncertainty-based pruning removes unreliable keypoints. A central application-level demonstration is vision-based aircraft landing, where calibrated covariances for runway keypoints support uncertainty-aware aircraft position estimation and downstream sensor fusion.

Explore similar work

CardsList
  1. Ev-YOLO: Uncertainty-Aware Object Detection via a Unified Evidential Formulation

    Sep 21, 2026Simon Barbarit-Gaboriau, Hind Laghmara, Rémi Boutteau +1