cs.CVNov 15, 2026

AstroPIE-53: Towards Understanding Failure Modes of Human Pose Estimation in Space

Authors: Stephanie Käs, Marten Flaig, Lukas Woyke, Osmanalp Ömeroğlu, Felix Krueckel, Onur Alp Çulha, Bastian Leibe

Organizations: Computer Vision Group, RWTH, Aachen, Germany

Abstract

Reliable monitoring of astronauts is essential for safety, situational awareness, and autonomous assistance in space missions. While modern computer vision enables accurate human detection and pose estimation on Earth, its robustness in space environments remains largely unquantified due to limited data availability. We present AstroPIE-53, a pilot dataset of 53 annotated astronaut videos collected from publicly available mission footage. To respect copyright restrictions, we release video identifiers, reconstruction scripts, and dense annotations rather than raw videos. The dataset includes bounding boxes, challenge classes, and human-annotated pose failure tags. We benchmark state-of-the-art person detection and pose estimation models under realistic zero-shot deployment conditions and perform the first systematic failure analysis for astronaut monitoring. Our results reveal substantial performance degradation caused by occlusions, unusual body orientations, low contrast, and microgravity motion patterns.

Figures & tables

Explore similar work

CardsList
  1. Vision Foundation Models with Synthetic-Only Training for Monocular Spacecraft Pose Estimation

    Sep 22, 2026John Church, Vazghen NikolianVision Foundation Model AdaptationObject Pose Estimation

  2. DreamSat-Pose: Spacecraft Pose Estimation from Single-View 3D Reconstructions and Learned 2D-3D Feature Matching

    Jul 15, 2026Josiane Uwumukiza, Jocelyn Zhao, Giovanni Lavezzi +5Relative Pose EstimationSpacecraft Rendezvous and Proximity Operations

  3. SpaceSense-Bench: A Large-Scale Multi-Modal Benchmark for Spacecraft Perception and Pose Estimation

    Mar 10, 2026Aodi Wu, Jianhong Zuo, Zeyuan Zhao +3Robotic PerceptionSpacecraft Pose Estimation