cs.RONov 16, 2026

QTOP: Scaling Humanoid Motion Tracking with Quantile Critics

Authors: Markus Peschl, Dana Kianfar, Daniel Dijkman

Organizations: Qualcomm AI Research

Abstract

Learning human motion tracking policies through reinforcement learning (RL) has emerged as a core capability that underpins a majority of recent progress in humanoid whole-body control. However, achieving generalization to unseen motions at high fidelity requires jointly scaling training to thousands of GPU and dataset hours. This work hypothesizes that motion tracking is inherently compute-bound because training on a diverse set of motions introduces learning interference, similar to multi-task RL. To tackle this, we propose Quantile Tracking Optimization (QTOP), which improves sample efficiency by introducing a distributional advantage estimate conditioned on state and reference pairs. QTOP outperforms on and off-policy RL baselines both in simulation and real-world tracking scenarios on multiple datasets by up to 10%. Furthermore, we establish a scaling law for QTOP and find that, aside from scaling predictably, dataset size has minimal impact on performance for moderately sized GPU hour regimes.

Figures & tables

Explore similar work

CardsList
  1. OmniXtreme: Breaking the Generality Barrier in High-Dynamic Humanoid Control

    Feb 27, 2026Yunshen Wang, Shaohang Zhu, Peiyuan Zhi +7Humanoid Robot ControlHumanoid Motion Tracking

  2. HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark

    Aug 13, 2026Dairu Liu, Zekun Qi, Jiayu Zeng +11Human-in-the-Loop EvaluationHumanoid Motion Tracking

  3. Humanoid-GPT: Scaling Data and Structure for Zero-Shot Motion Tracking

    Jun 2, 2026Zekun Qi, Xuchuan Chen, Dairu Liu +10Zero-Shot LearningTransformer