cs.CVNov 4, 2026

Human Motion Prediction via Continual Prior Compensation

Authors: Jianwei Tang, Jian-Fang Hu, Tianming Liang, Xiaotong Lin, Jiangxin Sun, Wei-Shi Zheng, Jianhuang Lai

Organizations: School of Computer Science, Sun Yat-sen University, Guangzhou, China. · the Guangdong Province Key Laboratory of Information Security Technology and the Key Laboratory of Machine Intelligence and Advanced Computing (Sun Yat-sen University), Ministry of Education, China.

Abstract

Human Motion Prediction (HMP) aims to predict future human poses at different moments according to observed past motion sequences. Previous approaches mainly treated the prediction of different temporal moments as a single prediction task and learned the predictions of varied moments simultaneously, which would encounter a main limitation: the learning of short-term predictions (referring to near-future'' prediction) could be hindered by the predictions of long-term (referring to far-future'' prediction) motions. In this paper, we develop a novel temporal continual learning framework called Continual Prior Compensation (CPC) to progressively train HMP models, in which we divide the prediction task of motions corresponding to varied temporal moments into several subtasks and train the model in a multi-stage manner. To mitigate the prior information forgetting in the progressive training, we further introduce a learnable random variable Prior Compensation Factor (PCF) to explicitly measure the prior knowledge loss. We theoretically show that the PCF can be efficiently learned together with the model parameters by minimizing a reasonable upper bound of the objective function. The proposed CPC is further enhanced to estimate the prior information loss for each subtask and a new framework called Continual Prior Compensation++ (CPC++) with Fine-Grained Prior Compensation Factor (FGPCF) is finally developed. Our CPC and CPC++ frameworks are quite flexible and can be easily integrated with different HMP backbone models and adapted to various datasets and applications. Extensive experiments on three HMP benchmark datasets using multiple SOTA HMP backbones (PGBIG, siMLPe, MotionMixer, and LTD) demonstrate the effectiveness and flexibility of our frameworks.

Figures & tables

Explore similar work

CardsList
  1. SimpliHuMoN: Simplifying Human Motion Prediction

    Mar 4, 2026Aadya Agrawal, Alexander SchwingHuman Motion PredictionHuman Trajectory Prediction

  2. AdvMT: Adversarial Motion Transformer for Long-term Human Motion Prediction

    Jan 10, 2024Sarmad Idrees, Seokman Sohn, Jongeun ChoiTransformerHuman Motion Generation

  3. Long-Term Prediction of Local and Global Human Motion with Occlusion Recovery

    Jun 26, 2026Qiaoyue Yang, Sven Heutger, Christopher Niemann +33D ViTsHuman Motion Prediction