Motion Representation Learning

Overview

Motion representation learning studies how to encode movement from sources such as body skeletons, wearable sensors, point trajectories, and human–object interactions so models can recognize, predict, generate, or control motion. Approaches range from discrete motion tokens and continuous latent spaces to geometric, graph-based, and frequency-aware representations, trained with masked prediction, contrastive learning, or temporal prediction. Language and video supervision increasingly connect these encodings to semantic descriptions and robot actions, while diffusion and flow-matching models use them for tasks such as text-to-motion generation and motion completion. A central challenge is balancing compact, efficient representations with fine-grained dynamics and meaningful semantics, while ensuring transfer across datasets, body shapes, sensor setups, and real-world conditions.

Latest papers

CardsList

184 papers25 papers in the last four weeks, down 43% on the four weeks before. 0.2% of all new papers.

  1. Semantic-Geometric Task Representations for Bimanual Manipulation from Human Demonstrations to Robot Action Planning

    Jan 16, 2026Franziska Herbert, Vignesh Prasad, Han Liu +2Bimanual Robotic ManipulationObject-Centric Representation Learning

  2. GeoMotionGPT: Geometry-Aligned Motion Understanding with Large Language Models

    Jan 12, 2026Zhankai Ye, Bofan Li, Yukai Jin +5Motion Representation LearningCross-Modal Alignment

  3. FunPhase: A Periodic Functional Autoencoder for Motion Generation via Phase Manifolds

    Dec 10, 2025Marco Pegoraro, Evan Atherton, Bruno Roy +2Representation LearningAutoencoders