Motion Representation Learning

Ask about this topic

Momentum

32 papers in the last four weeks, up 357% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 66

All topics
CardsList

  1. EgoLAP: Learning from Egocentric Human Data through Language-Action Reasoning

    Oct 6, 2026Lihan Zha, Shresth Grover, Tenny Yin +7Cross-Embodiment Robot LearningMotion Representation Learning

    Princeton University · Toyota Research Institute · Physical Intelligence

  2. Beyond Retargeting: Low-Latency and Robust Humanoid Whole-Body Teleoperation with Learned Atomic Motion Primitives

    Oct 6, 2026Xiayan Xu, Jiyu Yu, Xingzhou Chen +5Robot TeleoperationHumanoid Robot Control

    The Hong Kong University of Science and Technology, Hong Kong SAR, China · Zhejiang University, Hangzhou, China · Tencent Robotics X, Shenzhen, China +1

  3. SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Models

    Oct 5, 2026Xiaodong Wang, Tianle Li, Chuanxin Song +4Action-Conditioned Video GenerationWorld Models for Robotics

    Peking University

  4. Kinematics-Centric Continuous Sign Language Retrieval with Gloss-Guided Boundary-Aware Alignment

    Oct 4, 2026Chang Liu, Ke Han, Davide Talon +2Cross-Modal AlignmentMotion Representation Learning

    University of Trento Trento, Italy · Fondazione Bruno Kessler Trento, Italy

  5. World Motion Models: Flexible Sequence Modeling of SE(3) Trajectories

    Oct 1, 2026Jiahui Lei, Qianqian Wang, Trevor Darrell +1World Models for RoboticsMotion Representation Learning

    UC Berkeley · Harvard University

  6. NarrativeFlow: Flow-Based Vision-Language-Action Model Using Robot Velocity Fields

    Oct 1, 2026Shota Kobayashi, Koki Seno, Daichi Yashima +1Language-Conditioned Robot ManipulationCross-Embodiment Robot Learning

    Keio University, Japan

  7. Magic-W0: A Structured World-Action Foundation Model for Physical Intelligence

    Sep 30, 2026Xuhua Chen, Zhenhan Yin, Yuan Zhang +15Robot Foundation ModelsAction-Conditioned World Models

    Magic-Lab Team, Magiclab Robotics Inc.

  8. MotionWeave: Learning Motion-Centered Future Dynamics for Vision-Language-Action Policies

    Sep 30, 2026Jingqiu Wang, Yan WangVisuomotor Policy LearningRobotic Manipulation

    School of Data Science and Engineering East China Normal University, Shanghai, China

  9. Video2SwimFish: An Automated Pipeline for Reconstructing Controllable Fish Models and Biological Locomotion from Real Fish Videos

    Sep 30, 2026Hangong Chen, Linfeng Cheng, Tahsin Zaman Jilan +4Underwater 3D ReconstructionRobot Locomotion

    Department of Computer Science, North Carolina A&T State University · Department of Computer Science, University of Maryland, College Park

  10. Unveiling the Value of Motion for Cinematic Camera Trajectories

    Sep 30, 2026Ziqi Zhou, Yujian Yuan, Laura Sevilla-LaraCamera-Controlled Video GenerationMotion Representation Learning

    University of Edinburgh · The Hong Kong University of Science and Technology

  11. Eulerian Motion Reconstruction for Water Scenery

    Sep 29, 2026Chuhan Chen, Yen-Chi Cheng, Ayush Saraf +84D Reconstruction3D Reconstruction

    Carnegie Mellon University · University of Illinois Urbana-Champaign · Meta

  12. Retargeting Motions to Diverse Skeletons via Learnable Flattening

    Sep 29, 2026Kia-Jüng Yang, Fabian H. Sinz, Paweł A. PierzchlewiczZero-Shot LearningGraph Representation Learning

    Institute of Computer Science, University of Göttingen · Campus Institute Data Science, University Göttingen · Pantomim P.S.A

  13. CrossBFM: Distilling a Shared Latent Behavior Space Across Humanoid Embodiments

    Sep 29, 2026Tan-Dzung Do, Tuan Dat Phuong, Nico Bohlinger +6Robot Foundation ModelsCross-Embodiment Robot Learning

    VinRobotics · National University of Singapore · TU Darmstadt +3

  14. Learning Expressive and Compositional Motion Representation via Spectral Skills

    Sep 29, 2026Feiyang Wu, Chenxiao Gao, Chen Yang +3Robot Skill LearningHumanoid Robot Control

    Georgia Institute of Technology

  15. VidAct: Learning Manipulation from In-the-Wild Videos with Object-Centric 3D Awareness

    Sep 29, 2026Hang Li, Mingxin Zhang, Zihan Wu +9Object-Centric Representation LearningRobotic Manipulation

    Technical University of Munich · Peking University · Huawei Heisenberg Research Center +2

  16. DiMoP: Diffusion-Driven Motion Representation Learning With Frame-Level Pseudo-Classification for Skeleton-Based Action Recognition

    Sep 28, 2026Shanaka Ramesh Gunasekara, Wanqing Li, Nikalal Kaldera +2Skeleton-Based Action RecognitionMasked Diffusion Models

    Advanced Multimedia Research Lab, University of Wollongong, Australia

  17. HUMAN-TCI: Hierarchical Multi-Stream Motion-Aware Network with Torso-Centered Interaction for Text-to-Motion Retrieval

    Sep 28, 2026Muhammad Islam, Euijoon Ahn, Usman Naseem +1Cross-Modal RetrievalMotion Representation Learning

    College of Science and Engineering, James Cook University, Cairns, 4878, QLD, Australia · Centre for AI and Data Science Innovation, James Cook University, Cairns, 4878, QLD, Australia · School of Computing, Macquarie University, Sydney, 2113, NSW, Australia

  18. MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space

    Sep 28, 2026Qing Yu, Kent FujiwaraFlow MatchingText-to-Motion Generation

    LY Corporation, Tokyo, Japan

  19. TT-VidT: Decoupling the Temporal Axis for Efficient Motion-Centric Video Pretraining

    Sep 27, 2026Shih-Ying Yeh, Daniel Z. Kaplan, Xuehai Wang +3Efficient ViTsVideo Representation Learning

    National Tsing Hua University · Comfy Org Research · Karolinska Institutet +2

  20. Harnessing Coupled Stream Completion For Human-Object Interaction Modeling

    Sep 26, 2026Dawei Guan, Di Yang, Jiangtao WangHOI GenerationMotion Representation Learning

    School of Artificial Intelligence and Data Science, University of Science and Technology of China

  21. MotionJEPA: Preventing Temporal Feature Collapse by Capturing Visual Changes in Latent Space

    Sep 20, 2026Markus Karmann, Shile Li, Christian Internò +10Joint-Embedding Predictive ArchitectureLatent World Models

    University of Oxford · vivo Tech Research GmbH · Bielefeld University +5

  22. VISTA: Video-Injected Stylized Text-to-Animation

    Sep 20, 2026Monseej Purkayastha, Anindita Ghosh, Philipp SlusallekText-to-Motion GenerationHuman Motion Generation

    Saarland Informatics Campus & German Research Centre for Artificial Intelligence (DFKI), Saarbrücken, Germany · Max Planck Institute for Informatics (MPII), Saarbrücken, Germany

  23. BiRoAD: Learning Shared and Role-Adaptive Representations for Bimanual Manipulation

    Sep 20, 2026Yan Shen, Yuchen Liu, Feng Jiang +5Representation LearningBimanual Robotic Manipulation

    CFCS, School of Computer Science, Peking University

  24. MoWAM: Explicit Future Motion Prediction for Efficient World Action Models

    Sep 17, 2026Jiayu Wang, Bin Zhu, Yue Yu +1World Models for RoboticsWorld Model-Based Planning

    College of Computer Science and Artificial Intelligence, Fudan University, Shanghai, China · Singapore Management University, Singapore · Institute of Trustworthy Embodied AI, Fudan University, Shanghai, China

  25. WholeBodyWAM: Learning Whole-Body World Action Models with Scalable Motion Priors

    Sep 16, 2026Bowei Zhang, Qiyao Zhang, Shuanghao Bai +8Cross-Embodiment Robot LearningWorld Action Models

    Nankai University · Beijing Innovation Center of Humanoid Robotics · Beijing Institute of Technology +1

  26. GeoLAM: Learning Geometry-Grounded Latent Actions from Unlabeled Human Videos

    Sep 15, 2026Yifan Xie, Hekun Tian, Jinkun Liu +3Latent Action LearningGeometric Representation Learning

    Tsinghua University · Beijing Institute of Technology · Fudan University

  27. Learning Options for Compositional Motor Control with Adapter Banks

    Sep 15, 2026Sreejan Kumar, Marcelo Mattar, Lea DunckerRL ControlLatent Action Learning

    Columbia University · New York University

  28. X-WBC: A Cross-Embodiment Foundation Model for Humanoid Whole-Body Control

    Sep 14, 2026Juntong Zhang, Chun Gu, Li ZhangRobot Foundation ModelsHumanoid Robot Control

    Tongji University · Shanghai Innovation Institute · School of Data Science, Fudan University

  29. Atomic Motion Coordinate for Language-Steerable and Force-Responsive Manipulation

    Sep 14, 2026Jiaqi Zhai, Jingkai Zhao, Chen Yang +10Language-Conditioned Robot ManipulationForce-Controlled Robotic Manipulation

    Hangzhou DEEP Robotics Technology Co., Ltd. (DEEP Robotics), Hangzhou, China · Tsinghua University, Beijing, China · Zhejiang University, Hangzhou, China +7

  30. UniMo: Unifying Human and Animal Motion Generation

    Sep 14, 2026Zeyu Zhang, Zhiyuan Zhang, Siheng Wang +4Text-to-Motion GenerationHuman Motion Generation

    Westlake University, China · The Australian National University, Australia

  31. PhysioAI: Clinical Knowledge-Guided Semantic Supervision for Skeleton-Based Physiotherapy Action Recognition

    Sep 14, 2026Jie Cao, Euijoon Ahn, Anwar Hassan +1Skeleton-Based Action RecognitionHuman Activity Recognition

    The University of Sydney, Australia · James Cook University, Australia · Nepean Hospital, Australia

  32. Investigating Temporal Motion Features for Pose-to-Text Indian Sign Language Translation

    Sep 14, 2026Manav Dhamecha, Praveen Kumar Chandaliya, Pruthwik MishraSign Language TranslationTransformer

    Sardar Vallabhbhai National Institute of Technology, Surat, India

  33. MoVT: Video-Augmented Motion Tokenizer for Text-to-Motion Generation

    Sep 14, 2026Beibei Jing, Tianle Guo, Youjia Zhang +5Text-to-Motion GenerationHuman Motion Generation

    Huazhong University of Science and Technology School of Computer Science and Technology Wuhan, Hubei, China · Zhejiang University School of Software Technology Ningbo, China

  34. FOCI Policy: Focus on Object-Centric Interactions for Relational Manipulation Policies

    Sep 8, 2026Ze Fu, Pinhao Song, Yutong Hu +1Generalization in Robotic ManipulationRobotic Manipulation

    KU Leuven, Dept. Mechanical Engineering, Research unit Robotics, Automation and Mechatronics · KU Leuven, Dept. Electrical Engineering, Research unit Processing Speech and Images

  35. ReMoMask-2: Latent Retrieval-Augmented Masked Motion Generation

    Sep 8, 2026Yiran Wang, Zeyu Zhang, Ling Shao +1Text-to-Motion GenerationHuman Motion Generation

    University of Sydney, Camperdown 2006, Australia · School of Computer Science, Peking University, Beijing 100871, China · UCAS-Terminus AI Lab, University of Chinese Academy of Sciences, Beijing 101408, China

  36. RoboTok: An Internet-Scale Data Engine for Human Demonstration Retrieval and Dexterous Manipulation Learning

    Sep 2, 2026Howard Qian, Yiting Chen, Yunfei Xie +6Robot Skill LearningRobotic Data Collection

    Rice University · NVIDIA

  37. Puppeteer: Object-Grounded Posture-Aware Co-Speech Gesture Generation

    Aug 31, 2026Vida Adeli, Soroush Mehraban, Jacob Rommann +3Motion Diffusion ModelsHuman Motion Generation

    Pickford AI · University of Toronto · Vector Institute

  38. BLARM: Animating 3D Objects from Video via Blending Latent Rigid Motion Primitives

    Aug 31, 2026Pradyumn Goyal, Yizhak Ben-Shabat, Hsueh-Ti Derek Liu +6Motion Representation Learning

    Roblox · UMass Amherst · TU Crete

  39. Motion-Saliency Complementary Masked Modeling for Point Cloud Video Understanding

    Aug 31, 2026Wei Wang, Yiding Sun, Yuyan Wang +4Point Cloud LearningGenerative Modeling

    School of Computer Science and Technology, Xi’an Jiaotong University, Xi’an, 710049, China · Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ), Shenzhen, 518107, China · School of Software Engineering, Xi’an Jiaotong University, Xi’an, 710049, China +4

  40. MASQ: Mask-Aware Spatiotemporal Quantization for Unsupervised Skeleton Action Segmentation

    Aug 30, 2026Xinyao Qin, Linxiang Peng, Youbao Ye +2Temporal Action SegmentationUnsupervised Representation Learning

    University of Science and Technology of China, China

  41. SignRR: Retrieve and Refine Real Motion for Sign Language Production

    Aug 28, 2026Fidel Omar Tito Cruz, Angie Sanchez Marquina, Summy Farfan +1Human Motion GenerationMotion Representation Learning

    University of Central Florida Florida, USA · Universidad Nacional Mayor de San Marcos Lima, Peru · Universidad Catolica San Pablo Arequipa, Peru +1

  42. Beyond Simulated Benchmarks: Evaluating Motion Representations for Fall Detection Under Real-World Data Scarcity

    Aug 13, 2026Timilehin B. Aderinola, Ilaria D'Ascanio, Luca Palmerini +5Fall DetectionRepresentation Learning

    School of Computer Science, University College Dublin (UCD), Ireland · Department of Electrical, Electronic and Information Engineering “Guglielmo Marconi”, University of Bologna, Italy · Department of Clinical Gerontology, Robert Bosch Hospital, Stuttgart, Germany +2

  43. Motion Beyond Morphology: Bootstrapping Cross-Category Motion Transfer from Abstract Motion Representations

    Aug 3, 2026Zhixue Fang, Zhimin Zhang, Bi'an Du +6Representation LearningMotion Representation Learning

    Kling Team · Peking University

  44. MoRAE: Flow-Friendly Self-Supervised Latents for Text-to-Motion Generation

    Jul 31, 2026Yifei Zhu, Mingyi Shi, Yangyang Cai +3Self-Supervised LearningText-to-Motion Generation

    1Tohoku University, Sendai, Japan · 2The University of Hong Kong, Hong Kong

  45. MUGEN: A Unified Framework for Efficient Motion Understanding and Generation

    Jul 30, 2026Zhankai Ye, Yukai Jin, Bingyang Wei +5Representation LearningHuman Motion Generation

    1Florida State University · 2Texas Christian University · University of Miami +1

  46. MIME: Multimodal Interactive Motion Encoder

    Jul 18, 2026Addison Zucek, Prerit Gupta, Kamila Kuatova +1Text-to-Motion GenerationCross-Modal Alignment

    Purdue University

  47. Inertia-1: An Open Exploration of Wearable Motion Foundation Models

    Jul 7, 2026Zongzhe Xu, Aakarsh Anand, Sarah Jiang +4Human Activity RecognitionWearable Sensing

    University of California, Los Angeles · Duke University · John Hopkins University

  48. Geometry-Aware Motion Latents for Learning Robust Manipulation Policies

    Jul 6, 2026Yunchao Zhang, Yijia Weng, Ruizhe Liu +3Latent Action LearningGeometric Representation Learning

    Department of Computer Science, The University of Hong Kong, Hong Kong, China · Department of Computer Science, Stanford University, Stanford, California, USA · Department of Data Science and AI, Monash University, Melbourne, Australia

  49. SAMoR: Motion Modelling for Articulated Objects of Any Skeleton and Topology

    Jul 2, 2026Yuhao Zhang, Gerard Pons-Moll, Tolga BirdalGenerative ModelingMotion Representation Learning

    Imperial College London · University of Tübingen, Tübingen AI Center

  50. FrameONE: Hierarchical Motion Modeling for Universal Multi-View Echocardiographic Keyframe Detection

    Jul 1, 2026Rusi Chen, Yuhao Huang, Hongyuan Zhang +4Representation LearningMulti-View Learning

    Medical Ultrasound Image Computing (MUSIC) Lab, Shenzhen University, Shenzhen, China · Centre for Artificial Intelligence and Robotics (CAIR), Hong Kong Institute of Science & Innovation, Chinese Academy of Sciences, Hongkong, China · School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, China +2

  51. AnyBody: Free-Form Whole-Body Humanoid Control from Arbitrary Keypoint Guidance

    Jun 28, 2026Shuning Li, Sikai Li, Jiachen Li +1Robotic ControlHumanoid Robot Control

    University of North Carolina at Chapel Hill · Georgia Institute of Technology

  52. T-MOR: Learning Motion-Aware Skeleton Representations for Human Action Recognition

    Jun 19, 2026Di Yang, Mahmoud Ali, Quan Kong +2Skeleton-Based Action RecognitionRepresentation Learning

    Suzhou Institute for Advanced Research, University of Science and Technology of China, Suzhou, China · Inria Center at Universit´e Cˆote d’Azur, Valbonne, France · Woven by Toyota, Tokyo, Japan +1

  53. MotionPyramid: Hierarchical Motion Representation and Residual Interfaces

    Jun 15, 2026Gao Zhu, Zaishuo Xia, Yubei ChenLatent Action LearningHierarchical Representation Learning

    UC Davis

  54. Perfect Demo Makes Poor Teacher: Learning Robust Alignment from Critical Motion Segments

    Jun 14, 2026Mingyu Liu, Zeju Li, Jiuhe Shu +4Robot Skill LearningRobotic Manipulation

    Zhejiang University · Hong Kong University of Science and Technology (GZ) · Shanghai Innovation Institute

  55. Decoupled Motion Representation Learning for Moving Infrared Small Target Detection

    Jun 13, 2026Guoyi Zhang, Peiwen Wu, Han Wang +2Representation LearningInfrared Small Target Detection

    School of Aeronautics and Astronautics, Sun Yat-sen University, Shenzhen 518107, Guangdong, China

  56. MotionVLA: Vision-Language-Action Model for Humanoid Motion

    Jun 13, 2026Nonghai Zhang, Siyu Zhai, Yanjun Li +5Text-to-Motion GenerationHuman Motion Generation

    School of Computer Science, Peking University · AI2 Robotics

  57. μ0μ_0: A Scalable 3D Interaction-Trace World Model

    Jun 11, 2026Seungjae Lee, Yoonkyo Jung, Jusuk Lee +6World Models for RoboticsGeneralization in Robotic Manipulation

    University of Maryland, College Park · Seoul National University

  58. TopoCap: Learning Topology-Agnostic Motion Priors for Monocular Video-to-Animation

    Jun 10, 2026Cheng-Feng Pu, Jia-Peng Zhang, Meng-Hao Guo +2Markerless Motion CaptureMotion Retargeting

  59. PHASOR: Phase-Anchored Universal Action Representations for Humanoid Embodiments

    Jun 1, 2026Kihyun Kim, Chaeyun Kim, Jongho Shin +4Latent Action LearningRepresentation Learning

    AIM Intelligence · Seoul National University · LG Electronics +2

  60. The TIME Machine: On The Power of Motion for Efficient Perception

    May 21, 2026Mantas Skackauskas, Xinyue Hao, Laura Sevilla-LaraRepresentation LearningVideo Representation Learning

    School of Informatics University of Edinburgh