Markerless Motion Capture

Ask about this topic

Overview

Markerless motion capture reconstructs how people move in 3D from ordinary video, multi-camera recordings, or wearable sensors, enabling measurement and animation without laboratory marker suits. Common approaches detect 2D keypoints and lift them to 3D, fit articulated body meshes, or fuse views and sensor signals; temporal models and biomechanical constraints help produce coherent, physically plausible motion. Researchers apply these methods to clinical gait and rehabilitation, sports, hand tracking, animation, and robot learning, where accessible capture can extend measurement beyond specialized labs. Accuracy is improving, but occlusion, camera and sensor variation, and differences across populations remain difficult, and many systems still need stronger clinical validation—especially for out-of-plane motion and kinetics.

Latest papers

CardsList

68 papers9 papers in the last four weeks, up 50% on the four weeks before. 0.1% of all new papers.

  1. Confidence Filtering in Video-Based Gait Assessment: Measurement Error versus Selection Shift

    Oct 29, 2026David Regev, Eran Beeri BamaniSelection BiasGait Analysis

    Department of Information Science and Applied Artificial Intelligence, Bar-Ilan University, Ramat Gan, Israel.

  2. ExMR: Extremity Motion Refinement for Monocular Human Motion Capture

    Oct 19, 2026Tom Wehrbein, Bodo Rosenhahn3D Human Reconstruction3D Human Motion Reconstruction

    Institute of Information Processing, Leibniz University Hannover, 30167 Hannover, Germany

  3. DragonMoCap: Monocular Video-based Motion Capture for Diverse Dragon Topologies

    Oct 18, 2026Zhongfei Qing, Xiaoxiang Zhao, Ling-Hao Chen +7Markerless Motion CaptureRepresentation Learning

    Tencent, Shenzhen, China · Tsinghua University, Shenzhen, China · Nanyang Technological University, Singapore, Singapore +3

  4. Bridging the Markerless Tracking Validation Gap: Intraoperative X-ray Workflow Integration

    Oct 15, 2026Connor Daly, Salvatore Russo, Jinendra Ekanayake +2Markerless Motion CaptureMedical Image Registration

    The Hamlyn Centre for Robotic Surgery, Imperial College London, London, UK · Department of Neurosurgery, Imperial College Healthcare NHS Trust, London, UK · Stanford University School of Medicine, Stanford University, California, USA

  5. EgoWholeView: Camera-Only Head-Mounted Capture of Body and Bimanual Hand Motion for Embodied Demonstrations

    Oct 12, 2026Yaoqing Hu, Xuguo He, Daohan Cui +2Markerless Motion Capture3D Human Pose Estimation

    Zhongguancun Academy · DeepCybo · Beijing University of Chemical Technology +1

  6. CAST: Real-Time Motion Capture for Any Skeleton Topology

    Oct 10, 2026Pu Pang, Zhongfei Qing, Ling-Hao Chen +3Markerless Motion Capture3D Human Pose Estimation

    Xi’an Jiaotong University, China · Zhongguancun Academy, China · Tencent, China +2

  7. Toward Reliable Infant Pose Estimation: A Training-Dynamics Approach to Noisy Annotation Detection

    Oct 5, 2026Emanuele Cardinale, Sara Moccia, Alessandro Cacciatore +1Markerless Motion CaptureNoisy-Label Learning

    Department of Engineering and Geology, Università degli Studi “G. d’Annunzio” Chieti-Pescara, Pescara, 65127, Italy · Laboratory of Computational Oncology, Department of Oncology, KU Leuven, Leuven, 3000, Belgium · Department of Political Science, Università di Teramo, Teramo, 64100, Italy +1

  8. Monocular markerless biomechanics for clinically interpretable gait assessment in spinal cord injury

    Oct 4, 2026Shreyasvi Natraj, Mathieu Ruepp, Yanke Li +3Markerless Motion CaptureGait Analysis

    Spinal Cord Artificial Intelligence (SCAI) Lab, ETH Zürich, Zürich, Switzerland · Swiss Paraplegic Research, Swiss Paraplegic Centre, Nottwil, Switzerland · University Hospital Balgrist, Zurich, Switzerland +4

  9. FlowHMR: Physically Plausible Motion Capture from Video

    Oct 2, 2026Zhanke Wang, Chengfeng Zhao, Qing Shuai +8Style-Conditioned Motion Generation3D Human Motion Reconstruction

    Peking University · The Hong Kong University of Science and Technology · Tencent +3

  10. Reliability-Gated Fusion of Consumer Head and Foot IMUs for Lower-Body 3D Pose

    Sep 28, 2026Zhilin Guo, Boqiao Zhang, Oszkár Urbán +8Markerless Motion Capture3D Human Pose Estimation

    University of Cambridge · Chalmers University of Technology

  11. GaitVista: Reliability-Aware AI Measurement toward Accessible Longitudinal Gait Assessment

    Sep 18, 2026Nethmi Jayasinghe, Mihir Parashar, Amit Ranjan TrivediGait AnalysisMultimodal Sensor Fusion

    Department of Electrical and Computer Engineering, University of Illinois Chicago, Chicago, IL, USA. · Illinois Mathematics and Science Academy, Aurora, IL, USA.

  12. Video-Based Markerless Motion Capture for Clinical and Rehabilitation Biomechanics: A PRISMA-ScR Scoping Review of Validated Architectures, Clinical Readiness, and Emerging Methods

    Sep 16, 2026Florian Delaplace, Elodie Piche, Frédéric Chorin +1Markerless Motion CaptureGait Analysis

    LAMHESS, CHU · LAMHESS, Université Côte d'Azur, Nice, France · LAMHESS +3

  13. MEgoVista: Multi-view Ego-aware Motion Estimation for Metric 4D Hands and Head in the Wild

    Sep 15, 2026Jiangong Xiao, Chao Ma, Zhihao Zhang +19Markerless Motion Capture3D Hand Pose Estimation

    Northwestern Polytechnical University · Maniformer · Xi’an Jiaotong University

  14. Cross-Model Distillation of a Human-Pose Foundation Model from Unannotated Infant Video for Markerless 3D Pose Estimation

    Sep 1, 2026R. James Cotton, Divya Joshi, Colleen Peyton3D Foundation ModelsMarkerless Motion Capture

    1Shirley Ryan AbilityLab · Department of Physical Medicine and Rehabilitation, Northwestern University · Department of Physical Therapy and Human Movement Science, Northwestern University +1

  15. Kirin: Animal Motion Generation from In-the-Wild Video

    Sep 1, 2026Brian Nlong Zhao, Zhuoyang Pan, James M. Rehg +2Markerless Motion CaptureText-to-Motion Generation

    University of Illinois Urbana-Champaign · University of Pennsylvania · Stanford University +1

  16. Seeing the World and the Self from Egocentric Video

    Sep 1, 2026Kai Guan, Minchao Jiang, Ruichen WangLi +2Markerless Motion Capture3D Reconstruction

    The Hong Kong Polytechnic University · Eastern Institute of Technology, Ningbo

  17. Biomechanical 3D Body: Self-Supervised Distillation of Biomechanical Pose from a 3D Body Foundation Model

    Aug 30, 2026R. James Cotton, J. D. Peiffer, Lucinda Williamson +2Markerless Motion CaptureHuman Mesh Recovery

    Shirley Ryan AbilityLab, Chicago, IL, USA · Biomedical Engineering, Northwestern University, Evanston, IL, USA · Biomedical Engineering, University of Illinois Chicago, Chicago, IL, USA +1

  18. Sen-Cap: Sensor-Flexible and Noise-Resilient Human Motion Capture via LiDAR-Camera Integration

    Aug 3, 2026Aoru Xue, Yujing Sun, Yiming Ren +3Markerless Motion CaptureMultimodal Robustness

    ShanghaiTech University, Shanghai, China · ShanghaiTech University, China · Digital Trust Centre, Nanyang Technological University, Singapore +1

  19. Markerless Motion Capture in Routine Clinical Upper Limb Assessments: Validity and Insights Beyond Ordinal Scoring

    Jul 26, 2026Tim Unger, Olivier Lambercy, Roger Gassert +3Markerless Motion CaptureHuman Pose Estimation

    Data Analytics & Rehabilitation Technology (DART), Lake Lucerne Institute, Vitznau, Switzerland · Rehabilitation Engineering Laboratory, ETH Zurich, Zurich, Switzerland · Lake Lucerne Institute, Vitznau, Switzerland +2

  20. Direct Clinical Joint Angle Extraction from Parametric Body Model Rotation Matrices

    Jul 20, 2026Joey Páolo Kardolus, Daan Hendriks, Jaap JansenMarkerless Motion Capture

    Babon Innovations B.V., Utrecht, The Netherlands · Research Group Lifestyle and Health, HU University of Applied Sciences Utrecht, The Netherlands

  21. EgoExoMoCap: Distributed Ego-Exo Human Motion Capture

    Jul 17, 2026Jiaxi Jiang, Bharat Lal Bhatnagar, Nan Yang +6Markerless Motion Capture3D Human Pose Estimation

    1Meta Reality Labs · *This work was done during an internship at Meta. · 2ETH Zürich

  22. EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal

    Jul 15, 2026Alex Brandes, Haig Conti Georges Sajelian, Manthan Patel +11Humanoid Robot LocomotionMarkerless Motion Capture

    ETH Zurich · TU Munich · Stanford +1

  23. Biomechanics-aware Multi-view Markerless Motion Capture of Dexterous Hand Movements

    Jul 2, 2026Pouyan Firouzabadi, J. D. Peiffer, Kunal Shah +4Markerless Motion Capture3D Hand Pose Estimation

    Biomedical Engineering Department, Northwestern University, Chicago, IL, US · Shirley Ryan AbilityLab, Chicago, IL, US · Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, US +1

  24. Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction

    Jun 28, 2026Shuaikang Zhu, Yiding Sun, Yang YangMarkerless Motion Capture3D Human Pose Estimation

    School of Electronic and Information Engineering, Xi’an Jiaotong University · School of Software Engineering, Xi’an Jiaotong University

  25. PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation

    Jun 25, 2026Yi Lu, Shenghao Ren, Tianyu Xiong +6Markerless Motion CaptureHumanoid Robot Control

    School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. · BNRist, Tsinghua University, Beijing 100084, China. · Key Laboratory of Optoelectronic Devices and Systems with Extreme Performances of MOE, Nanjing University, Nanjing 210023, China.

  26. Seeing Through Occlusion: Deterministic Arm Kinematic Correction for Robot Teleoperation

    Jun 17, 2026Thomas M. Kwok, Nicholas Koenig, Yue HuMarkerless Motion CaptureDepth Estimation

    Department of Mechanical and Mechatronics Engineering, University of Waterloo, Canada

  27. VEPHand: View-Efficient Photometric Hand Performance Capture at Scale

    Jun 14, 2026Zhengyang Shen, Kai-Hung Chang, Erroll Wood +18Markerless Motion Capture3D Hand Pose Estimation

    Google XR

  28. TopoCap: Learning Topology-Agnostic Motion Priors for Monocular Video-to-Animation

    Jun 10, 2026Cheng-Feng Pu, Jia-Peng Zhang, Meng-Hao Guo +2Markerless Motion CaptureMotion Retargeting

    Zhili College, Tsinghua University, China · BNRist, Department of Computer Science and Technology, Tsinghua University, China · VAST, China

  29. MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry

    Jun 2, 2026Yiquan Li, Taeyoung Yeon, Chenfeng Gao +3Markerless Motion CaptureInertial Odometry

    Northwestern University · University of Chicago

  30. Quantitative Movement Testing: Measuring Chronic Pain Patient Movements from a Single Smartphone Video

    Jun 1, 2026Pranav Mahajan, Amanda Wall, Eleonora Maria Camerone +7Markerless Motion Capture3D Human Pose Estimation

    Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK. · Max Planck Institute of Biological Cybernetics, Tuebingen, Germany. · Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, UK. +4