Overview

3D point tracking follows points on objects or across whole scenes through video, recovering their motion in three dimensions rather than only in image coordinates. Methods combine visual correspondence with depth, multi-view geometry, point-cloud motion, and temporal constraints; newer approaches also adapt video foundation models, diffusion transformers, and state-space models for feed-forward or long-range tracking. The task supports dynamic-scene reconstruction, motion analysis, and robot learning, and is evaluated on benchmarks such as TAPVid-3D, PointOdyssey, KITTI, and nuScenes. A central challenge is maintaining accurate geometry and point identity through occlusion and long sequences without making inference too slow or memory-intensive.

Latest papers

CardsList

30 papers5 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. Gen4P: Video Generators are 4D Perceivers

    Oct 15, 2026Yitong Xia, Zeren Jiang, Chuanxia ZhengVideo Depth Estimation4D Scene Understanding

  2. Dense4D: Pixel-Level 4D Human Correspondence

    Oct 15, 2026Rıza Alp Güler3D Point TrackingNon-Rigid Shape Correspondence

  3. MoSE3: Learning World-Space SE(3) at Every Pixel

    Oct 2, 2026Jiahuan Cheng, Zhiyi Li, Tian Xia +33D Point Tracking

  4. SCOPE-4D: Endoscopic 4D Geometry Foundation Models

    Oct 1, 2026Chaoyi Zhou, Zhongpai Gao, Anwesa Choudhuri +6Endoscopic 3D ReconstructionEndoscopy

  5. ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wild

    Oct 1, 2026Ilya Fradlin, Christian Schmidt, Jens Piekenbrinck +33D Point TrackingDynamic Scene Reconstruction

  6. 3D Point Tracking with State Space Models

    Sep 27, 2026Masahiro Ogawa, Qi An, Atsushi YamashitaPoint Tracking3D Point Tracking

  7. GAUGE: Group-Wise View-Inconsistency Rectification for Feed-Forward 4D Tracking

    Sep 26, 2026Zhuoqian Feng, Weixing Chen, Ziliang Chen +23D Point Tracking

  8. TrackEverything: Long Horizon Dense Tracking via De-Duplicating 3D Scene Representations

    Sep 24, 2026Ayush Jain, Sreeharsha Paruchuri, Ishita Gupta +5Point Tracking3D Point Tracking

  9. JAMB: Joint Action-Motion Diffusion for Bimanual Manipulation

    Sep 21, 2026Chuyang Xiao, Peilin Meng, David Held3D Point TrackingBimanual Robotic Manipulation

  10. Field Tracking of Insects Using a Stereoscopic Event-Based Camera Setup

    Sep 18, 2026Pratham G. Shenwai, Martin J. Lankheet, John T. Hrynuk +3Visual Object TrackingEvent-Based Vision

  11. PointZero: 3D Point Track Completion for Learning Transferable 3D Dynamics

    Sep 16, 2026Bardienus P. Duisterhof, Kaifeng Zhang, Adam Hung +53D Point Tracking3D Representation Learning

  12. SAVTrack: Selective Vote Aggregation for Reliability-Aware Point Cloud Tracking

    Sep 15, 2026Sifan Zhou, Linyue Tan, Qiwei Wang +2Point Tracking3D Point Tracking

  13. Point4D: Long-range 4D Motion Reconstruction

    Sep 8, 2026Minsik Jeon, Jay Karhade, Deva Ramanan +1Point Tracking3D Point Tracking

  14. TFTrack: A Template-Free Framework for Efficient 3D Point Cloud Tracking

    Sep 7, 2026Zhaofeng Hu, Sifan Zhou, Jiahao Nie +33D Point TrackingVisual Object Tracking

  15. TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Views

    Sep 1, 2026Skanda Koppula, Frano Rajic, Abdullah Faiz Ur Rahman +9Point Tracking3D Point Tracking

  16. Geometry Beats Estimated Depth: RGB-Only Multi-Camera 3D Tracking under Sim2Real

    Aug 4, 2026Abdullah Naeem, Anav Katwal, Ayon Dey +2Synthetic-to-Real Domain Adaptation3D Point Tracking

  17. OmniX: Any-view and Any-time 4D Reconstruction via Feed-forward Trajectory Fields

    Jul 12, 2026Yanqin Jiang, Tengfei Wang, Zhengwei Wang +63D Point Tracking4D Reconstruction

  18. E-TraMamba: A New Paradigm for Efficient Long-Term 3D Feature Tracking with Event Cameras

    Jul 3, 2026Juwei Shen, Yujie Wu, Changwen ChenPoint TrackingEvent-Based Vision

  19. LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videos

    May 17, 2026Chenyi Xu, Yihao Wu, Liqi Yan +43D Point Tracking4D Reconstruction

  20. TrackCraft3R: Repurposing Video Diffusion Transformers for Dense 3D Tracking

    May 12, 2026Jisu Nam, Jahyeok Koo, Soowon Son +4Point Tracking3D Point Tracking

  21. QueST: Persistent Queries as Semantic Monitors for Drift Suppression in Long-Horizon Tracking

    May 10, 2026Mayank Anand, Mohammad Saqlain, Kyan Mahajan +33D Point TrackingMulti-Object Tracking

  22. Syn4D: A Multiview Synthetic 4D Dataset

    May 6, 2026Zeren Jiang, Yushi Lan, Yihang Luo +83D Point Tracking4D Reconstruction

  23. Genie 4D: Semantic-Prior-Guided 4D Dynamic Scene Reconstruction

    Apr 10, 2026Yiru Yang, Zhuojie Wu, Nishant Kumar Singh +14D ReconstructionDynamic Scene Reconstruction

  24. 4D Vessel Reconstruction for Benchtop Thrombectomy Analysis

    Apr 8, 2026Ethan Nguyen, Javier Carmona, Arisa Matsuzaki +24D ReconstructionDeformable Shape Reconstruction

  25. DRoPS: Dynamic 3D Reconstruction of Pre-Scanned Objects

    Mar 25, 2026Narek Tumanyan, Samuel Rota Bulò, Denis Rozumny +5Dynamic Scene ReconstructionDeformable Shape Reconstruction

  26. 4DGS360: 360° Gaussian Reconstruction of Dynamic Objects from a Single Video

    Mar 23, 2026Jae Won Jang, Yeonjin Chang, Wonsik Shin +2Dynamic Scene ReconstructionPanoramic 3D Reconstruction

  27. PCSTracker: Long-Term Scene Flow Estimation for Point Cloud Sequences

    Mar 20, 2026Min Lin, Gangwei Xu, Xianqi Wang +2Scene Flow Estimation3D Point Tracking

  28. TrackDeform3D: Markerless and Autonomous 3D Keypoint Tracking and Dataset Collection for Deformable Objects

    Mar 17, 2026Yeheng Zong, Yizhou Chen, Alexander Bowler +23D Point Tracking

  29. 3PoinTr: From Human Videos to Robot Policies with 3D Point-Track Plans

    Mar 9, 2026Adam Hung, Bardienus Pieter Duisterhof, Jeffrey IchnowskiHuman-to-Robot Motion ImitationRobot Policy Learning

  30. Track4World: Feedforward World-centric Dense 3D Tracking of All Pixels

    Mar 3, 2026Jiahao Lu, Jiayi Xu, Wenbo Hu +5Scene Flow Estimation3D Point Tracking