Overview

3D point tracking follows points on objects or across whole scenes through video, recovering their motion in three dimensions rather than only in image coordinates. Methods combine visual correspondence with depth, multi-view geometry, point-cloud motion, and temporal constraints; newer approaches also adapt video foundation models, diffusion transformers, and state-space models for feed-forward or long-range tracking. The task supports dynamic-scene reconstruction, motion analysis, and robot learning, and is evaluated on benchmarks such as TAPVid-3D, PointOdyssey, KITTI, and nuScenes. A central challenge is maintaining accurate geometry and point identity through occlusion and long sequences without making inference too slow or memory-intensive.

Latest papers

CardsList

36 papers5 papers in the last four weeks, down 44% on the four weeks before. 0.0% of all new papers.

  1. π4π^4: A Foundation Model for 4D Scene Geometry and Motion

    Nov 17, 2026Yifan Wang, Weiguang Zhao, Ni Yang +44D Scene UnderstandingMulti-View 3D Reconstruction

  2. Generative AI models for exploring diffusion dynamics from multi-frame particle tracking

    Nov 12, 2026Jianan Wei, Qiang Zhang, Hao Sun +23D Point TrackingDiffusion Models

  3. Track4D: Representing Dense 3D Tracking for Video Diffusion Models

    Nov 11, 2026Yushi Lan, Zeren Jiang, Kelvin Li +33D Point TrackingVideo Diffusion Models

  4. SurgTAP-3D: A Large-Scale Cross-Surgery Video Dataset with Contact-Aware 3D Motion Tracking

    Nov 8, 2026Jiaxin Guo, Wenzhen Dong, Taoyu Wu +93D Point TrackingSurgical Instrument Tracking

  5. ReLift: Dense 3D Tracking as Lifted Trajectory Repair

    Oct 30, 2026Assaf Singer, Maroun Khriesh, Noam Rotstein +23D Point Tracking

  6. Gen4P: Video Generators are 4D Perceivers

    Oct 15, 2026Yitong Xia, Zeren Jiang, Chuanxia ZhengVideo Depth Estimation4D Scene Understanding

  7. Dense4D: Pixel-Level 4D Human Correspondence

    Oct 15, 2026Rıza Alp Güler3D Point TrackingNon-Rigid Shape Correspondence

  8. MoSE3: Learning World-Space SE(3) at Every Pixel

    Oct 2, 2026Jiahuan Cheng, Zhiyi Li, Tian Xia +33D Point Tracking

  9. SCOPE-4D: Endoscopic 4D Geometry Foundation Models

    Oct 1, 2026Chaoyi Zhou, Zhongpai Gao, Anwesa Choudhuri +6Endoscopic 3D ReconstructionEndoscopy

  10. ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wild

    Oct 1, 2026Ilya Fradlin, Christian Schmidt, Jens Piekenbrinck +33D Point TrackingDynamic Scene Reconstruction

  11. 3D Point Tracking with State Space Models

    Sep 27, 2026Masahiro Ogawa, Qi An, Atsushi YamashitaPoint Tracking3D Point Tracking

  12. GAUGE: Group-Wise View-Inconsistency Rectification for Feed-Forward 4D Tracking

    Sep 26, 2026Zhuoqian Feng, Weixing Chen, Ziliang Chen +23D Point Tracking

  13. TrackEverything: Long Horizon Dense Tracking via De-Duplicating 3D Scene Representations

    Sep 24, 2026Ayush Jain, Sreeharsha Paruchuri, Ishita Gupta +5Point Tracking3D Point Tracking

  14. JAMB: Joint Action-Motion Diffusion for Bimanual Manipulation

    Sep 21, 2026Chuyang Xiao, Peilin Meng, David Held3D Point TrackingBimanual Robotic Manipulation

  15. Field Tracking of Insects Using a Stereoscopic Event-Based Camera Setup

    Sep 18, 2026Pratham G. Shenwai, Martin J. Lankheet, John T. Hrynuk +3Visual Object TrackingEvent-Based Vision

  16. PointZero: 3D Point Track Completion for Learning Transferable 3D Dynamics

    Sep 16, 2026Bardienus P. Duisterhof, Kaifeng Zhang, Adam Hung +53D Point Tracking3D Representation Learning

  17. SAVTrack: Selective Vote Aggregation for Reliability-Aware Point Cloud Tracking

    Sep 15, 2026Sifan Zhou, Linyue Tan, Qiwei Wang +2Point Tracking3D Point Tracking

  18. Point4D: Long-range 4D Motion Reconstruction

    Sep 8, 2026Minsik Jeon, Jay Karhade, Deva Ramanan +1Point Tracking3D Point Tracking

  19. TFTrack: A Template-Free Framework for Efficient 3D Point Cloud Tracking

    Sep 7, 2026Zhaofeng Hu, Sifan Zhou, Jiahao Nie +33D Point TrackingVisual Object Tracking

  20. TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Views

    Sep 1, 2026Skanda Koppula, Frano Rajic, Abdullah Faiz Ur Rahman +9Point Tracking3D Point Tracking

  21. Geometry Beats Estimated Depth: RGB-Only Multi-Camera 3D Tracking under Sim2Real

    Aug 4, 2026Abdullah Naeem, Anav Katwal, Ayon Dey +2Synthetic-to-Real Domain Adaptation3D Point Tracking

  22. OmniX: Any-view and Any-time 4D Reconstruction via Feed-forward Trajectory Fields

    Jul 12, 2026Yanqin Jiang, Tengfei Wang, Zhengwei Wang +63D Point Tracking4D Reconstruction

  23. E-TraMamba: A New Paradigm for Efficient Long-Term 3D Feature Tracking with Event Cameras

    Jul 3, 2026Juwei Shen, Yujie Wu, Changwen ChenPoint TrackingEvent-Based Vision

  24. LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videos

    May 17, 2026Chenyi Xu, Yihao Wu, Liqi Yan +43D Point Tracking4D Reconstruction

  25. TrackCraft3R: Repurposing Video Diffusion Transformers for Dense 3D Tracking

    May 12, 2026Jisu Nam, Jahyeok Koo, Soowon Son +4Point Tracking3D Point Tracking

  26. QueST: Persistent Queries as Semantic Monitors for Drift Suppression in Long-Horizon Tracking

    May 10, 2026Mayank Anand, Mohammad Saqlain, Kyan Mahajan +33D Point TrackingMulti-Object Tracking

  27. Syn4D: A Multiview Synthetic 4D Dataset

    May 6, 2026Zeren Jiang, Yushi Lan, Yihang Luo +83D Point Tracking4D Reconstruction

  28. Genie 4D: Semantic-Prior-Guided 4D Dynamic Scene Reconstruction

    Apr 10, 2026Yiru Yang, Zhuojie Wu, Nishant Kumar Singh +14D ReconstructionDynamic Scene Reconstruction

  29. 4D Vessel Reconstruction for Benchtop Thrombectomy Analysis

    Apr 8, 2026Ethan Nguyen, Javier Carmona, Arisa Matsuzaki +24D ReconstructionDeformable Shape Reconstruction