Multi-Object Tracking

Also known as MOT

Ask about this topic

Overview

Multi-object tracking studies how to detect multiple objects and keep their identities consistent as they move, disappear, and reappear in video, supporting applications such as autonomous driving, surveillance, and biological monitoring. Common approaches combine detection with motion prediction and data association, using tools such as Kalman filters, appearance-based re-identification, and graph matching; newer end-to-end Transformer and query-based trackers learn detection and association together. Evaluation spans crowded pedestrian benchmarks such as MOT17, MOT20, and DanceTrack, as well as 3D driving, aerial, multi-camera, and specialized animal or cell-tracking settings. A central challenge is preserving identities under long occlusions, dense interactions, and domain shifts while keeping methods efficient and making benchmark scores reflect real deployment conditions.

Latest papers

CardsList

189 papers19 papers in the last four weeks, down 41% on the four weeks before. 0.1% of all new papers.

  1. Out of Sight, Out of Track: Adversarial Attacks on Propagation-based Multi-Object Trackers via Query State Manipulation

    Apr 1, 2026Halima Bouzidi, Haoyu Liu, Yonatan Gizachew Achamyeleh +2Adversarial AttacksMulti-Object Tracking

    University of California, Irvine, CA, USA

  2. Multi-AUV Ad-hoc Networks-Based Multi-Target Tracking Based on Scene-Adaptive Embodied Intelligence

    Mar 28, 2026Kai Tian, Jialun Wang, Chuan Lin +4Multi-Object TrackingUnderwater Robotics

    Software College, Northeastern University, Shenyang, China. · Key Laboratory of Maritime Intelligent Network Information Technology, Ministry of Education, Hohai University.

  3. COVTrack++: Learning Open-Vocabulary Multi-Object Tracking from Continuous Videos via a Synergistic Paradigm

    Mar 25, 2026Zekun Qian, Wei Feng, Ruize Han +1Visual Object TrackingMulti-Object Tracking

    School of Computer Science and Technology, Tianjin University, Tianjin, China · Department of Computer Science, City University of Hong Kong, Hong Kong SAR, China · Faculty of Computer Science and Artificial Intelligence, Shenzhen University of Advanced Technology

  4. Generalized multi-object classification and tracking with sparse feature resonator networks

    Mar 23, 2026Lazar Supic, Alec Mullen, E. Paxon FradyObject-Centric Representation LearningMulti-Object Tracking

    Redwood Center for Theoretical Neuroscience, UC Berkeley · Neuromorphic Computing Lab, Intel

  5. Dual-level Adaptation for Multi-Object Tracking: Building Test-Time Calibration from Experience and Intuition

    Mar 23, 2026Wen Guo, Pengfei Zhao, Zongmeng Wang +2Multi-Object TrackingTest-Time Adaptation

    Shandong Technology and Business University · Inner Mongolia University · University of Science and Technology Beijing +1

  6. VSD-MOT: End-to-End Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Distillation

    Mar 21, 2026Jun DuMulti-Object TrackingVisual Object Tracking

  7. Inst4DGS: Instance-Decomposed 4D Gaussian Splatting with Multi-Video Label Permutation Learning

    Mar 19, 2026Yonghan Lee, Dinesh Manocha3D Gaussian SplattingInstance Segmentation

    University of Maryland, College Park, USA

  8. ModTrack: Sensor-Agnostic Multi-View Tracking via Identity-Informed PHD Filtering with Covariance Propagation

    Mar 16, 2026Aditya Iyer, Jack Roberts, Nora AyanianMulti-Object TrackingUncertainty-Aware Multimodal Fusion

    Department of Computer Science, Brown University, Providence, RI, USA · School of Engineering, Brown University, Providence, RI, USA

  9. Context-Aware Sensor Modeling for Asynchronous Multi-Sensor Tracking in Stone Soup

    Mar 16, 2026Martin Vonheim Larsen, Kim MathiassenRadar-LiDAR FusionMulti-Object Tracking

    Norwegian Defence Research Establishment (FFI) · University of Oslo, Department of Technology Systems

  10. QTrack: Query-Driven Reasoning for Multi-modal MOT

    Mar 14, 2026Tajamul Ashraf, Tavaheed Tariq, Sonia Yadav +4Referring MOTMultimodal Visual Object Tracking

    King Abdullah University of Science and Technology (KAUST), Saudi Arabia · Gaash Research Lab, National Institute of Technology Srinagar, India · The University of Queensland, Australia

  11. TSDCRF: Balancing Privacy and Multi-Object Tracking via Time-Series CRF and Normalized Control Penalty

    Mar 14, 2026Bo Ma, Jinsong Wu, Weiqi YanMulti-Object TrackingDifferential Privacy

    School of Mathematics and Computer Engineering, Auckland University of Technology,Auckland 1024, New Zealand · Department of Electrical Engineering, University of Chile, Santiago, Chile

  12. FC-Track: Overlap-Aware Post-Association Correction for Online Multi-Object Tracking

    Mar 13, 2026Cheng Ju, Zejing Zhao, Akio NamikiMulti-Object TrackingData Association

    Graduate School of Engineering, Chiba University, Chiba 263-8522 Japan.

  13. Unsupervised LiDAR-Based Multi-UAV Detection and Tracking Under Extreme Sparsity

    Mar 12, 2026Nivand Khosravi, Rodrigo Ventura, Meysam BasiriUAV DetectionAerial Object Detection

    Instituto Superior T´ecnico, University of Lisbon, Lisbon, Portugal

  14. Distributed Kalman--Consensus Filtering with Adaptive Uncertainty Weighting for Multi-Object Tracking in Mobile Robot Networks

    Mar 11, 2026Niusha Khosravi, Rodrigo Ventura, Meysam BasiriMulti-Object TrackingMulti-Robot Systems

    Instituto Superior Técnico University of Lisbon Lisbon, Portugal

  15. OccTrack360: 4D Panoptic Occupancy Tracking from Surround-View Fisheye Cameras

    Mar 9, 2026Yongzhi Lin, Kai Luo, Yuanfan Zheng +4Autonomous Driving PerceptionSemantic Occupancy Mapping

    The authors are with the School of Artificial Intelligence and Robotics and the National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University, Changsha, China · The author is with Ant Group, Hangzhou, China. · The author is also with the State Key Laboratory of Extreme Photonics and Instrumentation, Zhejiang University, Hangzhou, China.

  16. NOVA: Next-step Open-Vocabulary Autoregression for 3D Multi-Object Tracking in Autonomous Driving

    Mar 6, 2026Kai Luo, Xu Wang, Rui Fan +1Visual Object TrackingAutonomous Driving

    School of Artificial Intelligence and Robotics and the National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University, Changsha 410082, China · College of Mechanical and Vehicle Engineering, Hunan University, Changsha 410082, China · State Key Laboratory of Intelligent Autonomous Systems, Tongji University, Shanghai 201804, China

  17. Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Tracking

    Mar 6, 2026Chunjiang Li, Jianbo Ma, Li Shen +2Multi-Object TrackingOcclusion Reasoning

    College of Computer Science, Sichuan University, Chengdu, China · Institute of Optics and Electronics, CAS, Chengdu, China

  18. Breaking Smooth-Motion Assumptions: A UAV Benchmark for Multi-Object Tracking in Complex and Adverse Conditions

    Mar 6, 2026Jingtao Ye, Kexin Zhang, Xunchi Ma +6Multi-Object Tracking

    Xidian University, School of Computer Science and Technology, China

  19. ORMOT: A Dataset and Framework for Omnidirectional Referring Multi-Object Tracking

    Mar 5, 2026Zihan Zhou, Sijia Chen, Yanqiu Yu +2Referring MOTVisual Object Tracking

    National Key Laboratory of Science and Technology on Multi-spectral Information Processing, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China

  20. Tracking Feral Horses in Aerial Video Using Oriented Bounding Boxes

    Mar 4, 2026Saeko Takizawa, Tamao Maeda, Shinya Yamamoto +1Multi-Object TrackingObject Detection

    Graduate School of Information Science, University of Hyogo, Hyogo, Japan · Research Center for Integrative Evolutionary Science, The Graduate University for Advanced Studies, Kanagawa, Japan · Institute for the Future of Human Society, Kyoto University, Kyoto, Japan

  21. SCATR: Mitigating New Instance Suppression in LiDAR-based Tracking-by-Attention via Second Chance Assignment and Track Query Dropout

    Mar 2, 2026Brian Cheong, Letian Wang, Sandro Papais +1Multi-Object Tracking3D MOT

    University of Toronto

  22. QANTIS: A Hardware-Validated Quantum Platform for POMDP Planning and Multi-Target Data Association

    Feb 28, 2026Bayram Yüksel Eker, Suayb S. Arslan, Özgür Nazlı +2Partially Observable Markov Decision ProcessesMulti-Object Tracking

    Neura Parse Ltd., London, United Kingdom · Department of Computer Engineering, Boğaziçi University, Istanbul, Turkey · İzmir Ekonomi Üniversitesi, İzmir, Turkey +2

  23. Phys-3D: Physics-Constrained Real-Time Crowd Tracking and Counting on Railway Platforms

    Feb 26, 2026Bin Zeng, Johannes Künzel, Anna Hilsmann +1Crowd CountingMulti-Object Tracking

    Visual Computing Group, Humboldt University Berlin, Unter den Linden 6, 10099 Berlin, Germany · Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute, HHI, Einsteinufer 37, 10587 Berlin, Germany

  24. RT-RMOT: A Dataset and Framework for RGB-Thermal Referring Multi-Object Tracking

    Feb 25, 2026Yanqiu Yu, Zhifan Jin, Sijia Chen +4Referring MOTVisual Object Tracking

    Huazhong University of Science and Technology, Wuhan, Hubei, China · South-Central Minzu University, Wuhan, Hubei, China

  25. A Computer Vision Framework for Multi-Class Detection and Tracking in Soccer Broadcast Footage

    Feb 17, 2026Daniel TshianiSports Video AnalysisSoccer Analytics

  26. DRMOT: A Dataset and Framework for RGBD Referring Multi-Object Tracking

    Feb 4, 2026Sijia Chen, Shaofeng Liang, Lijuan Ma +7Referring MOTMulti-Object Tracking

    Huazhong University of Science and Technology · South-Central Minzu University

  27. Generative Semantic Multi-Object Tracking: A Large-Scale Benchmark and an MLLM-Driven Reasoning Framework

    Jan 10, 2026Pan Liao, Feng Yang, Di Wu +3Multimodal Large Language ModelsMLLM Reasoning

  28. LeafTrackNet: A Deep Learning Framework for Robust Leaf Tracking in Top-Down Plant Phenotyping

    Dec 15, 2025Shanghua Liu, Majharulislam Babor, Christoph Verduyn +4Agricultural Image AnalysisPlant Phenotyping

    Leibniz Institute for Agricultural Engineering and Bioeconomy, Germany · BASF Belgium Coordination Center CommV, Belgium · BASF Metabolome Solutions GmbH, Germany +2

  29. SelfMOTR: Revisiting MOTR with Self-Generating Detection Priors

    Nov 25, 2025Fabian Gülhan, Emil Mededovic, Yuli Wu +1Multi-Object Tracking

    Chair of Imaging and Computer Vision, RWTH Aachen University, Germany · Heinrich Heine University Düsseldorf, Faculty of Mathematics and Natural Sciences, Machine Learning for Medical Data, Germany

  30. GenTrack2: An Improved Hybrid Approach for Multi-Object Tracking

    Oct 28, 2025Toan Van Nguyen, Rasmus G. K. Christiansen, Dirk Kraft +1Multi-Object TrackingParticle Filtering

    SDU Robotics, University of Southern Denmark