Multi-Object Tracking

Also known as MOT

Ask about this topic

Overview

Multi-object tracking studies how to detect multiple objects and keep their identities consistent as they move, disappear, and reappear in video, supporting applications such as autonomous driving, surveillance, and biological monitoring. Common approaches combine detection with motion prediction and data association, using tools such as Kalman filters, appearance-based re-identification, and graph matching; newer end-to-end Transformer and query-based trackers learn detection and association together. Evaluation spans crowded pedestrian benchmarks such as MOT17, MOT20, and DanceTrack, as well as 3D driving, aerial, multi-camera, and specialized animal or cell-tracking settings. A central challenge is preserving identities under long occlusions, dense interactions, and domain shifts while keeping methods efficient and making benchmark scores reflect real deployment conditions.

Latest papers

CardsList

189 papers19 papers in the last four weeks, down 41% on the four weeks before. 0.1% of all new papers.

  1. Fast Instinct, Slow Reason: A Dual-Speed Agentic Framework for Self-Configuring Multi-Object Tracking in Satellite Video

    Oct 24, 2026Fan He, Baining Wu, Yan Li +1Multi-Object Tracking

    State Key Laboratory of Integrated Chips and Systems, Fudan University, Shanghai 200433, China

  2. WildDepth-v2: A Synchronized RGB--LiDAR--Radar Dataset and Benchmark for Metric Depth, Motion, and Tracking of Wildlife

    Oct 22, 2026Muhammad Aamir, Sangyun Shin, Naoya Muramatsu +4Metric Depth EstimationWildlife Monitoring

    Department of Computer Science, University of Oxford, Oxford, UK · University of Cape Town, Cape Town, South Africa · Wildlife Conservation Research Unit, Department of Biology, University of Oxford, UK +1

  3. Decentralized Multi-View, Multi-Zone Tracking for Scalable Camera Networks

    Oct 20, 2026David Voihanski, Mor Sinai, Ben Zion BobrovskyMulti-Object Tracking

    Juganu, Or Yehuda, Israel · Tel Aviv University, Israel

  4. Cross-Visibility-Gap Identity Persistence for 4D Scene Graphs

    Oct 20, 2026Jiahui Hu, Li Gao, Yu Liu +14D Scene UnderstandingMulti-Object Tracking

    Department of Computer Science, The University of Hong Kong · Chongqing University · Department of Computing, The Hong Kong Polytechnic University

  5. Normalizing Flow for Neural-Enhanced Track-Before-Detect

    Oct 18, 2026Shaoxiu Wei, Bhaskar Rao, Florian MeyerMulti-Object TrackingBayesian Filtering

    University of California San Diego, La Jolla, CA

  6. Spectral-Aware Proposal Enhancement for Diffusion-Based Multispectral UAV Multi-Object Tracking

    Oct 17, 2026Xu Lin, Tingfa Xu, Tianhao Li +4Multi-Object Tracking

    Beijing Institute of Technology, Beijing 100081, China. · Beijing Institute of Technology Chongqing Innovation Center, Chongqing 401135, China.

  7. ARC-SORT: Adaptive, Robust, Compensated Multi-Object Tracking with Interacting Multiple Models

    Oct 15, 2026Girish Kumar AdariMulti-Object Tracking

    Athlitix Inc.

  8. The Impact of Detector Architecture, Model Scale, and Scene Density on Multi-Pedestrian Tracking

    Oct 14, 2026Pedro Manoel Herminio Alves, Dalton Cézane Gomes Valadares, Cláudio de Souza BaptistaMulti-Object TrackingObject Detection

    Federal University of Campina Grande, Brazil · Federal University of Paraíba, Brazil

  9. CowCare: A Unified Visual Framework for Viewpoint-Robust Cattle Tracking and Spatiotemporal Heat-Stress Analysis

    Oct 10, 2026Xin Liu, Weiran Li, Minghao Zhu +2Precision Livestock FarmingAgricultural Image Analysis

    College of Information and Electrical Engineering, China Agricultural University, Beijing, 100083, China · National Innovation Center for Digital Fishery, Ministry of Agriculture and Rural Affairs, Beijing, 100083, China · Key Laboratory of Smart Farming Technologies for Aquatic Animal and Livestock, Ministry of Agriculture and Rural Affairs, Beijing, 100083, China +1

  10. Multi-Modal Graph Neural Network-Inspired Vessel Identification and Tracking for UAV-Based Maritime Surveillance

    Oct 9, 2026Chenjie Zhao, Jiangtian Nie, Jiawen Kang +2Maritime SurveillanceMulti-Object Tracking

    Sanya Science and Education Innovation Park of Wuhan University of Technology, Sanya 572025, China · School of Navigation, Wuhan University of Technology, Wuhan 430063, China · School of Natural and Computing Sciences, University of Aberdeen, Aberdeen AB24 3UE, U.K. +2

  11. MOTIP2: Spatial Priors for End-to-End Multi-Object Tracking

    Oct 7, 2026Benoît Roussel, Damien Bouet, Liming Chen +1Multi-Object TrackingData Association

    École Centrale de Lyon LIRIS, UMR CNRS 5205 Lyon, France · IDEMIA Courbevoie, France

  12. Referring Multi-Object Tracking in Moving-Camera Videos via Global Motion Compensation

    Oct 3, 2026Hsin-Chen Pai, Jyun-Kai Wang, Yi-Cheng Peng +1Camera Motion UnderstandingReferring MOT

    National Cheng Kung University, Tainan, Taiwan

  13. Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environments

    Oct 1, 2026Dominik Wojcikiewicz, Diego Paez-GranadosMulti-Object Tracking

    Digital Health Care and Rehabilitation, Swiss Paraplegic Research (SPF), Switzerland

  14. ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wild

    Oct 1, 2026Ilya Fradlin, Christian Schmidt, Jens Piekenbrinck +33D Point TrackingDynamic Scene Reconstruction

    RWTH Aachen University

  15. Towards Automatic Video Annotation with ASH: Zero-Shot Open-Vocabulary Multi-Object Tracking and Segmentation

    Oct 1, 2026Arash Rocky, Q. M. Jonathan WuVideo Object SegmentationInstance Segmentation

    Department of Electrical and Computer Engineering, University of Windsor, Windsor, ON, N9B 3P4, Canada

  16. ByteTraX: Enhancing the ByteTrack Architecture with Optimised Thresholding

    Sep 29, 2026Thomas A. O'Shea-WhellerData AssociationMulti-Object Tracking

    University of Exeter

  17. UGO: Unified Architecture for General Multi-Object Tracking by Segmentation

    Sep 29, 2026Jer Pelhan, Alan Lukezic, Matej KristanInstance SegmentationMulti-Object Tracking

    Faculty of Computer and Information Science, University of Ljubljana

  18. ReWorld-Track: A Recursive Event World Model for Language-Guided Multi-Camera Tracking

    Sep 29, 2026Haoyang Wu, Shoudong Han, Chaoyue Li +3World Model LearningState Tracking

    Huazhong University of Science and Technology · Jiangxi University of Water Resources and Electric Power · Zhongnan University of Economics and Law

  19. VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Tracking

    Sep 28, 2026Zhizhen Li, Zan Wang, Huidong Peng +4Data AssociationMulti-Object Tracking

    Dalian University of Technology · Wuhan University · University of North Texas +1

  20. Identity-Assisted Association of Unordered DOA Estimates for Neural Speech Source Tracking

    Sep 27, 2026Bing Yang, Di Liang, Xiaofei LiMulti-Object Tracking

    School of Engineering, Westlake University, Hangzhou, China · School of Artificial Intelligence, Tianjin University, Tianjin, China · Zhejiang University, Hangzhou, China +1

  21. PanoPed: Beyond Bounding Boxes for Sim-to-Real Panoramic Pedestrian Tracking

    Sep 25, 2026Qinfeng Zhu, Weiguang Zhao, Yunxi Jiang +2Visual Object TrackingMulti-Object Tracking

    Xi’an Jiaotong-Liverpool University · University of Liverpool · Duke Kunshan University +1

  22. LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT

    Sep 23, 2026Grégoire Francisco, Alessandro D'Amico, Samuele Costantini +2Visual Object TrackingMulti-Object Tracking

    Toyota Motor Europe, Zaventem, Belgium

  23. A Systematic Evaluation of Infrastructure-Based Radar System for Highway Traffic Monitoring

    Sep 22, 2026Tianheng Zhu, Woei-chyi Chang, Alamss Riaz +2Intelligent Transportation SystemsTraffic Flow Estimation

    Lyles School of Civil and Construction Engineering Purdue University, West Lafayette, IN, USA

  24. Identity-Centric Video Summarization via Hierarchical Fusion of Biometric, Appearance, and 3D Body Features

    Sep 22, 2026Milad Mirjalili, Enrique Alegre Gutiérrez, Eduardo Fidalgo Fernández +3Video SummarizationMulti-Object Tracking

    Group for Vision and Intelligent Systems, Institute for Research and Innovation in Engineering (I4), Universidad de León, 24071, León, Spain

  25. Identity-Consistent Analysis of Long-Shot Windsurfing Video: A Domain-Specific Offline Tracking System

    Sep 21, 2026Bertil BraunSports Video AnalysisMulti-Object Tracking

  26. DOA-SORT: Directional Occlusion-Aware Multi-Object Tracking with Distributional Observations

    Sep 19, 2026Hao WangMulti-Object TrackingData Association

    BDNRC

  27. Do Spinning Radar Doppler Velocity Measurements Improve Vehicle Detection and Tracking?

    Sep 17, 2026Eric Xie, Daniil Lisus, Timothy D. BarfootAutonomous Driving PerceptionObject Detection

    Robotics Institute, University of Toronto, Canada

  28. On-the-Fly Homographies Calibration for Multi-Camera Tracking

    Sep 16, 2026David Voihanski, Mor Sinai, Ben Zion BobrovskyMulti-View GeometryCamera Calibration

    Juganu Or Yehuda, Israel · Tel Aviv University Israel

  29. Online Multi-Camera 3D Tracking via ID Prediction over Recurrent Sparse Queries

    Sep 16, 2026Pragyan Shrestha, Haruto Nakayama, Atom Scott3D MOTMulti-Object Tracking

    Playbox Inc., Tokyo, Japan

  30. Understanding Dynamic Scenes at Gigapixel Scale: Wide-Area Spatio-Temporal Perception from UAVs

    Sep 16, 2026Yuhang Zhu, Meiyi Zhu, Yunkai Dang +4Remote SensingUAV Remote Sensing

    Nanjing University