Simple Online and Realtime Tracking with a Deep Association Metric
Not on the map. Why?
Abstract (arXiv)
Simple Online and Realtime Tracking (SORT) is a pragmatic approach to multiple object tracking with a focus on simple, effective algorithms. In this paper, we integrate appearance information to improve the performance of SORT. Due to this extension we are able to track objects through longer periods of occlusions, effectively reducing the number of identity switches. In spirit of the original framework we place much of the computational complexity into an offline pre-training stage where we learn a deep association metric on a large-scale person re-identification dataset. During online application, we establish measurement-to-track associations using nearest neighbor queries in visual appearance space. Experimental evaluation shows that our extensions reduce the number of identity switches by 45%, achieving overall competitive performance at high frame rates.
Key facts. Cited by 908 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 125; 2022: 154; 2023: 156; 2024: 192; 2025: 160; 2026: 120.
908 papers.
Sort:
By area:
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2021A Survey of Human-in-the-loop for Machine Learningcited by 214
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2023Towards Open Vocabulary Learning: A Surveycited by 165
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
38 more
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 130
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
- 2021Learning to Track with Object Permanencecited by 117
- 2022MeMOT: Multi-Object Tracking with Memorycited by 113
- 2021SimpleTrack: Understanding and Rethinking 3D Multi-object Trackingcited by 102
- 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2023Referring Multi-Object Trackingcited by 91
- 2022MUTR3D: A Multi-camera Tracking Framework via 3D-to-2D Queriescited by 90
- 2021Face Forensics in the Wildcited by 87
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
- 2021Crossover Learning for Fast Online Video Instance Segmentationcited by 83
- 2021Monocular Quasi-Dense 3D Object Trackingcited by 80
- 2022Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentationcited by 79
- 2023General Object Foundation Model for Images and Videos at Scalecited by 71
- 2021A Survey on Interpretable Reinforcement Learningcited by 70
- 2021Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoningcited by 68
- 2021Multiple Object Tracking with Correlation Learningcited by 67
- 2022Hard to Track Objects with Irregular Motions and Similar Appearances? Make It Easier by Buffering the Matching Spacecited by 66
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
- 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
- 2021SiamMOT: Siamese Multi-Object Trackingcited by 62
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
- 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
- 2022QDTrack: Quasi-Dense Similarity Learning for Appearance-Only Multiple Object Trackingcited by 61
- 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
- 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 58
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2021DEFT: Detection Embeddings for Trackingcited by 56
- 2022APT-36K: A Large-scale Benchmark for Animal Pose Estimation and Trackingcited by 55
- 2023Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Trackingcited by 54
- 2023OVTrack: Open-Vocabulary Multiple Object Trackingcited by 53
- 2021RelationTrack: Relation-aware Multiple Object Tracking with Decoupled Representationcited by 52
- 2022CAMO-MOT: Combined Appearance-Motion Optimization for 3D Multi-Object Tracking with Camera-LiDAR Fusioncited by 50
- 2024Matching Anything by Segmenting Anythingcited by 49
- 2021Predicting Pedestrian Crossing Intention with Feature Fusion and Spatio-Temporal Attentioncited by 48
50 most cited of 908 All 908 (JSON)
- 2026ByteTraX: Enhancing the ByteTrack Architecture with Optimised Thresholding29 Sep 2026
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026ReWorld-Track: A Recursive Event World Model for Language-Guided Multi-Camera Tracking29 Sep 2026
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026Identity-Centric Video Summarization via Hierarchical Fusion of Biometric, Appearance, and 3D Body Features22 Sep 2026
- 2026Identity-Consistent Analysis of Long-Shot Windsurfing Video: A Domain-Specific Offline Tracking System21 Sep 2026
- 2026DOA-SORT: Directional Occlusion-Aware Multi-Object Tracking with Distributional Observations19 Sep 2026
- 2026Online Multi-Camera 3D Tracking via ID Prediction over Recurrent Sparse Queries16 Sep 2026
- 2026Tracking the Unseen: An Occlusion-Robust Framework for Target Tracking Under Full and Long-Term Occlusion15 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026CatchMonitor: a machine learning system for automated fish discard quantification14 Sep 2026
- 2026EECTracker: Swarm Motion Prior-Guided Feature Compensation for Airborne Optical UAV Swarm Tracking14 Sep 2026
38 more
- 2026Revisiting Multi-Object Tracking Baselines: Hyperparameter Optimization with Multi-Fidelity Greedy Coordinate Search10 Sep 2026
- 2026Tracking-by-detection in Multi-object Tracking: Survey and Experiments8 Sep 2026
- 2026Re-engineering SORT-based algorithms for low-cost small object tracking from omnidirectional footage7 Sep 2026
- 2026Unified Vision-Centric Pedestrian Crossing Action Prediction via Adaptive Patch Projection and Proactive Spatial Rectification7 Sep 2026
- 2026A Two-Stage Framework for Ego-Centric Key Object Identification via Object State Prediction7 Sep 2026
- 2026An Integrated Video-AI Platform for Action-Level Microanastomosis Training and Performance Feedback6 Sep 2026
- 2026Cross-Domain Tracker Adaptation Without Target-Domain Labels via Vision-Language Agents4 Sep 2026
- 2026PuTR-CouT: Counting-by-Tracking in Camera-Trap Image Sequences4 Sep 2026
- 2026BMCTrack-d: Pig re-identification and tracking via back marks in challenging camera settings3 Sep 2026
- 2026Counting Animals in Camera-Traps Image Sequences without Count Labels: Winning Solution to the iWildCam 2021 Challenge3 Sep 2026
- 2026YesTrack: Referring Multi-Object Tracking via MLLM-based Yes/No Verification2 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026Uncertainty-Aware Trajectory Forecasting from Imperfect Tracking31 Aug 2026
- 2026Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge29 Aug 2026
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception28 Aug 2026
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts24 Aug 2026
- 2026Multi-Modal Traffic Sign Detection with Semantic Attributes for Autonomous Driving21 Aug 2026
- 2026Training-Free Long-Term Multi-Object Tracking for Sports Video Analytics16 Aug 2026
- 2026GenTrack3: Hybrid Stochastic-Deterministic Online Multi-Object Tracking with Cluster-Aware Association10 Aug 2026
- 2026Data collection from highways: a geometric, class-agnostic approach to embedded vehicle counting7 Aug 2026
- 2026Geometry Beats Estimated Depth: RGB-Only Multi-Camera 3D Tracking under Sim2Real4 Aug 2026
- 2026A Review of Vision-Based Vehicle Detection for UAV-Based Traffic Monitoring: Experimental Insights and Future Directions4 Aug 2026
- 2026Models as Tools: An Agentic Coordination Framework for Unified Multimodal Visual Tracking1 Aug 2026
- 2026CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking28 Jul 2026
- 2026Beyond Appearance: A Multi-cue Framework and Large-scale Benchmark for Pedestrian Association and Tracking on Mobile Aerial-Ground Platforms26 Jul 2026
- 2026Calibration-Free 3D Multi-Camera People Tracking for Indoor Environment22 Jul 2026
- 2026WASABI: Whole-graph Assignment-based Stabilizer for lAne topology By Inter-frame tracking22 Jul 2026
- 2026VLA-ReID: Video-Level Association for Re-Identification in Multi-Object Tracking with Highly Similar Objects19 Jul 2026
- 2026The generator is the tracker: Multi-object tracking by painting persistent identity colours19 Jul 2026
- 2026AdvSerial: Physical Adversarial Attacks on Infrastructure-mounted Pedestrian Detectors via Semantic Feature Suppression19 Jul 2026
- 2026Articulated Humanoid Head for a Robot Receptionist Capable of Natural Human Interaction19 Jul 2026
- 2026GHR-VLM: Making Zero-Shot Transit Video Analytics Realizable with Grounded Hybrid Reasoning15 Jul 2026
- 2026Higher-Order Cell Tracking Transformer13 Jul 2026
- 2026InterPet4D: A Multimodal 4D Human-Pet Interaction Dataset for Pet Motion Generation11 Jul 2026
- 2026REMIND: RE-Identification with Memory for INDoor Navigation10 Jul 2026
- 2026Moving Like a Human: Ego-Motion-Normalized Temporal Signatures for Real-Time Aerial Person Tracking on Milliwatt-Class Hardware9 Jul 2026
- 2026WaspMOT: A Benchmark for Long-Term Multi-Object Tracking of Trichogramma Wasps9 Jul 2026
- 2026SAGE: Synchronized Action-Gaze Recognition and Anticipation for Human Behavior Understanding4 Jul 2026
50 newest of 908 All 908 (JSON)
- 2024Elysium: Exploring Object-level Perception in Videos via MLLMcited by 48
- 2023Compositional Prompt Tuning with Motion Cues for Open-vocabulary Video Relation Detectioncited by 22
- 2024TrafficVLM: A Controllable Visual Language Model for Traffic Video Captioningcited by 17
- 2025Investigating Traffic Accident Detection Using Multimodal Large Language Modelscited by 1
- 2026Step-Level Visual Grounding Faithfulness Predicts Out-of-Distribution Generalization in Long-Horizon Vision-Language Modelscited by 1
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancementcited by 0
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understandingcited by 0
- 2026Training-Free Semantic Multi-Object Tracking with Vision-Language Modelscited by 0
- 2026Cross-Domain Tracker Adaptation Without Target-Domain Labels via Vision-Language Agentscited by 0
- 2026Unified Vision-Centric Pedestrian Crossing Action Prediction via Adaptive Patch Projection and Proactive Spatial Rectificationcited by 0
- 2026Unified Vision-Centric Pedestrian Crossing Action Prediction via Adaptive Patch Projection and Proactive Spatial Rectification7 Sep 2026
- 2026Cross-Domain Tracker Adaptation Without Target-Domain Labels via Vision-Language Agents4 Sep 2026
- 2026Training-Free Semantic Multi-Object Tracking with Vision-Language Models15 Apr 2026
- 2026Step-Level Visual Grounding Faithfulness Predicts Out-of-Distribution Generalization in Long-Horizon Vision-Language Models6 Mar 2026
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understanding21 Nov 2025
- 2025Investigating Traffic Accident Detection Using Multimodal Large Language Models23 Sep 2025
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancement17 Sep 2025
- 2024TrafficVLM: A Controllable Visual Language Model for Traffic Video Captioning14 Apr 2024
- 2024Elysium: Exploring Object-level Perception in Videos via MLLM25 Mar 2024
- 2023Compositional Prompt Tuning with Motion Cues for Open-vocabulary Video Relation Detection1 Feb 2023
- 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
- 2024The Crystal Ball Hypothesis in diffusion models: Anticipating object positions from initial noisecited by 18
- 2023FastBlend: a Powerful Model-Free Toolkit Making Video Stylization Easiercited by 3
- 2024LDTrack: Dynamic People Tracking by Service Robots using Diffusion Modelscited by 3
- 2024DINTR: Tracking via Diffusion-based Interpolationcited by 1
- 2024ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Modelcited by 0
- 2024DINTR: Tracking via Diffusion-based Interpolation14 Oct 2024
- 2024ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Model28 Aug 2024
- 2024The Crystal Ball Hypothesis in diffusion models: Anticipating object positions from initial noise4 Jun 2024
- 2024LDTrack: Dynamic People Tracking by Service Robots using Diffusion Models13 Feb 2024
- 2023FastBlend: a Powerful Model-Free Toolkit Making Video Stylization Easier15 Nov 2023
- 2023DiffusionTrack: Diffusion Model For Multi-Object Tracking19 Aug 2023
- 2021Pylot: A Modular Platform for Exploring Latency-Accuracy Tradeoffs in Autonomous Vehiclescited by 33
- 2022Time3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Drivingcited by 30
- 2024EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Drivingcited by 18
- 2022Real-time Full-stack Traffic Scene Perception for Autonomous Driving with Roadside Camerascited by 13
- 2026Zero-Shot Semantic Re-Identification for Autonomous Driving: A VLM Baseline Studycited by 1
- 2026Zero-Shot Semantic Re-Identification for Autonomous Driving: A VLM Baseline Study8 Jun 2026
- 2024EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Driving28 Feb 2024
- 2022Real-time Full-stack Traffic Scene Perception for Autonomous Driving with Roadside Cameras20 Jun 2022
- 2022Time3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Driving30 May 2022
- 2021Pylot: A Modular Platform for Exploring Latency-Accuracy Tradeoffs in Autonomous Vehicles16 Apr 2021
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2021A Survey of Human-in-the-loop for Machine Learningcited by 214
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2023Towards Open Vocabulary Learning: A Surveycited by 165
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
12 most cited of 877 All 877 (JSON)
- 2026ByteTraX: Enhancing the ByteTrack Architecture with Optimised Thresholding29 Sep 2026
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026Identity-Centric Video Summarization via Hierarchical Fusion of Biometric, Appearance, and 3D Body Features22 Sep 2026
- 2026Identity-Consistent Analysis of Long-Shot Windsurfing Video: A Domain-Specific Offline Tracking System21 Sep 2026
- 2026DOA-SORT: Directional Occlusion-Aware Multi-Object Tracking with Distributional Observations19 Sep 2026
- 2026Online Multi-Camera 3D Tracking via ID Prediction over Recurrent Sparse Queries16 Sep 2026
- 2026Tracking the Unseen: An Occlusion-Robust Framework for Target Tracking Under Full and Long-Term Occlusion15 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026CatchMonitor: a machine learning system for automated fish discard quantification14 Sep 2026
- 2026EECTracker: Swarm Motion Prior-Guided Feature Compensation for Airborne Optical UAV Swarm Tracking14 Sep 2026
- 2026Revisiting Multi-Object Tracking Baselines: Hyperparameter Optimization with Multi-Fidelity Greedy Coordinate Search10 Sep 2026
12 newest of 877 All 877 (JSON)