Simple Online and Realtime Tracking
Not on the map. Why?
Abstract (arXiv)
This paper explores a pragmatic approach to multiple object tracking where the main focus is to associate objects efficiently for online and realtime applications. To this end, detection quality is identified as a key factor influencing tracking performance, where changing the detector can improve tracking by up to 18.9%. Despite only using a rudimentary combination of familiar techniques such as the Kalman Filter and Hungarian algorithm for the tracking components, this approach achieves an accuracy comparable to state-of-the-art online trackers. Furthermore, due to the simplicity of our tracking method, the tracker updates at a rate of 260 Hz which is over 20x faster than other state-of-the-art trackers.
Key facts. Cited by 862 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Feb 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 111; 2022: 150; 2023: 168; 2024: 177; 2025: 143; 2026: 112.
862 papers.
Sort:
By area:
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
- 2022V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Drivingcited by 157
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 130
38 more
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
- 2022Simple-BEV: What Really Matters for Multi-Sensor BEV Perception?cited by 128
- 2021Learning to Track with Object Permanencecited by 117
- 2022Global Tracking Transformerscited by 110
- 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videoscited by 110
- 2023CelebV-Text: A Large-Scale Facial Text-Video Datasetcited by 103
- 2021SimpleTrack: Understanding and Rethinking 3D Multi-object Trackingcited by 102
- 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2023Referring Multi-Object Trackingcited by 91
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challengescited by 87
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
- 2023LLM-grounded Video Diffusion Modelscited by 83
- 2022SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videoscited by 80
- 2022Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentationcited by 79
- 2021Object-Region Video Transformerscited by 73
- 2021STEP: Segmenting and Tracking Every Pixelcited by 72
- 2023General Object Foundation Model for Images and Videos at Scalecited by 71
- 2021Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoningcited by 68
- 2021MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?cited by 68
- 2021Multiple Object Tracking with Correlation Learningcited by 67
- 2022Hard to Track Objects with Irregular Motions and Similar Appearances? Make It Easier by Buffering the Matching Spacecited by 66
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
- 2024TUMTraf V2X Cooperative Perception Datasetcited by 66
- 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2021SiamMOT: Siamese Multi-Object Trackingcited by 62
- 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
- 2022QDTrack: Quasi-Dense Similarity Learning for Appearance-Only Multiple Object Trackingcited by 61
- 2023A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Futurecited by 59
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
- 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 58
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2021DEFT: Detection Embeddings for Trackingcited by 56
- 2021Exploring Simple 3D Multi-Object Tracking for Autonomous Drivingcited by 56
- 2023Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Trackingcited by 54
- 2023OVTrack: Open-Vocabulary Multiple Object Trackingcited by 53
- 2021RelationTrack: Relation-aware Multiple Object Tracking with Decoupled Representationcited by 52
50 most cited of 862 All 862 (JSON)
- 2026End-to-End Learning vs. Modular Architectures: Comparative Insights into Autonomous Driving Systems1 Oct 2026
- 2026TrackFish3D: Self-Supervised 3D Tracking of Schooling Fish from Multi-view Videos29 Sep 2026
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026ReWorld-Track: A Recursive Event World Model for Language-Guided Multi-Camera Tracking29 Sep 2026
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026Identity-Centric Video Summarization via Hierarchical Fusion of Biometric, Appearance, and 3D Body Features22 Sep 2026
- 2026Identity-Consistent Analysis of Long-Shot Windsurfing Video: A Domain-Specific Offline Tracking System21 Sep 2026
- 2026Combining Foundation Model Confidence and Monocular Depth for Training-Free Out-of-Distribution Segmentation19 Sep 2026
- 2026DOA-SORT: Directional Occlusion-Aware Multi-Object Tracking with Distributional Observations19 Sep 2026
- 2026PAANI : On Device Visual Evidence Fusion and Explainable Guidance for River Robot Simulation17 Sep 2026
- 2026Tracking the Unseen: An Occlusion-Robust Framework for Target Tracking Under Full and Long-Term Occlusion15 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
38 more
- 2026CatchMonitor: a machine learning system for automated fish discard quantification14 Sep 2026
- 2026IMM-based Multiple Object Tracking using a State Prediction Neural Network10 Sep 2026
- 2026Revisiting Multi-Object Tracking Baselines: Hyperparameter Optimization with Multi-Fidelity Greedy Coordinate Search10 Sep 2026
- 2026Tracking-by-detection in Multi-object Tracking: Survey and Experiments8 Sep 2026
- 2026Re-engineering SORT-based algorithms for low-cost small object tracking from omnidirectional footage7 Sep 2026
- 2026Cross-Domain Tracker Adaptation Without Target-Domain Labels via Vision-Language Agents4 Sep 2026
- 2026YesTrack: Referring Multi-Object Tracking via MLLM-based Yes/No Verification2 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge29 Aug 2026
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception28 Aug 2026
- 2026AdaptAV: Continuous Adaption of Vision Models for Autonomous Vehicles Using Cloud-based Oracle24 Aug 2026
- 2026Multi-Modal Traffic Sign Detection with Semantic Attributes for Autonomous Driving21 Aug 2026
- 2026Teach a Molmo2Fish: Towards interactive fish tracking with natural language guidance19 Aug 2026
- 2026Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking18 Aug 2026
- 2026Training-Free Long-Term Multi-Object Tracking for Sports Video Analytics16 Aug 2026
- 2026Navigating the Proximity-Safety Balance: Constraint Decomposition for Human Following in Pedestrian Crowds10 Aug 2026
- 2026GenTrack3: Hybrid Stochastic-Deterministic Online Multi-Object Tracking with Cluster-Aware Association10 Aug 2026
- 2026Data collection from highways: a geometric, class-agnostic approach to embedded vehicle counting7 Aug 2026
- 2026SetEasy: A Multi-Modal Classroom Engagement Assessment and Seating Optimization Framework7 Aug 2026
- 2026When One Modality Is Not Enough: Multimodal Sex and Life-Stage Classification of Red Deer from Aerial RGB-Thermal Video7 Aug 2026
- 2026Equipment-centric workpiece localization in near real-time using deep learning-based vision and event-driven finite state machines6 Aug 2026
- 2026Promptable Animal Pose Tracking Across Species5 Aug 2026
- 2026When Fish Look Alike: Tracking Identities with Dual-branch Elasticity29 Jul 2026
- 2026CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking28 Jul 2026
- 2026Denial of Deadline: Network-Driven Accuracy Collapse in Distributed Inference Pipelines27 Jul 2026
- 2026Beyond Appearance: A Multi-cue Framework and Large-scale Benchmark for Pedestrian Association and Tracking on Mobile Aerial-Ground Platforms26 Jul 2026
- 2026Incremental Optimal Assignment for Real-Time Crowd Tracking23 Jul 2026
- 2026Calibration-Free 3D Multi-Camera People Tracking for Indoor Environment22 Jul 2026
- 2026WASABI: Whole-graph Assignment-based Stabilizer for lAne topology By Inter-frame tracking22 Jul 2026
- 2026Automating Visual Recognition of Leprosy in Wild Chimpanzees19 Jul 2026
- 2026VLA-ReID: Video-Level Association for Re-Identification in Multi-Object Tracking with Highly Similar Objects19 Jul 2026
- 2026The generator is the tracker: Multi-object tracking by painting persistent identity colours19 Jul 2026
- 2026Articulated Humanoid Head for a Robot Receptionist Capable of Natural Human Interaction19 Jul 2026
- 2026AE-UAV: An Air-to-Air Event-Based UAV Tracking Benchmark and a Real-Time Frequency-Domain Tracker16 Jul 2026
- 2026Edge-Aware Thermal Infrared UAV Swarm Tracking14 Jul 2026
- 2026Higher-Order Cell Tracking Transformer13 Jul 2026
- 2026Event-RGB Adaptive Tracking for Nighttime Highway Perception13 Jul 2026
- 2026Banshee: Target Switch Attacks on Gimbal-Stabilized Visual Tracking Systems via Acoustic Injection10 Jul 2026
50 newest of 862 All 862 (JSON)
- 2024Elysium: Exploring Object-level Perception in Videos via MLLMcited by 48
- 2025Investigating Vision-Language Model for Point Cloud-based Vehicle Classificationcited by 2
- 2025Investigating Traffic Accident Detection Using Multimodal Large Language Modelscited by 1
- 2025EffOWT: Transfer Visual Language Models to Open-World Tracking Efficiently and Effectivelycited by 0
- 2025SAM2Auto: Auto Annotation Using FLASHcited by 0
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancementcited by 0
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understandingcited by 0
- 2026Bridging the Modality Gap in Roadside LiDAR: A Training-Free Vision-Language Model Framework for Vehicle Classificationcited by 0
- 2026Training-Free Semantic Multi-Object Tracking with Vision-Language Modelscited by 0
- 2026Decoding Pedestrian Crossing Intention from Egocentric Vision via Vision Language Modelscited by 0
- 2026Cross-Domain Tracker Adaptation Without Target-Domain Labels via Vision-Language Agentscited by 0
- 2026Cross-Domain Tracker Adaptation Without Target-Domain Labels via Vision-Language Agents4 Sep 2026
- 2026Decoding Pedestrian Crossing Intention from Egocentric Vision via Vision Language Models8 Jun 2026
- 2026Training-Free Semantic Multi-Object Tracking with Vision-Language Models15 Apr 2026
- 2026Bridging the Modality Gap in Roadside LiDAR: A Training-Free Vision-Language Model Framework for Vehicle Classification10 Feb 2026
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understanding21 Nov 2025
- 2025Investigating Traffic Accident Detection Using Multimodal Large Language Models23 Sep 2025
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancement17 Sep 2025
- 2025SAM2Auto: Auto Annotation Using FLASH9 Jun 2025
- 2025Investigating Vision-Language Model for Point Cloud-based Vehicle Classification10 Apr 2025
- 2025EffOWT: Transfer Visual Language Models to Open-World Tracking Efficiently and Effectively7 Apr 2025
- 2024Elysium: Exploring Object-level Perception in Videos via MLLM25 Mar 2024
- 2021Pylot: A Modular Platform for Exploring Latency-Accuracy Tradeoffs in Autonomous Vehiclescited by 33
- 2022Time3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Drivingcited by 30
- 2022Real-time Full-stack Traffic Scene Perception for Autonomous Driving with Roadside Camerascited by 13
- 2023End-to-end Autonomous Driving using Deep Learning: A Systematic Reviewcited by 7
- 2026Zero-Shot Semantic Re-Identification for Autonomous Driving: A VLM Baseline Studycited by 1
- 2026Dash2Sim: Closed-Loop Driving Simulation from in-the-wild Dashcam Videoscited by 0
- 2026End-to-End Learning vs. Modular Architectures: Comparative Insights into Autonomous Driving Systemscited by 0
- 2026End-to-End Learning vs. Modular Architectures: Comparative Insights into Autonomous Driving Systems1 Oct 2026
- 2026Zero-Shot Semantic Re-Identification for Autonomous Driving: A VLM Baseline Study8 Jun 2026
- 2026Dash2Sim: Closed-Loop Driving Simulation from in-the-wild Dashcam Videos5 Jun 2026
- 2023End-to-end Autonomous Driving using Deep Learning: A Systematic Review27 Aug 2023
- 2022Real-time Full-stack Traffic Scene Perception for Autonomous Driving with Roadside Cameras20 Jun 2022
- 2022Time3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Driving30 May 2022
- 2021Pylot: A Modular Platform for Exploring Latency-Accuracy Tradeoffs in Autonomous Vehicles16 Apr 2021
- 2023LLM-grounded Video Diffusion Modelscited by 83
- 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
- 2024LDTrack: Dynamic People Tracking by Service Robots using Diffusion Modelscited by 3
- 2024DINTR: Tracking via Diffusion-based Interpolationcited by 1
- 2024ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Modelcited by 0
- 2024DINTR: Tracking via Diffusion-based Interpolation14 Oct 2024
- 2024ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Model28 Aug 2024
- 2024LDTrack: Dynamic People Tracking by Service Robots using Diffusion Models13 Feb 2024
- 2023LLM-grounded Video Diffusion Models29 Sep 2023
- 2023DiffusionTrack: Diffusion Model For Multi-Object Tracking19 Aug 2023
- 2018Learning from Demonstration in the Wildcited by 25
- 2018Learning from Demonstration in the Wild8 Nov 2018
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
- 2022V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Drivingcited by 157
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 130
12 most cited of 832 All 832 (JSON)
- 2026TrackFish3D: Self-Supervised 3D Tracking of Schooling Fish from Multi-view Videos29 Sep 2026
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026Identity-Centric Video Summarization via Hierarchical Fusion of Biometric, Appearance, and 3D Body Features22 Sep 2026
- 2026Identity-Consistent Analysis of Long-Shot Windsurfing Video: A Domain-Specific Offline Tracking System21 Sep 2026
- 2026Combining Foundation Model Confidence and Monocular Depth for Training-Free Out-of-Distribution Segmentation19 Sep 2026
- 2026DOA-SORT: Directional Occlusion-Aware Multi-Object Tracking with Distributional Observations19 Sep 2026
- 2026PAANI : On Device Visual Evidence Fusion and Explainable Guidance for River Robot Simulation17 Sep 2026
- 2026Tracking the Unseen: An Occlusion-Robust Framework for Target Tracking Under Full and Long-Term Occlusion15 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026CatchMonitor: a machine learning system for automated fish discard quantification14 Sep 2026
- 2026IMM-based Multiple Object Tracking using a State Prediction Neural Network10 Sep 2026
12 newest of 832 All 832 (JSON)