Simple Cues Lead to a Strong Multi-Object Tracker
Not on the map. Why?
Abstract (arXiv)
For a long time, the most common paradigm in Multi-Object Tracking was tracking-by-detection (TbD), where objects are first detected and then associated over video frames. For association, most models resourced to motion and appearance cues, e.g., re-identification networks. Recent approaches based on attention propose to learn the cues in a data-driven manner, showing impressive results. In this paper, we ask ourselves whether simple good old TbD methods are also capable of achieving the performance of end-to-end models. To this end, we propose two key ingredients that allow a standard re-identification network to excel at appearance-based tracking. We extensively analyse its failure cases, and show that a combination of our appearance features with a simple motion model leads to strong tracking results. Our tracker generalizes to four public datasets, namely MOT17, MOT20, BDD100k, and DanceTrack, achieving state-of-the-art performance. https://github.com/dvl-tum/GHOST.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Builds on 72 of its 99 references that are in the map. First posted on arXiv 9 Jun 2022.
Builds on
72 of 99 references.
References · 72
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
- 2016YOLO9000: Better, Faster, Strongercited by 1,429
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2016Simple Online and Realtime Trackingcited by 862
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 784
38 more
- 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 763
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 685
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 531
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 489
- 2020Tracking Objects as Pointscited by 483
- 2017Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)cited by 472
- 2019Bag of Tricks and A Strong Baseline for Deep Person Re-identificationcited by 429
- 2020Improving robustness against common corruptions by covariate shift adaptationcited by 427
- 2019Tracking without bells and whistlescited by 382
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2020TransTrack: Multiple Object Tracking with Transformercited by 370
- 2018Two at Once: Enhancing Learning and Generalization Capacities via IBN-Netcited by 361
- 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 355
- 2019Towards Real-Time Multi-Object Trackingcited by 311
- 2016Revisiting Batch Normalization For Practical Domain Adaptationcited by 285
- 2018CrowdHuman: A Benchmark for Detecting Human in a Crowdcited by 283
- 2020Evaluating Prediction-Time Batch Normalization for Robustness under Covariate Shiftcited by 235
- 2020Quasi-Dense Similarity Learning for Multiple Object Trackingcited by 220
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2019Learning a Neural Solver for Multiple Object Trackingcited by 198
- 2019Domain-Specific Batch Normalization for Unsupervised Domain Adaptationcited by 197
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2020MOTChallenge: A Benchmark for Single-Camera Multiple Target Trackingcited by 134
- 2019ABD-Net: Attentive but Diverse Person Re-Identificationcited by 126
- 2021Learning to Track with Object Permanencecited by 117
- 2020Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Trackingcited by 115
- 2022MeMOT: Multi-Object Tracking with Memorycited by 113
- 2020Learning to Generalize Unseen Domains via Memory-based Multi-Source Meta-Learning for Person Re-Identificationcited by 110
- 2022Global Tracking Transformerscited by 110
- 2018Real-time Multiple People Tracking with Deeply Learned Candidate Selection and Person Re-Identificationcited by 96
- 2018Deep Affinity Network for Multiple Object Trackingcited by 82
- 2016Learning by tracking: Siamese CNN for robust target associationcited by 79
- 2020Meta Batch-Instance Normalization for Generalizable Person Re-Identificationcited by 77
- 2017Tracking The Untrackable: Learning To Track Multiple Cues with Long-Term Dependenciescited by 76
- 2016POI: Multiple Object Tracking with High Performance Detection and Appearance Featurecited by 74
- 2019Spatial-Temporal Relation Networks for Multi-Object Trackingcited by 74
50 most cited of 72 All 72 (JSON)
Built on by
Citing papers per year: 2023: 5; 2024: 16; 2025: 17; 2026: 6.
44 papers.
Sort:
By area:
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2023UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensationcited by 42
- 2023EarlyBird: Early-Fusion for Multi-View Tracking in the Bird's Eye Viewcited by 33
- 2024Lifting Multi-View Detection and Tracking to the Bird's Eye Viewcited by 25
- 2024Towards Generalizable Multi-Object Trackingcited by 22
- 2024Keypoint Promptable Re-Identificationcited by 15
- 2023DeNoising-MOT: Towards Multiple Object Tracking with Severe Occlusionscited by 12
- 2024DeconfuseTrack:Dealing with Confusion for Multi-Object Trackingcited by 9
- 2024MambaMOT: State-Space Model as Motion Predictor for Multi-Object Trackingcited by 8
- 2024SPAMming Labels: Efficient Annotations for the Trackers of Tomorrowcited by 7
- 2025Zero-Shot 4D Lidar Panoptic Segmentationcited by 6
32 more
- 2023Single-Shot and Multi-Shot Feature Learning for Multi-Object Trackingcited by 5
- 2024Associate Everything Detected: Facilitating Tracking-by-Detection to the Unknowncited by 5
- 2024Is Multiple Object Tracking a Matter of Specialization?cited by 5
- 2025CAMELTrack: Context-Aware Multi-cue ExpLoitation for Online Multi-Object Trackingcited by 4
- 2024DenseTrack: Drone-based Crowd Tracking via Density-aware Motion-appearance Synergycited by 3
- 2025NOOUGAT: Towards Unified Online and Offline Multi-Object Trackingcited by 3
- 2024Multi-Granularity Language-Guided Training for Multi-Object Trackingcited by 2
- 2024DroneMOT: Drone-based Multi-Object Tracking Considering Detection Difficulties and Simultaneous Moving of Drones and Objectscited by 2
- 2025When Trackers Date Fish: A Benchmark and Framework for Underwater Multiple Fish Trackingcited by 2
- 2025SIS-Challenge: Event-based Spatio-temporal Instance Segmentation Challenge at the CVPR 2025 Event-based Vision Workshopcited by 2
- 2024AM-SORT: Adaptable Motion Predictor with Historical Trajectory Embedding for Multi-Object Trackingcited by 1
- 2024Spatial-Temporal Multi-Cuts for Online Multiple-Camera Vehicle Trackingcited by 1
- 2025FusionSORT: Fusion Methods for Online Multi-object Visual Trackingcited by 1
- 2025Tiny Neural Networks for Multi-Object Tracking in a Modular Kalman Frameworkcited by 1
- 2025Depth-Aware Scoring and Hierarchical Alignment for Multiple Object Trackingcited by 1
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Trackingcited by 1
- 2024Hierarchical IoU Tracking based on Intervalcited by 0
- 2024When to Extract ReID Features: A Selective Approach for Improved Multiple Object Trackingcited by 0
- 2025FaceQSORT: a Multi-Face Tracking Method based on Biometric and Appearance Featurescited by 0
- 2025Deep LG-Track: An Enhanced Localization-Confidence-Guided Multi-Object Trackercited by 0
- 2025SAM2Auto: Auto Annotation Using FLASHcited by 0
- 2025Towards Continuous Home Cage Monitoring: An Evaluation of Tracking and Identification Strategies for Laboratory Micecited by 0
- 2025GRASPTrack: Geometry-Reasoned Association via Segmentation and Projection for Multi-Object Trackingcited by 0
- 2025SocialTrack: Multi-Object Tracking in Complex Urban Traffic Scenes Inspired by Social Behaviorcited by 0
- 2025SelfMOTR: Revisiting MOTR with Self-Generating Detection Priorscited by 0
- 2025DM3T: Harmonizing Modalities via Diffusion for Multi-Object Trackingcited by 0
- 2025Learning Association via Track-Detection Matching for Multi-Object Trackingcited by 0
- 2026SAMOFT: Robust Multi-Object Tracking via Region and Flowcited by 0
- 2026When Fish Look Alike: Tracking Identities with Dual-branch Elasticitycited by 0
- 2026Tracking the Unseen: An Occlusion-Robust Framework for Target Tracking Under Full and Long-Term Occlusioncited by 0
- 2026Rule-Constrained Assignment for Cue-Ball Identification in Broadcast Snookercited by 0
- 2026Towards Automatic Video Annotation with ASH: Zero-Shot Open-Vocabulary Multi-Object Tracking and Segmentationcited by 0
- 2026Towards Automatic Video Annotation with ASH: Zero-Shot Open-Vocabulary Multi-Object Tracking and Segmentation1 Oct 2026
- 2026Rule-Constrained Assignment for Cue-Ball Identification in Broadcast Snooker20 Sep 2026
- 2026Tracking the Unseen: An Occlusion-Robust Framework for Target Tracking Under Full and Long-Term Occlusion15 Sep 2026
- 2026When Fish Look Alike: Tracking Identities with Dual-branch Elasticity29 Jul 2026
- 2026SAMOFT: Robust Multi-Object Tracking via Region and Flow10 May 2026
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Tracking6 Mar 2026
- 2025Learning Association via Track-Detection Matching for Multi-Object Tracking26 Dec 2025
- 2025DM3T: Harmonizing Modalities via Diffusion for Multi-Object Tracking28 Nov 2025
- 2025SelfMOTR: Revisiting MOTR with Self-Generating Detection Priors25 Nov 2025
- 2025NOOUGAT: Towards Unified Online and Offline Multi-Object Tracking2 Sep 2025
- 2025SIS-Challenge: Event-based Spatio-temporal Instance Segmentation Challenge at the CVPR 2025 Event-based Vision Workshop18 Aug 2025
- 2025SocialTrack: Multi-Object Tracking in Complex Urban Traffic Scenes Inspired by Social Behavior18 Aug 2025
32 more
- 2025GRASPTrack: Geometry-Reasoned Association via Segmentation and Projection for Multi-Object Tracking11 Aug 2025
- 2025Towards Continuous Home Cage Monitoring: An Evaluation of Tracking and Identification Strategies for Laboratory Mice10 Jul 2025
- 2025When Trackers Date Fish: A Benchmark and Framework for Underwater Multiple Fish Tracking8 Jul 2025
- 2025SAM2Auto: Auto Annotation Using FLASH9 Jun 2025
- 2025Depth-Aware Scoring and Hierarchical Alignment for Multiple Object Tracking1 Jun 2025
- 2025CAMELTrack: Context-Aware Multi-cue ExpLoitation for Online Multi-Object Tracking2 May 2025
- 2025Tiny Neural Networks for Multi-Object Tracking in a Modular Kalman Framework3 Apr 2025
- 2025Deep LG-Track: An Enhanced Localization-Confidence-Guided Multi-Object Tracker2 Apr 2025
- 2025Zero-Shot 4D Lidar Panoptic Segmentation1 Apr 2025
- 2025FaceQSORT: a Multi-Face Tracking Method based on Biometric and Appearance Features20 Jan 2025
- 2025FusionSORT: Fusion Methods for Online Multi-object Visual Tracking1 Jan 2025
- 2024Is Multiple Object Tracking a Matter of Specialization?1 Nov 2024
- 2024Spatial-Temporal Multi-Cuts for Online Multiple-Camera Vehicle Tracking3 Oct 2024
- 2024Associate Everything Detected: Facilitating Tracking-by-Detection to the Unknown14 Sep 2024
- 2024When to Extract ReID Features: A Selective Approach for Improved Multiple Object Tracking10 Sep 2024
- 2024Keypoint Promptable Re-Identification25 Jul 2024
- 2024DenseTrack: Drone-based Crowd Tracking via Density-aware Motion-appearance Synergy24 Jul 2024
- 2024DroneMOT: Drone-based Multi-Object Tracking Considering Detection Difficulties and Simultaneous Moving of Drones and Objects12 Jul 2024
- 2024Hierarchical IoU Tracking based on Interval19 Jun 2024
- 2024Multi-Granularity Language-Guided Training for Multi-Object Tracking7 Jun 2024
- 2024Towards Generalizable Multi-Object Tracking1 Jun 2024
- 2024SPAMming Labels: Efficient Annotations for the Trackers of Tomorrow17 Apr 2024
- 2024Multiple Object Tracking as ID Prediction25 Mar 2024
- 2024Lifting Multi-View Detection and Tracking to the Bird's Eye View19 Mar 2024
- 2024MambaMOT: State-Space Model as Motion Predictor for Multi-Object Tracking16 Mar 2024
- 2024DeconfuseTrack:Dealing with Confusion for Multi-Object Tracking5 Mar 2024
- 2024AM-SORT: Adaptable Motion Predictor with Historical Trajectory Embedding for Multi-Object Tracking25 Jan 2024
- 2023UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensation14 Dec 2023
- 2023Single-Shot and Multi-Shot Feature Learning for Multi-Object Tracking17 Nov 2023
- 2023EarlyBird: Early-Fusion for Multi-View Tracking in the Bird's Eye View20 Oct 2023
- 2023DeNoising-MOT: Towards Multiple Object Tracking with Severe Occlusions9 Sep 2023
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Tracking1 Aug 2023
- 2025SAM2Auto: Auto Annotation Using FLASHcited by 0
- 2025SAM2Auto: Auto Annotation Using FLASH9 Jun 2025
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2023UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensationcited by 42
- 2023EarlyBird: Early-Fusion for Multi-View Tracking in the Bird's Eye Viewcited by 33
- 2024Lifting Multi-View Detection and Tracking to the Bird's Eye Viewcited by 25
- 2024Towards Generalizable Multi-Object Trackingcited by 22
- 2024Keypoint Promptable Re-Identificationcited by 15
- 2023DeNoising-MOT: Towards Multiple Object Tracking with Severe Occlusionscited by 12
- 2024DeconfuseTrack:Dealing with Confusion for Multi-Object Trackingcited by 9
- 2024MambaMOT: State-Space Model as Motion Predictor for Multi-Object Trackingcited by 8
- 2024SPAMming Labels: Efficient Annotations for the Trackers of Tomorrowcited by 7
- 2025Zero-Shot 4D Lidar Panoptic Segmentationcited by 6
12 most cited of 43 All 43 (JSON)
- 2026Towards Automatic Video Annotation with ASH: Zero-Shot Open-Vocabulary Multi-Object Tracking and Segmentation1 Oct 2026
- 2026Rule-Constrained Assignment for Cue-Ball Identification in Broadcast Snooker20 Sep 2026
- 2026Tracking the Unseen: An Occlusion-Robust Framework for Target Tracking Under Full and Long-Term Occlusion15 Sep 2026
- 2026When Fish Look Alike: Tracking Identities with Dual-branch Elasticity29 Jul 2026
- 2026SAMOFT: Robust Multi-Object Tracking via Region and Flow10 May 2026
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Tracking6 Mar 2026
- 2025Learning Association via Track-Detection Matching for Multi-Object Tracking26 Dec 2025
- 2025DM3T: Harmonizing Modalities via Diffusion for Multi-Object Tracking28 Nov 2025
- 2025SelfMOTR: Revisiting MOTR with Self-Generating Detection Priors25 Nov 2025
- 2025NOOUGAT: Towards Unified Online and Offline Multi-Object Tracking2 Sep 2025
- 2025SIS-Challenge: Event-based Spatio-temporal Instance Segmentation Challenge at the CVPR 2025 Event-based Vision Workshop18 Aug 2025
- 2025SocialTrack: Multi-Object Tracking in Complex Urban Traffic Scenes Inspired by Social Behavior18 Aug 2025
12 newest of 43 All 43 (JSON)