Multi-Object Tracking by Hierarchical Visual Representations
Not on the map. Why?
Abstract (arXiv)
We propose a new visual hierarchical representation paradigm for multi-object tracking. It is more effective to discriminate between objects by attending to objects' compositional visual regions and contrasting with the background contextual information instead of sticking to only the semantic visual cue such as bounding boxes. This compositional-semantic-contextual hierarchy is flexible to be integrated in different appearance-based multi-object tracking methods. We also propose an attention-based visual feature module to fuse the hierarchical visual representations. The proposed method achieves state-of-the-art accuracy and time efficiency among query-based methods on multiple multi-object tracking benchmarks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 56 references that are in the map. First posted on arXiv 24 Feb 2024.
Builds on
45 of 56 references.
References · 45
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
- 2019Objects as Pointscited by 1,172
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,018
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 531
33 more
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 489
- 2020Tracking Objects as Pointscited by 483
- 2020End-to-End Video Instance Segmentation with Transformerscited by 443
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2020TransTrack: Multiple Object Tracking with Transformercited by 370
- 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 355
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2018CrowdHuman: A Benchmark for Detecting Human in a Crowdcited by 283
- 2020Quasi-Dense Similarity Learning for Multiple Object Trackingcited by 220
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2017PoseTrack: A Benchmark for Human Pose Estimation and Trackingcited by 173
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2020TAO: A Large-Scale Benchmark for Tracking Any Objectcited by 146
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 130
- 2021Learning to Track with Object Permanencecited by 117
- 2022MeMOT: Multi-Object Tracking with Memorycited by 113
- 2020Rethinking the competition between detection and ReID in Multi-Object Trackingcited by 101
- 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2018Pose Flow: Efficient Online Pose Trackingcited by 80
- 2018Horizontal Pyramid Matching for Person Re-identificationcited by 70
- 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
- 2022Body Part-Based Representation Learning for Occluded Person Re-Identificationcited by 63
- 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
- 2021RelationTrack: Relation-aware Multiple Object Tracking with Decoupled Representationcited by 52
- 2015Object detection via a multi-region & semantic segmentation-aware CNN modelcited by 47
- 2021Tracking Pedestrian Heads in Dense Crowdcited by 42
- 2021Semi-TCL: Semi-Supervised Track Contrastive Representation Learningcited by 23
- 2022Track Targets by Dense Spatio-Temporal Position Encodingcited by 8
- 2017Robust Visual Tracking via Hierarchical Convolutional Featurescited by 4
Built on by
Not cited yet.