PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking
Not on the map. Why?
Abstract (arXiv)
We introduce Point-supervised Multi-Object Tracking (PS-MOT) as a cost-effective alternative to traditional bounding box supervision, shifting the focus from spatial fitting to topological center-driven representation. However, PS-MOT faces challenges, e.g., spatial ambiguity and identity drift due to the lack of explicit geometric structure and scale constraints. To address these, we propose PS-Track, a hierarchical pipeline transitioning from points to instances across data, model, and loss levels. At the data level, we introduce Temporal-Feedback Prompting (TFP) to evolve points into temporally consistent pseudo-labels using negative spatial cues and motion priors. At the model level, we design the Point-Excited Wavelet Attention (PEWA) module, which leverages semantic correlations to activate high-frequency components, ``hallucinating'' object boundaries. At the loss level, Uncertainty-Guided Gaussian Learning (UGL) models pseudo-labels as probabilistic distributions, dynamically calibrating supervision intensity. Experiments on DanceTrack, EmboTrack, SportsMOT, and JRDB demonstrate that PS-Track provides a feasible and effective point-supervised alternative across diverse tracking scenarios, establishing a new state-of-the-art for point-supervised tracking. The source code is available at https://github.com/xifen523/PS-MOT.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 58 of its 72 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
58 of 72 references.
References · 58
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017Mask R-CNNcited by 7,259
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2016Simple Online and Realtime Trackingcited by 862
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 685
38 more
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 489
- 2020Tracking Objects as Pointscited by 483
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2020TransTrack: Multiple Object Tracking with Transformercited by 370
- 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 355
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2015What's the Point: Semantic Segmentation with Point Supervisioncited by 297
- 2020Quasi-Dense Similarity Learning for Multiple Object Trackingcited by 220
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2015Weakly Supervised Deep Detection Networkscited by 183
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2020MOTChallenge: A Benchmark for Single-Camera Multiple Target Trackingcited by 134
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
- 2017Multiple Instance Detection Network with Online Instance Classifier Refinementcited by 117
- 2022Global Tracking Transformerscited by 110
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
- 2021Pointly-Supervised Instance Segmentationcited by 83
- 2017Extreme clicking for efficient object annotationcited by 80
- 2024D-FINE: Redefine Regression Task in DETRs as Fine-grained Distribution Refinementcited by 73
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
- 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2021Learnable Graph Matching: Incorporating Graph Partitioning with Deep Feature Learning for Multiple Object Trackingcited by 47
- 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Drivingcited by 46
- 2023UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensationcited by 42
- 2022Point-to-Box Network for Accurate Object Detection via Single Point Supervisioncited by 31
- 2023Focus On Details: Online Multi-object Tracking with Diverse Fine-grained Representationcited by 25
- 2023Point2RBox: Combine Knowledge from Synthetic Visual Patterns for End-to-end Oriented Object Detection with Single Point Supervisioncited by 21
- 2022Object Localization under Single Coarse Point Supervisioncited by 18
- 2024Self-Supervised Multi-Object Tracking with Path Consistencycited by 16
- 2025Omnidirectional Multi-Object Trackingcited by 12
- 2025Point2RBox-v2: Rethinking Point-supervised Oriented Object Detection with Spatial Layout Among Instancescited by 11
50 most cited of 58 All 58 (JSON)
Built on by
Not cited yet.