A time-weighted metric for sets of trajectories to assess multi-object tracking algorithms
Not on the map. Why?
Abstract (arXiv)
This paper proposes a metric for sets of trajectories to evaluate multi-object tracking algorithms that includes time-weighted costs for localisation errors of properly detected targets, for false targets, missed targets and track switches. The proposed metric extends the metric in [1] by including weights to the costs associated to different time steps. The time-weighted costs increase the flexibility of the metric [1] to fit more applications and user preferences. We first introduce a metric based on multi-dimensional assignments, and then its linear programming relaxation, which is computable in polynomial time and is also a metric. The metrics can also be extended to metrics on random finite sets of trajectories to evaluate and rank algorithms across different scenarios, each with a ground truth set of trajectories.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 12 of its 29 references that are in the map. First posted on arXiv 26 Oct 2021.
Builds on
12 of 29 references.
References · 12
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 692
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 532
- 2019Multiple Futures Predictioncited by 178
- 2016Generalized optimal sub-pattern assignment metriccited by 33
- 2016A metric on the space of finite sets of trajectories for evaluation of multi-target tracking algorithmscited by 17
- 2016Multiple target tracking based on sets of trajectoriescited by 11
- 2018Poisson multi-Bernoulli mixture trackers: continuity through random finite sets of trajectoriescited by 10
- 2016A metric for sets of trajectories that is practical and mathematically consistentcited by 7
- 2019Poisson Multi-Bernoulli Mixtures for Sets of Trajectoriescited by 4
- 2019Spooky effect in optimal OSPA estimation and how GOSPA solves itcited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 1; 2025: 4.
6 papers.
- 2024TGOSPA Metric Parameters Selection and Evaluation for Visual Multi-object Trackingcited by 2
- 2025From Target Tracking to Targeting Track -- Part I: A Metric for Spatio-Temporal Trajectory Evaluationcited by 2
- 2022Detection-aware multi-object tracking evaluationcited by 1
- 2025Fast computation of the TGOSPA metric for multiple target tracking via unbalanced optimal transportcited by 1
- 2025GOSPA and T-GOSPA quasi-metrics for evaluation of multi-object tracking algorithmscited by 0
- 2025Model-based Multi-object Visual Tracking: Identification and Standard Model Limitationscited by 0
- 2025Model-based Multi-object Visual Tracking: Identification and Standard Model Limitations19 Aug 2025
- 2025GOSPA and T-GOSPA quasi-metrics for evaluation of multi-object tracking algorithms18 Jul 2025
- 2025Fast computation of the TGOSPA metric for multiple target tracking via unbalanced optimal transport12 Mar 2025
- 2025From Target Tracking to Targeting Track -- Part I: A Metric for Spatio-Temporal Trajectory Evaluation20 Feb 2025
- 2024TGOSPA Metric Parameters Selection and Evaluation for Visual Multi-object Tracking11 Dec 2024
- 2022Detection-aware multi-object tracking evaluation16 Dec 2022