Contour Errors: Ego-Centric Matching for 3D Multi-Object Tracking Performance Evaluation
Not on the map. Why?
Abstract (arXiv)
Open-loop performance evaluation of 3D multi-object tracking in autonomous driving requires matching criteria that effectively penalize translational, shape, and orientation errors from the ego vehicle perspective. The prevailing criteria for determining true positives are Intersection over Union (IoU) and Centre-Point Distances (CPD). When IoU is extended from the 2D image plane to 3D volumetric overlap, it often falls below its acceptance threshold even with minor yaw misalignments, whereas CPD disregards orientation entirely. To address this limitation, we propose Contour Errors (CE) as an ego-centric criterion that employs Hausdorff-type reasoning to sparse bounding-box corner geometry by selecting the k-nearest ego-centric corners. This method provides a graded orientation sensitivity between the extremes of IoU, which overpenalizes, and CPD, which is orientation-blind. We evaluate Contour Errors against six baselines using the HOTA evaluation protocol on the nuScenes dataset, conditioned on proximity, yaw error, and a confidence threshold. At the standard IoU vehicle threshold, 47% of car and 75% of pedestrian CE-valid matches are rejected by IoU despite close contour proximity, while fewer than 0.1% of IoU-valid matches fail CE. These results establish the ego-centric matching criterion as a primary factor for improving open-loop perception evaluation in safety-critical autonomous driving.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 4 Jun 2025.
Builds on
19 of 30 references.
References · 19
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
- 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 459
- 2020AB3DMOT: A Baseline for 3D Multi-Object Tracking and New Evaluation Metricscited by 63
- 2020Learning to Evaluate Perception Models Using Planner-Centric Metricscited by 49
- 20223D Multi-Object Tracking Using Graph Neural Networks with Cross-Edge Modality Attentioncited by 27
- 2021Injecting Planning-Awareness into Prediction and Detection Evaluationcited by 21
7 more
- 2017Tracking the Trackers: An Analysis of the State of the Art in Multiple Object Trackingcited by 18
- 2023A Novel Benchmarking Paradigm and a Scale- and Motion-Aware Model for Egocentric Pedestrian Trajectory Predictioncited by 12
- 2023Self-Supervised Multi-Object Tracking For Autonomous Driving From Consistency Across Timescalescited by 7
- 2023Shape-IoU: More Accurate Metric considering Bounding Box Shape and Scalecited by 3
- 2024EC-IoU: Orienting Safety for Object Detectors via Ego-Centric Intersection-over-Unioncited by 2
- 2022Evaluation Metrics for Object Detection for Autonomous Systemscited by 1
- 2024Object criticality for safer navigationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.