mlsanityData to 7 Oct 2026

Detect Closer Surfaces that can be Seen: New Modeling and Evaluation in Cross-domain 3D Object Detection

arXiv 2407.04061 ↗First posted 4 Jul 2024cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

The performance of domain adaptation technologies has not yet reached an ideal level in the current 3D object detection field for autonomous driving, which is mainly due to significant differences in the size of vehicles, as well as the environments they operate in when applied across domains. These factors together hinder the effective transfer and application of knowledge learned from specific datasets. Since the existing evaluation metrics are initially designed for evaluation on a single domain by calculating the 2D or 3D overlap between the prediction and ground-truth bounding boxes, they often suffer from the overfitting problem caused by the size differences among datasets. This raises a fundamental question related to the evaluation of the 3D object detection models' cross-domain performance: Do we really need models to maintain excellent performance in their original 3D bounding boxes after being applied across domains? From a practical application perspective, one of our main focuses is actually on preventing collisions between vehicles and other obstacles, especially in cross-domain scenarios where correctly predicting the size of vehicles is much more difficult. In other words, as long as a model can accurately identify the closest surfaces to the ego vehicle, it is sufficient to effectively avoid obstacles. In this paper, we propose two metrics to measure 3D object detection models' ability of detecting the closer surfaces to the sensor on the ego vehicle, which can be used to evaluate their cross-domain performance more comprehensively and reasonably. Furthermore, we propose a refinement head, named EdgeHead, to guide models to focus more on the learnable closer surfaces, which can greatly improve the cross-domain performance of existing models not only under our new metrics, but even also under the original BEV/3D metrics.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 29 of its 33 references that are in the map. First posted on arXiv 4 Jul 2024.

Builds on

29 of 33 references.

References · 29

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2020End-to-End Object Detection with Transformerscited by 7,384
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  4. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  5. 2015Fast R-CNNcited by 2,930
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  7. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  8. 2020Center-based 3D Object Detection and Trackingcited by 1,143
  9. 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
  10. 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
  11. 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
  12. 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
17 more
  1. 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
  2. 2020Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detectioncited by 409
  3. 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
  4. 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 221
  5. 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 158
  6. 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 150
  7. 2019Progressive Domain Adaptation for Object Detectioncited by 134
  8. 2019A Robust Learning Approach to Domain Adaptive Object Detectioncited by 109
  9. 2017ROAD: Reality Oriented Adaptation for Semantic Segmentation of Urban Scenescited by 95
  10. 2021ST3D++: Denoised Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 57
  11. 2022LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detectioncited by 54
  12. 2023PillarNeXt: Rethinking Network Designs for 3D Object Detection in LiDAR Point Cloudscited by 54
  13. 2019Few-shot Adaptive Faster R-CNNcited by 42
  14. 2023Uni3D: A Unified Baseline for Multi-dataset 3D Object Detectioncited by 39
  15. 2023Density-Insensitive Unsupervised Domain Adaption on 3D Object Detectioncited by 31
  16. 2023Revisiting Domain-Adaptive 3D Object Detection by Reliable, Diverse and Class-balanced Pseudo-Labelingcited by 28
  17. 2023Bi3D: Bi-domain Active Learning for Cross-domain 3D Object Detectioncited by 21

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.