Leveraging Pre-Trained 3D Object Detection Models For Fast Ground Truth Generation
Not on the map. Why?
Abstract (arXiv)
Training 3D object detectors for autonomous driving has been limited to small datasets due to the effort required to generate annotations. Reducing both task complexity and the amount of task switching done by annotators is key to reducing the effort and time required to generate 3D bounding box annotations. This paper introduces a novel ground truth generation method that combines human supervision with pretrained neural networks to generate per-instance 3D point cloud segmentation, 3D bounding boxes, and class annotations. The annotators provide object anchor clicks which behave as a seed to generate instance segmentation results in 3D. The points belonging to each instance are then used to regress object centroids, bounding box dimensions, and object orientation. Our proposed annotation scheme requires 30x lower human annotation time. We use the KITTI 3D object detection dataset to evaluate the efficiency and the quality of our annotation scheme. We also test the the proposed scheme on previously unseen data from the Autonomoose self-driving vehicle to demonstrate generalization capabilities of the network.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 3; 2023: 1; 2024: 4; 2025: 1.
12 papers.
- 2022Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentationcited by 152
- 2021Offboard 3D Object Detection from Point Cloud Sequencescited by 145
- 2021Auto4D: Learning to Label 4D Objects from Sequential Point Cloudscited by 42
- 2023Once Detected, Never Lost: Surpassing Human Performance in Offline LiDAR based 3D Object Detectioncited by 28
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Explorationcited by 17
- 2021SALT: A Semi-automatic Labeling Tool for RGB-D Video Sequencescited by 10
- 2022MAP-Gen: An Automated 3D-Box Annotation Flow with Multimodal Attention Point Generatorcited by 9
- 2024Dual-Perspective Knowledge Enrichment for Semi-Supervised 3D Object Detectioncited by 9
- 2024Vision-Language Guidance for LiDAR-based Unsupervised 3D Object Detectioncited by 3
- 2022You Only Label Once: 3D Box Adaptation from Point Cloud to Image via Semi-Supervised Learningcited by 1
- 2024VRSO: Visual-Centric Reconstruction for Static Object Annotationcited by 0
- 2025Rethinking the Encoding and Annotating of 3D Bounding Box: Corner-Aware 3D Object Detection from Point Cloudscited by 0
- 2025Rethinking the Encoding and Annotating of 3D Bounding Box: Corner-Aware 3D Object Detection from Point Clouds18 Nov 2025
- 2024Vision-Language Guidance for LiDAR-based Unsupervised 3D Object Detection7 Aug 2024
- 2024VRSO: Visual-Centric Reconstruction for Static Object Annotation22 Mar 2024
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Exploration30 Jan 2024
- 2024Dual-Perspective Knowledge Enrichment for Semi-Supervised 3D Object Detection10 Jan 2024
- 2023Once Detected, Never Lost: Surpassing Human Performance in Offline LiDAR based 3D Object Detection24 Apr 2023
- 2022You Only Label Once: 3D Box Adaptation from Point Cloud to Image via Semi-Supervised Learning17 Nov 2022
- 2022MAP-Gen: An Automated 3D-Box Annotation Flow with Multimodal Attention Point Generator29 Mar 2022
- 2022Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentation29 Mar 2022
- 2021Offboard 3D Object Detection from Point Cloud Sequences8 Mar 2021
- 2021SALT: A Semi-automatic Labeling Tool for RGB-D Video Sequences22 Feb 2021
- 2021Auto4D: Learning to Label 4D Objects from Sequential Point Clouds17 Jan 2021