mlsanityData to 14 Oct 2026

What Matters in Range View 3D Object Detection

arXiv 2407.16789 ↗First posted 23 Jul 2024cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Lidar-based perception pipelines rely on 3D object detection models to interpret complex scenes. While multiple representations for lidar exist, the range-view is enticing since it losslessly encodes the entire lidar sensor output. In this work, we achieve state-of-the-art amongst range-view 3D object detection models without using multiple techniques proposed in past range-view literature. We explore range-view 3D object detection across two modern datasets with substantially different properties: Argoverse 2 and Waymo Open. Our investigation reveals key insights: (1) input feature dimensionality significantly influences the overall performance, (2) surprisingly, employing a classification loss grounded in 3D spatial proximity works as well or better compared to more elaborate IoU-based losses, and (3) addressing non-uniform lidar density via a straightforward range subsampling technique outperforms existing multi-resolution, range-conditioned networks. Our experiments reveal that techniques proposed in recent range-view literature are not needed to achieve state-of-the-art performance. Combining the above findings, we establish a new state-of-the-art model for range-view 3D object detection -- improving AP by 2.2% on the Waymo Open dataset while maintaining a runtime of 10 Hz. We establish the first range-view model on the Argoverse 2 dataset and outperform strong voxel-based baselines. All models are multi-class and open-source. Code is available at https://github.com/benjaminrwilson/range-view-3d-detection.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 33 references that are in the map. First posted on arXiv 23 Jul 2024.

Builds on

30 of 33 references.

References · 30

  1. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  2. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  3. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  4. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  5. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
  6. 2017Deep Setscited by 1,421
  7. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  8. 2020Center-based 3D Object Detection and Trackingcited by 1,144
  9. 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
  10. 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 724
  11. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
  12. 2017Deep Layer Aggregationcited by 436
18 more
  1. 2018An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solutioncited by 307
  2. 2019A Study of BFLOAT16 for Deep Learning Trainingcited by 232
  3. 2020VarifocalNet: An IoU-aware Dense Object Detectorcited by 231
  4. 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 222
  5. 2019End-to-End Multi-View Fusion for 3D Object Detection in LiDAR Point Cloudscited by 171
  6. 2021IntentNet: Learning to Predict Intention from Raw Sensor Datacited by 158
  7. 2021RangeDet:In Defense of Range View for LiDAR-based 3D Object Detectioncited by 140
  8. 2019LaserNet: An Efficient Probabilistic 3D Object Detector for Autonomous Drivingcited by 133
  9. 2021RSN: Range Sparse Net for Efficient, Accurate LiDAR 3D Object Detectioncited by 115
  10. 2016Vehicle Detection from 3D Lidar Using Fully Convolutional Networkcited by 107
  11. 2022SWFormer: Sparse Window Transformer for 3D Object Detection in Point Cloudscited by 92
  12. 2022Fully Convolutional One-Stage 3D Object Detection on LiDAR Range Imagescited by 56
  13. 2020Multi-View Fusion of Sensor Data for Improved Perception and Prediction in Autonomous Drivingcited by 41
  14. 2021To the Point: Efficient 3D Object Detection in the Range Image with Graph Convolution Kernelscited by 39
  15. 2020LaserFlow: Efficient and Probabilistic Object Detection and Motion Forecastingcited by 22
  16. 2021MVFuseNet: Improving End-to-End Object Detection and Motion Forecasting through Multi-View Fusion of LiDAR Datacited by 18
  17. 2023Vision-RADAR fusion for Robotics BEV Detections: A Surveycited by 14
  18. 2020RV-FuseNet: Range View Based Fusion of Time-Series LiDAR Data for Joint 3D Object Detection and Motion Forecastingcited by 8

Built on by

Not cited yet.