SpotNet: An Image Centric, Lidar Anchored Approach To Long Range Perception
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose SpotNet: a fast, single stage, image-centric but LiDAR anchored approach for long range 3D object detection. We demonstrate that our approach to LiDAR/image sensor fusion, combined with the joint learning of 2D and 3D detection tasks, can lead to accurate 3D object detection with very sparse LiDAR support. Unlike more recent bird's-eye-view (BEV) sensor-fusion methods which scale with range r as O(r2), SpotNet scales as O(1) with range. We argue that such an architecture is ideally suited to leverage each sensor's strength, i.e. semantic understanding from images and accurate range finding from LiDAR data. Finally we show that anchoring detections on LiDAR points removes the need to regress distances, and so the architecture is able to transfer from 2MP to 8MP resolution images without re-training.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 32 references that are in the map. First posted on arXiv 24 May 2024.
Builds on
24 of 32 references.
References · 24
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 455
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
- 2017Joint 3D Proposal Generation and Object Detection from View Aggregationcited by 325
- 20163D Bounding Box Estimation Using Deep Learning and Geometrycited by 277
- 2020Deep Continuous Fusion for Multi-Sensor 3D Object Detectioncited by 263
- 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
- 2020Multi-Task Multi-Sensor Fusion for 3D Object Detectioncited by 203
- 2019CenterMask : Real-Time Anchor-Free Instance Segmentationcited by 200
12 more
- 2021Deep Parametric Continuous Convolutional Neural Networkscited by 161
- 2021IntentNet: Learning to Predict Intention from Raw Sensor Datacited by 158
- 2020PnPNet: End-to-End Perception and Prediction with Tracking in the Loopcited by 143
- 2019GS3D: An Efficient 3D Object Detection Framework for Autonomous Drivingcited by 106
- 2018MonoGRNet: A Geometric Reasoning Network for Monocular 3D Object Localizationcited by 84
- 2020HDNET: Exploiting HD Maps for 3D Object Detectioncited by 78
- 2019Sensor Fusion for Joint 3D Object Detection and Semantic Segmentationcited by 48
- 2020Multi-View Fusion of Sensor Data for Improved Perception and Prediction in Autonomous Drivingcited by 41
- 2019Triangulation Learning Network: from Monocular to Stereo 3D Object Detectioncited by 40
- 2019MonoLoco: Monocular 3D Pedestrian Localization and Uncertainty Estimationcited by 39
- 2019Mono3D++: Monocular 3D Vehicle Detection with Two-Scale 3D Hypotheses and Task Priorscited by 37
- 2019Robust Semantic Segmentation in Adverse Weather Conditions by means of Sensor Data Fusioncited by 18
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.