Multi-level and multi-modal feature fusion for accurate 3D object detection in Connected and Automated Vehicles
Not on the map. Why?
Abstract (arXiv)
Aiming at highly accurate object detection for connected and automated vehicles (CAVs), this paper presents a Deep Neural Network based 3D object detection model that leverages a three-stage feature extractor by developing a novel LIDAR-Camera fusion scheme. The proposed feature extractor extracts high-level features from two input sensory modalities and recovers the important features discarded during the convolutional process. The novel fusion scheme effectively fuses features across sensory modalities and convolutional layers to find the best representative global features. The fused features are shared by a two-stage network: the region proposal network (RPN) and the detection head (DH). The RPN generates high-recall proposals, and the DH produces final detection results. The experimental results show the proposed model outperforms more recent research on the KITTI 2D and 3D detection benchmark, particularly for distant and highly occluded instances.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 39 references that are in the map. First posted on arXiv 15 Dec 2022.
Builds on
28 of 39 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2015Fast R-CNNcited by 2,930
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
- 2021FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detectioncited by 444
16 more
- 2017Joint 3D Proposal Generation and Object Detection from View Aggregationcited by 325
- 20163D Bounding Box Estimation Using Deep Learning and Geometrycited by 277
- 2017SqueezeSeg: Convolutional Neural Nets with Recurrent CRF for Real-Time Road-Object Segmentation from 3D LiDAR Point Cloudcited by 231
- 2019MVX-Net: Multimodal VoxelNet for 3D Object Detectioncited by 162
- 2019LaserNet: An Efficient Probabilistic 3D Object Detector for Autonomous Drivingcited by 133
- 2020Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Reviewcited by 107
- 2016Vehicle Detection from 3D Lidar Using Fully Convolutional Networkcited by 105
- 2018SNIPER: Efficient Multi-Scale Trainingcited by 87
- 2021Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detectioncited by 79
- 2019Sensor Fusion for Joint 3D Object Detection and Semantic Segmentationcited by 48
- 2019Bag of Freebies for Training Object Detection Neural Networkscited by 47
- 2019Complexer-YOLO: Real-Time 3D Object Detection and Tracking on Semantic Point Cloudscited by 35
- 20193D Object Detection Using Scale Invariant and Feature Reweighting Networkscited by 23
- 20193D Bounding Box Estimation for Autonomous Vehicles by Cascaded Geometric Constraints and Depurated 2D Detections Using 3D Resultscited by 7
- 2021Traffic-Net: 3D Traffic Monitoring Using a Single Cameracited by 4
- 2019Feature Intertwiner for Object Detectioncited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.