EPNet: Enhancing Point Features with Image Semantics for 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
In this paper, we aim at addressing two critical issues in the 3D detection task, including the exploitation of multiple sensors~(namely LiDAR point cloud and camera image), as well as the inconsistency between the localization and classification confidence. To this end, we propose a novel fusion module to enhance the point features with semantic image features in a point-wise manner without any image annotations. Besides, a consistency enforcing loss is employed to explicitly encourage the consistency of both the localization and classification confidence. We design an end-to-end learnable framework named EPNet to integrate these two components. Extensive experiments on the KITTI and SUN-RGBD datasets demonstrate the superiority of EPNet over the state-of-the-art methods. Codes and models are available at: urlhttps://github.com/happinesslz/EPNet.
Key facts. Cited by 164 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 41; 2023: 42; 2024: 33; 2025: 18; 2026: 9.
164 papers.
Sort:
By area:
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 466
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 336
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2021Multimodal Virtual Point 3D Detectioncited by 166
- 2022Focal Sparse Convolutional Networks for 3D Object Detectioncited by 142
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2022DeepInteraction: 3D Object Detection via Modality Interactioncited by 125
- 2023Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Drivingcited by 114
- 2021SPG: Unsupervised Domain Adaptation for 3D Object Detection via Semantic Point Generationcited by 94
- 2022Sparse Fuse Dense: Towards High Quality 3D Detection with Depth Completioncited by 82
38 more
- 2023LoGoNet: Towards Accurate 3D Object Detection with Local-to-Global Cross-Modal Fusioncited by 80
- 2022Multi-modal Sensor Fusion for Auto Driving Perception: A Surveycited by 76
- 2023UniTR: A Unified and Efficient Multi-Modal Transformer for Bird's-Eye-View Representationcited by 74
- 2022AutoAlign: Pixel-Instance Feature Aggregation for Multi-Modal 3D Object Detectioncited by 70
- 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 67
- 2021GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Monocular 3D Object Detectioncited by 66
- 2021Multi-Modal 3D Object Detection in Autonomous Driving: a Surveycited by 63
- 2022MSMDFusion: Fusing LiDAR and Camera at Multiple Scales with Multi-Depth Seeds for 3D Object Detectioncited by 62
- 2021Behind the Curtain: Learning Occluded Shapes for 3D Object Detectioncited by 58
- 2022Transformation-Equivariant 3D Object Detection for Autonomous Drivingcited by 52
- 2022Benchmarking the Robustness of LiDAR-Camera Fusion for 3D Object Detectioncited by 50
- 2022Voxel Field Fusion for 3D Object Detectioncited by 50
- 2021EPNet++: Cascade Bi-directional Fusion for Multi-Modal 3D Object Detectioncited by 49
- 2021VPFNet: Improving 3D Object Detection with Virtual Point based LiDAR and Stereo Data Fusioncited by 48
- 2024Co-Occ: Coupling Explicit Feature Fusion with Volume Rendering Regularization for Multi-Modal 3D Semantic Occupancy Predictioncited by 48
- 2023UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye Viewcited by 43
- 2022Graph R-CNN: Towards Accurate 3D Object Detection with Semantic-Decorated Local Graphcited by 42
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Visioncited by 40
- 2021LIF-Seg: LiDAR and Camera Image Fusion for 3D LiDAR Semantic Segmentationcited by 34
- 2023GraphAlign: Enhancing Accurate Feature Alignment by Graph matching for Multi-Modal 3D Object Detectioncited by 34
- 2024GraphBEV: Towards Robust BEV Feature Alignment for Multi-Modal 3D Object Detectioncited by 33
- 2022CAT-Det: Contrastively Augmented Transformer for Multi-modal 3D Object Detectioncited by 32
- 2023TR3D: Towards Real-Time Indoor 3D Object Detectioncited by 32
- 2022HRFuser: A Multi-resolution Sensor Fusion Architecture for 2D Object Detectioncited by 31
- 2023BEVFusion4D: Learning LiDAR-Camera Fusion Under Bird's-Eye-View via Cross-Modality Guidance and Temporal Aggregationcited by 31
- 2022CramNet: Camera-Radar Fusion with Ray-Constrained Cross-Attention for Robust 3D Object Detectioncited by 30
- 2023Fully Sparse Fusion for 3D Object Detectioncited by 29
- 2024Vision-based 3D occupancy prediction in autonomous driving: a review and outlookcited by 29
- 2023Uni3DETR: Unified 3D Detection Transformercited by 27
- 2021Security Analysis of Camera-LiDAR Fusion Against Black-Box Attacks on Autonomous Vehiclescited by 26
- 2021Joint Multi-Object Detection and Tracking with Camera-LiDAR Fusion for Autonomous Drivingcited by 26
- 2022Homogeneous Multi-modal Feature Fusion and Interaction for 3D Object Detectioncited by 26
- 2024DVLO: Deep Visual-LiDAR Odometry with Local-to-Global Feature Fusion and Bi-Directional Structure Alignmentcited by 26
- 2024Multi-Sensor Object Anomaly Detection: Unifying Appearance, Geometry, and Internal Propertiescited by 26
- 2024SparseLIF: High-Performance Sparse LiDAR-Camera Fusion for 3D Object Detectioncited by 25
- 2024A Survey on Text-guided 3D Visual Grounding: Elements, Recent Advances, and Future Directionscited by 25
- 2022GLENet: Boosting 3D Object Detectors with Generative Label Uncertainty Estimationcited by 24
- 2022DetMatch: Two Teachers are Better Than One for Joint 2D and 3D Semi-Supervised Object Detectioncited by 20
50 most cited of 164 All 164 (JSON)
- 2026GraphBEV++: Multi-Modal Feature Alignment for Autonomous Driving15 Jun 2026
- 2026xModel-KD: Cross-modal Knowledge Distillation for 3D Scene Perception using LiDAR28 May 2026
- 2026TriBand-BEV: Real-Time LiDAR-Only 3D Pedestrian Detection via Height-Aware BEV and High-Resolution Feature Fusion12 May 2026
- 2026Hyperbolic Distillation: Geometry-Guided Cross-Modal Transfer for Robust 3D Object Detection11 May 2026
- 2026Control Your Queries: Heterogeneous Query Interaction for Camera-Radar Fusion28 Apr 2026
- 2026Weather-Conditioned Branch Routing for Robust LiDAR-Radar 3D Object Detection7 Apr 2026
- 2026Bridging the Dimensionality Gap: A Taxonomy and Survey of 2D Vision Model Adaptation for 3D Analysis3 Apr 2026
- 2026Multi-Modal Decouple and Recouple Network for Robust 3D Object Detection8 Mar 2026
- 2026Wild-Drive: Off-Road Scene Captioning and Path Planning via Robust Multi-modal Routing and Efficient Large Language Model28 Feb 2026
- 2025GeoTeacher: Geometry-Guided Semi-Supervised 3D Object Detection29 Dec 2025
- 2025Diffusion-Based Restoration for Multi-Modal 3D Object Detection in Adverse Weather15 Dec 2025
- 2025UniLION: Towards Unified Autonomous Driving Model with Linear Group RNNs3 Nov 2025
38 more
- 2025All You Need for Object Detection: From Pixels, Points, and Prompts to Next-Gen Fusion and Multimodal LLMs/VLMs in Autonomous Vehicles30 Oct 2025
- 2025InsFusion: Rethink Instance-level LiDAR-Camera Fusion for 3D Object Detection10 Sep 2025
- 2025DVLO4D: Deep Visual-Lidar Odometry with Sparse Spatial-temporal Fusion7 Sep 2025
- 2025CMF-IoU: Multi-Stage Cross-Modal Fusion 3D Object Detection with IoU Joint Prediction18 Aug 2025
- 2025LDRFusion: A LiDAR-Dominant multimodal refinement framework for 3D object detection22 Jul 2025
- 2025Integrating Multi-Modal Sensors: A Review of Fusion Techniques for Intelligent Vehicles27 Jun 2025
- 2025A Survey of Multi-sensor Fusion Perception for Embodied AI: Background, Methods, Challenges and Prospects24 Jun 2025
- 2025DepthFusion: Depth-Aware Hybrid Feature Fusion for LiDAR-Camera 3D Object Detection12 May 2025
- 2025A Review of 3D Object Detection with Vision-Language Models25 Apr 2025
- 2025MS-Occ: Multi-Stage LiDAR-Camera Fusion for 3D Semantic Occupancy Prediction22 Apr 2025
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Vision3 Apr 2025
- 2025GLRD: Global-Local Collaborative Reason and Debate with PSL for 3D Open-Vocabulary Detection26 Mar 2025
- 2025FrustumFusionNets: A Three-Dimensional Object Detection Network Based on Tractor Road Scene18 Mar 2025
- 2025Efficient Multimodal 3D Object Detector via Instance-Level Contrastive Distillation17 Mar 2025
- 2025FGU3R: Fine-Grained Fusion via Unified 3D Representation for Multimodal 3D Object Detection8 Jan 2025
- 2024DecoratingFusion: A LiDAR-Camera Fusion Network with the Combination of Point-level and Feature-level Fusion31 Dec 2024
- 2024Multi-Sensor Object Anomaly Detection: Unifying Appearance, Geometry, and Internal Properties19 Dec 2024
- 2024MSSF: A 4D Radar and Camera Fusion Framework With Multi-Stage Sampling for 3D Object Detection in Autonomous Driving22 Nov 2024
- 2024Cocoon: Robust Multi-Modal Perception with Uncertainty-Aware Sensor Fusion16 Oct 2024
- 2024MMLF: Multi-modal Multi-class Late Fusion for Object Detection with Uncertainty Estimation11 Oct 2024
- 2024Navigating Threats: A Survey of Physical Adversarial Attacks on LiDAR Perception Systems in Autonomous Vehicles30 Sep 2024
- 2024PhantomLiDAR: Cross-modality Signal Injection Attacks against LiDAR26 Sep 2024
- 2024VaLID: Verification as Late Integration of Detections for LiDAR-Camera Fusion23 Sep 2024
- 2024AdaptiveFusion: Adaptive Multi-Modal Multi-View Fusion for 3D Human Body Reconstruction7 Sep 2024
- 2024RegTrack: Simplicity Beneath Complexity in Robust Multi-Modal 3D Multi-Object Tracking1 Sep 2024
- 2024FlatFusion: Delving into Details of Sparse Transformer-based Camera-LiDAR Fusion for Autonomous Driving13 Aug 2024
- 2024DeepInteraction++: Multi-Modality Interaction for Autonomous Driving9 Aug 2024
- 2024Boosting Online 3D Multi-Object Tracking through Camera-Radar Cross Check18 Jul 2024
- 2024Global-Local Collaborative Inference with LLM for Lidar-Based Open-Vocabulary Detection12 Jul 2024
- 2024Boosting 3D Object Detection with Semantic-Aware Multi-Branch Framework8 Jul 2024
- 2024MARS: Multimodal Active Robotic Sensing for Articulated Characterization1 Jul 2024
- 2024BiCo-Fusion: Bidirectional Complementary LiDAR-Camera Fusion for Semantic- and Spatial-Aware 3D Object Detection27 Jun 2024
- 2024A Survey on Text-guided 3D Visual Grounding: Elements, Recent Advances, and Future Directions9 Jun 2024
- 2024ContrastAlign: Toward Robust BEV Feature Alignment via Contrastive Learning for Multi-Modal 3D Object Detection27 May 2024
- 2024A re-calibration method for object detection with multi-modal alignment bias in autonomous driving27 May 2024
- 2024BadFusion: 2D-Oriented Backdoor Attacks against 3D Object Detection6 May 2024
- 2024Vision-based 3D occupancy prediction in autonomous driving: a review and outlook4 May 2024
- 2024Co-Occ: Coupling Explicit Feature Fusion with Volume Rendering Regularization for Multi-Modal 3D Semantic Occupancy Prediction6 Apr 2024
50 newest of 164 All 164 (JSON)
- 2023UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye Viewcited by 43
- 2026Hyperbolic Distillation: Geometry-Guided Cross-Modal Transfer for Robust 3D Object Detectioncited by 0
- 2026xModel-KD: Cross-modal Knowledge Distillation for 3D Scene Perception using LiDARcited by 0
- 2026xModel-KD: Cross-modal Knowledge Distillation for 3D Scene Perception using LiDAR28 May 2026
- 2026Hyperbolic Distillation: Geometry-Guided Cross-Modal Transfer for Robust 3D Object Detection11 May 2026
- 2023UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye View27 Mar 2023
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Visioncited by 40
- 2025A Review of 3D Object Detection with Vision-Language Modelscited by 4
- 2025All You Need for Object Detection: From Pixels, Points, and Prompts to Next-Gen Fusion and Multimodal LLMs/VLMs in Autonomous Vehiclescited by 2
- 2025All You Need for Object Detection: From Pixels, Points, and Prompts to Next-Gen Fusion and Multimodal LLMs/VLMs in Autonomous Vehicles30 Oct 2025
- 2025A Review of 3D Object Detection with Vision-Language Models25 Apr 2025
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Vision3 Apr 2025
- 2023Diffusion-based 3D Object Detection with Random Boxescited by 5
- 2023Diffusion-based 3D Object Detection with Random Boxes5 Sep 2023
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 336
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2021Multimodal Virtual Point 3D Detectioncited by 166
- 2022Focal Sparse Convolutional Networks for 3D Object Detectioncited by 142
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2022DeepInteraction: 3D Object Detection via Modality Interactioncited by 125
- 2023Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Drivingcited by 114
- 2021SPG: Unsupervised Domain Adaptation for 3D Object Detection via Semantic Point Generationcited by 94
- 2022Sparse Fuse Dense: Towards High Quality 3D Detection with Depth Completioncited by 82
- 2023LoGoNet: Towards Accurate 3D Object Detection with Local-to-Global Cross-Modal Fusioncited by 80
12 most cited of 151 All 151 (JSON)
- 2026TriBand-BEV: Real-Time LiDAR-Only 3D Pedestrian Detection via Height-Aware BEV and High-Resolution Feature Fusion12 May 2026
- 2026Control Your Queries: Heterogeneous Query Interaction for Camera-Radar Fusion28 Apr 2026
- 2026Weather-Conditioned Branch Routing for Robust LiDAR-Radar 3D Object Detection7 Apr 2026
- 2026Bridging the Dimensionality Gap: A Taxonomy and Survey of 2D Vision Model Adaptation for 3D Analysis3 Apr 2026
- 2026Multi-Modal Decouple and Recouple Network for Robust 3D Object Detection8 Mar 2026
- 2026Wild-Drive: Off-Road Scene Captioning and Path Planning via Robust Multi-modal Routing and Efficient Large Language Model28 Feb 2026
- 2025GeoTeacher: Geometry-Guided Semi-Supervised 3D Object Detection29 Dec 2025
- 2025Diffusion-Based Restoration for Multi-Modal 3D Object Detection in Adverse Weather15 Dec 2025
- 2025InsFusion: Rethink Instance-level LiDAR-Camera Fusion for 3D Object Detection10 Sep 2025
- 2025DVLO4D: Deep Visual-Lidar Odometry with Sparse Spatial-temporal Fusion7 Sep 2025
- 2025CMF-IoU: Multi-Stage Cross-Modal Fusion 3D Object Detection with IoU Joint Prediction18 Aug 2025
- 2025LDRFusion: A LiDAR-Dominant multimodal refinement framework for 3D object detection22 Jul 2025
12 newest of 151 All 151 (JSON)