PIXOR: Real-time 3D Object Detection from Point Clouds
Not on the map. Why?
Abstract (arXiv)
We address the problem of real-time 3D object detection from point clouds in the context of autonomous driving. Computation speed is critical as detection is a necessary component for safety. Existing approaches are, however, expensive in computation due to high dimensionality of point clouds. We utilize the 3D data more efficiently by representing the scene from the Bird's Eye View (BEV), and propose PIXOR, a proposal-free, single-stage detector that outputs oriented 3D object estimates decoded from pixel-wise neural network predictions. The input representation, network architecture, and model optimization are especially designed to balance high accuracy and real-time efficiency. We validate PIXOR on two datasets: the KITTI BEV object detection benchmark, and a large-scale 3D vehicle detection benchmark. In both datasets we show that the proposed detector surpasses other state-of-the-art methods notably in terms of Average Precision (AP), while still runs at >28 FPS.
Key facts. Cited by 358 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 102; 2022: 96; 2023: 77; 2024: 41; 2025: 30; 2026: 12.
358 papers.
Sort:
By area:
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2021OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communicationcited by 304
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
- 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 248
- 2021End-to-end Interpretable Neural Motion Plannercited by 240
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 211
38 more
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2021TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviorscited by 192
- 2021Multimodal Virtual Point 3D Detectioncited by 166
- 2021IntentNet: Learning to Predict Intention from Raw Sensor Datacited by 158
- 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 158
- 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
- 2021Offboard 3D Object Detection from Point Cloud Sequencescited by 144
- 2021RangeDet:In Defense of Range View for LiDAR-based 3D Object Detectioncited by 140
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2022Not All Points Are Equal: Learning Highly Efficient Point-based Detectors for 3D LiDAR Point Cloudscited by 131
- 2021LiDAR R-CNN: An Efficient and Universal 3D Object Detectorcited by 129
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2021RSN: Range Sparse Net for Efficient, Accurate LiDAR 3D Object Detectioncited by 115
- 2021Improving 3D Object Detection with Channel-wise Transformercited by 108
- 2021Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentationcited by 107
- 20213D Object Detection for Autonomous Driving: A Surveycited by 106
- 2023Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusioncited by 105
- 2022Voxel Set Transformer: A Set-to-Set Approach to 3D Object Detection from Point Cloudscited by 102
- 2021Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attackscited by 101
- 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
- 2021SPG: Unsupervised Domain Adaptation for 3D Object Detection via Semantic Point Generationcited by 93
- 2021FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detectioncited by 92
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 91
- 2021AFDetV2: Rethinking the Necessity of the Second Stage for Object Detection from Point Cloudscited by 88
- 2022Surface Representation for Point Cloudscited by 84
- 2022Fully Sparse 3D Object Detectioncited by 84
- 2021Geometry-based Distance Decomposition for Monocular 3D Object Detectioncited by 83
- 2021Free-form Description Guided 3D Visual Graph Network for Object Grounding in Point Cloudcited by 81
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 76
- 2021M3DeTR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformerscited by 74
- 2022LidarMultiNet: Towards a Unified Multi-Task Network for LiDAR Perceptioncited by 74
- 20213D-MAN: 3D Multi-frame Attention Network for Object Detectioncited by 73
- 2022Scene Graph Generation: A Comprehensive Surveycited by 73
- 2022Multi-modal Sensor Fusion for Auto Driving Perception: A Surveycited by 73
- 2022LiDAR Snowfall Simulation for Robust 3D Object Detectioncited by 72
- 2021LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detectorcited by 69
- 2021Raw High-Definition Radar for Multi-Task Learningcited by 69
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
50 most cited of 358 All 358 (JSON)
- 2026Learning Structurally Consistent Representations for Multi-View Radar Semantic Segmentation30 Jun 2026
- 2026Towards Compact Autonomous Driving Perception with Balanced Learning and Multi-sensor Fusion2 Jun 2026
- 2026Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks24 May 2026
- 2026Adversarial Trust Poisoning in Vehicular Collaborative Perception21 May 2026
- 2026TriBand-BEV: Real-Time LiDAR-Only 3D Pedestrian Detection via Height-Aware BEV and High-Resolution Feature Fusion12 May 2026
- 2026UniD-Shift: Towards Unified Semantic Segmentation via Interpretable Share-Private Multimodal Decomposition8 May 2026
- 2026Revisiting Radar Perception With Spectral Point Clouds9 Apr 2026
- 2026RAVEN: Radar Adaptive Vision Encoders for Efficient Chirp-wise Object Detection and Segmentation6 Apr 2026
- 2026Bridging the Dimensionality Gap: A Taxonomy and Survey of 2D Vision Model Adaptation for 3D Analysis3 Apr 2026
- 2026Group3D: MLLM-Driven Semantic Grouping for Open-Vocabulary 3D Object Detection23 Mar 2026
- 2026AdaRadar: Rate Adaptive Spectral Compression for Radar-based Perception18 Mar 2026
- 2026On the Feasibility and Opportunity of Autoregressive 3D Object Detection9 Mar 2026
38 more
- 2025CrownGen: Patient-customized Crown Generation via Point Diffusion Model26 Dec 2025
- 2025Roles of MLLMs in Visually Rich Document Retrieval for RAG: A Survey16 Dec 2025
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Models3 Dec 2025
- 2025QAL: A Loss for Recall Precision Balance in 3D Reconstruction21 Nov 2025
- 2025LiSTAR: Ray-Centric World Models for 4D LiDAR Sequences in Autonomous Driving20 Nov 2025
- 2025Rethinking the Encoding and Annotating of 3D Bounding Box: Corner-Aware 3D Object Detection from Point Clouds18 Nov 2025
- 2025FractalCloud: A Fractal-Inspired Architecture for Efficient Large-Scale Point Cloud Processing10 Nov 2025
- 20253DPillars: Pillar-based two-stage 3D object detection6 Sep 2025
- 2025Domain Adaptation for Different Sensor Configurations in 3D Object Detection4 Sep 2025
- 2025To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software28 Aug 2025
- 2025OpenM3D: Open Vocabulary Multi-view Indoor 3D Object Detection without Human Annotations27 Aug 2025
- 2025SAMFusion: Sensor-Adaptive Multimodal Fusion for 3D Object Detection in Adverse Weather22 Aug 2025
- 2025DoppDrive: Doppler-Driven Temporal Aggregation for Improved Radar Object Detection17 Aug 2025
- 2025HQ-OV3D: A High Box Quality Open-World 3D Detection Framework based on Diffision Model12 Aug 2025
- 2025Robust Single-Stage Fully Sparse 3D Object Detection via Detachable Latent Diffusion5 Aug 2025
- 2025Rethinking Backbone Design for Lightweight 3D Object Detection in LiDAR1 Aug 2025
- 2025Perspective-Invariant 3D Object Detection23 Jul 2025
- 2025Rethink 3D Object Detection from Physical World30 Jun 2025
- 2025DSOcc: Leveraging Depth Awareness and Semantic Aid to Boost Camera-Based 3D Semantic Occupancy Prediction27 May 2025
- 2025Multimodal and Multiview Deep Fusion for Autonomous Marine Navigation2 May 2025
- 2025AttentiveGRU: Recurrent Spatio-Temporal Modeling for Advanced Radar-Based BEV Object Detection1 Apr 2025
- 2025Intrinsic-feature-guided 3D Object Detection1 Apr 2025
- 2025GLRD: Global-Local Collaborative Reason and Debate with PSL for 3D Open-Vocabulary Detection26 Mar 2025
- 2025GASP: Unifying Geometric and Semantic Self-Supervised Pre-training for Autonomous Driving19 Mar 2025
- 2025SparseAlign: A Fully Sparse Framework for Cooperative Object Detection17 Mar 2025
- 2025Unlocking Generalization Power in LiDAR Point Cloud Registration13 Mar 2025
- 2025V2X-ReaLO: An Open Online Framework and Dataset for Cooperative Perception in Reality13 Mar 2025
- 2025Improving Generalization Ability for 3D Object Detection by Learning Sparsity-invariant Features4 Feb 2025
- 2025Advances in Set Function Learning: A Survey of Techniques and Applications24 Jan 2025
- 2025LayerMix: Enhanced Data Augmentation through Fractal Integration for Robust Deep Learning8 Jan 2025
- 2024Joint Perception and Prediction for Autonomous Driving: A Survey18 Dec 2024
- 2024DSRC: Learning Density-insensitive and Semantic-aware Collaborative Representation against Corruptions14 Dec 2024
- 2024CLAP: Unsupervised 3D Representation Learning for Fusion 3D Perception via Curvature Sampling and Prototype Learning4 Dec 2024
- 2024A Resource Efficient Fusion Network for Object Detection in Bird's-Eye View using Camera and Raw Radar Data20 Nov 2024
- 2024Robust 3D Semantic Occupancy Prediction with Calibration-free Spatial Transformation19 Nov 2024
- 2024EMPERROR: A Flexible Generative Perception Error Model for Probing Self-Driving Planners12 Nov 2024
- 2024LiDAttack: Robust Black-box Attack on LiDAR-based Object Detection4 Nov 2024
- 20243DGS-DET: Empower 3D Gaussian Splatting with Boundary Guidance and Box-Focused Sampling for Indoor 3D Object Detection2 Oct 2024
50 newest of 358 All 358 (JSON)
- 2021End-to-end Interpretable Neural Motion Plannercited by 240
- 2021Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attackscited by 101
- 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
- 2023Unsupervised 3D Perception with 2D Vision-Language Distillation for Autonomous Drivingcited by 37
- 2022Time3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Drivingcited by 30
- 2023Implicit Occupancy Flow Fields for Perception and Prediction in Self-Drivingcited by 30
- 2023Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Reviewcited by 25
- 2024QuAD: Query-based Interpretable Neural Motion Planning for Autonomous Drivingcited by 11
- 2021Trajectory Prediction for Autonomous Driving with Topometric Mapcited by 6
- 2025GASP: Unifying Geometric and Semantic Self-Supervised Pre-training for Autonomous Drivingcited by 4
- 2024EMPERROR: A Flexible Generative Perception Error Model for Probing Self-Driving Plannerscited by 1
- 2025GASP: Unifying Geometric and Semantic Self-Supervised Pre-training for Autonomous Driving19 Mar 2025
- 2024EMPERROR: A Flexible Generative Perception Error Model for Probing Self-Driving Planners12 Nov 2024
- 2024QuAD: Query-based Interpretable Neural Motion Planning for Autonomous Driving1 Apr 2024
- 2023Unsupervised 3D Perception with 2D Vision-Language Distillation for Autonomous Driving25 Sep 2023
- 2023Implicit Occupancy Flow Fields for Perception and Prediction in Self-Driving2 Aug 2023
- 2023Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Review2 Mar 2023
- 2022Time3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Driving30 May 2022
- 2021Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attacks17 Jun 2021
- 2021Trajectory Prediction for Autonomous Driving with Topometric Map9 May 2021
- 2021End-to-end Interpretable Neural Motion Planner17 Jan 2021
- 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Driving16 Jan 2021
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2021OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communicationcited by 304
- 2023Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusioncited by 105
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 91
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 45
- 2024UnO: Unsupervised Occupancy Fields for Perception and Forecastingcited by 40
- 2025Perspective-Invariant 3D Object Detectioncited by 16
- 2025LiSTAR: Ray-Centric World Models for 4D LiDAR Sequences in Autonomous Drivingcited by 0
- 2025LiSTAR: Ray-Centric World Models for 4D LiDAR Sequences in Autonomous Driving20 Nov 2025
- 2025Perspective-Invariant 3D Object Detection23 Jul 2025
- 2024UnO: Unsupervised Occupancy Fields for Perception and Forecasting12 Jun 2024
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar 2024
- 2023Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusion2 Nov 2023
- 2022Learning to Generate Realistic LiDAR Point Clouds8 Sep 2022
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformers22 Mar 2022
- 2021OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communication16 Sep 2021
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
- 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 248
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 211
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2021TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviorscited by 192
- 2021Multimodal Virtual Point 3D Detectioncited by 166
12 most cited of 335 All 335 (JSON)
- 2026Learning Structurally Consistent Representations for Multi-View Radar Semantic Segmentation30 Jun 2026
- 2026Towards Compact Autonomous Driving Perception with Balanced Learning and Multi-sensor Fusion2 Jun 2026
- 2026Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks24 May 2026
- 2026Adversarial Trust Poisoning in Vehicular Collaborative Perception21 May 2026
- 2026TriBand-BEV: Real-Time LiDAR-Only 3D Pedestrian Detection via Height-Aware BEV and High-Resolution Feature Fusion12 May 2026
- 2026UniD-Shift: Towards Unified Semantic Segmentation via Interpretable Share-Private Multimodal Decomposition8 May 2026
- 2026Revisiting Radar Perception With Spectral Point Clouds9 Apr 2026
- 2026RAVEN: Radar Adaptive Vision Encoders for Efficient Chirp-wise Object Detection and Segmentation6 Apr 2026
- 2026Bridging the Dimensionality Gap: A Taxonomy and Survey of 2D Vision Model Adaptation for 3D Analysis3 Apr 2026
- 2026Group3D: MLLM-Driven Semantic Grouping for Open-Vocabulary 3D Object Detection23 Mar 2026
- 2026AdaRadar: Rate Adaptive Spectral Compression for Radar-based Perception18 Mar 2026
- 2026On the Feasibility and Opportunity of Autoregressive 3D Object Detection9 Mar 2026
12 newest of 335 All 335 (JSON)