Vision-Centric BEV Perception: A Survey
Not on the map. Why?
Abstract (arXiv)
In recent years, vision-centric Bird's Eye View (BEV) perception has garnered significant interest from both industry and academia due to its inherent advantages, such as providing an intuitive representation of the world and being conducive to data fusion. The rapid advancements in deep learning have led to the proposal of numerous methods for addressing vision-centric BEV perception challenges. However, there has been no recent survey encompassing this novel and burgeoning research field. To catalyze future research, this paper presents a comprehensive survey of the latest developments in vision-centric BEV perception and its extensions. It compiles and organizes up-to-date knowledge, offering a systematic review and summary of prevalent algorithms. Additionally, the paper provides in-depth analyses and comparative results on various BEV perception tasks, facilitating the evaluation of future works and sparking new research directions. Furthermore, the paper discusses and shares valuable empirical implementation details to aid in the advancement of related algorithms.
Key facts. Cited by 126 papers in the map (data through 7 Oct 2026). Builds on 119 of its 180 references that are in the map. First posted on arXiv 4 Aug 2022.
Builds on
119 of 180 references.
References · 119
- 2017Attention Is All You Needcited by 59,932
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2020Reformer: The Efficient Transformercited by 1,658
- 2017Deformable Convolutional Networkscited by 1,481
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
38 more
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2020Center-based 3D Object Detection and Trackingcited by 1,143
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
- 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 852
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2017Generative Adversarial Networks: An Overviewcited by 588
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 502
- 2020Sparse R-CNN: End-to-End Object Detection with Learnable Proposalscited by 494
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 456
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 455
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
- 2021FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detectioncited by 444
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 351
- 2019Class-balanced Grouping and Sampling for Point Cloud 3D Object Detectioncited by 350
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
- 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 326
- 2017Joint 3D Proposal Generation and Object Detection from View Aggregationcited by 325
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2020Deep Continuous Fusion for Multi-Sensor 3D Object Detectioncited by 263
- 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 263
- 2019M3D-RPN: Monocular 3D Region Proposal Network for Object Detectioncited by 251
- 2020Sparse Sinkhorn Attentioncited by 250
- 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 248
- 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
- 2022CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformerscited by 227
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2018Orthographic Feature Transform for Monocular 3D Object Detectioncited by 201
50 most cited of 119 All 119 (JSON)
Built on by
Citing papers per year: 2022: 6; 2023: 42; 2024: 37; 2025: 26; 2026: 15.
126 papers.
Sort:
By area:
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2024Holistic Autonomous Driving Understanding by Bird's-Eye-View Injected Multi-Modal Large Modelscited by 75
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 72
- 2023Bird's-Eye-View Scene Graph for Vision-Language Navigationcited by 71
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 67
- 2023LXL: LiDAR Excluded Lean 3D Object Detection with 4D Imaging Radar and Camera Fusioncited by 57
- 2022Uncertainty-aware Vision-based Metric Cross-view Geolocalizationcited by 54
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
- 2024GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splattingcited by 50
- 2023RoboBEV: Towards Robust Bird's Eye View Perception under Corruptionscited by 42
38 more
- 2023InstaGraM: Instance-level Graph Modeling for Vectorized HD Map Learningcited by 40
- 2022SuperFusion: Multilevel LiDAR-Camera Fusion for Long-Range HD Map Generationcited by 39
- 2024Benchmarking and Improving Bird's Eye View Perception Robustness in Autonomous Drivingcited by 39
- 2023Among Us: Adversarially Robust Collaborative Perception by Consensuscited by 37
- 2024A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspectivecited by 37
- 2023UniWorld: Autonomous Driving Pre-training via World Modelscited by 32
- 2023BEVFusion4D: Learning LiDAR-Camera Fusion Under Bird's-Eye-View via Cross-Modality Guidance and Temporal Aggregationcited by 31
- 2023Data-driven Traffic Simulation: A Comprehensive Reviewcited by 29
- 2024Vision-based 3D occupancy prediction in autonomous driving: a review and outlookcited by 29
- 2024Is Your HD Map Constructor Reliable under Sensor Corruptions?cited by 28
- 2023Towards Domain Generalization for Multi-view 3D Object Detection in Bird-Eye-Viewcited by 27
- 2025CoSDH: Communication-Efficient Collaborative Perception via Supply-Demand Awareness and Intermediate-Late Hybridizationcited by 27
- 2023Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Reviewcited by 25
- 2022Are We Ready for Vision-Centric Driving Streaming Perception? The ASAP Benchmarkcited by 24
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunitiescited by 24
- 2024The RoboDrive Challenge: Drive Anytime Anywhere in Any Conditioncited by 23
- 2024GEOcc: Geometrically Enhanced 3D Occupancy Network with Implicit-Explicit Depth Fusion and Contextual Self-Supervisioncited by 21
- 2024Navigation Instruction Generation with BEV Perception and Large Language Modelscited by 20
- 2022Focal-PETR: Embracing Foreground for Efficient Multi-Camera 3D Object Detectioncited by 19
- 2025LiMoE: Mixture of LiDAR Representation Learners from Automotive Scenescited by 19
- 2023On the Adversarial Robustness of Camera-based 3D Object Detectioncited by 15
- 2023Calibration-free BEV Representation for Infrastructure Perceptioncited by 15
- 2023UniScene: Multi-Camera Unified Pre-training via 3D Scene Reconstruction for Autonomous Drivingcited by 15
- 2024BEVSpread: Spread Voxel Pooling for Bird's-Eye-View Representation in Vision-based Roadside 3D Object Detectioncited by 15
- 2023Surround-View Vision-based 3D Detection for Autonomous Driving: A Surveycited by 14
- 2023FedBEVT: Federated Learning Bird's Eye View Perception Transformer in Road Traffic Systemscited by 14
- 2024GAFusion: Adaptive Fusing LiDAR and Camera with Multiple Guidance for 3D Object Detectioncited by 14
- 2025Rethinking Driving World Model as Synthetic Data Generator for Perception Taskscited by 14
- 2023Bi-Mapper: Holistic BEV Semantic Mapping for Autonomous Drivingcited by 13
- 2023AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Drivingcited by 13
- 2023F2BEV: Bird's Eye View Generation from Surround-View Fisheye Camera Images for Automated Drivingcited by 12
- 2023VIMI: Vehicle-Infrastructure Multi-view Intermediate Fusion for Camera-based 3D Object Detectioncited by 12
- 2024SeaBird: Segmentation in Bird's View with Dice Loss Improves Monocular 3D Detection of Large Objectscited by 12
- 2025SafeMap: Robust HD Map Construction from Incomplete Observationscited by 12
- 2023Adv3D: Generating 3D Adversarial Examples for 3D Object Detection in Driving Scenarios with NeRFcited by 10
- 2024BEV-TSR: Text-Scene Retrieval in BEV Space for Autonomous Drivingcited by 10
- 2023Navya3DSeg -- Navya 3D Semantic Segmentation Dataset & split generation for autonomous vehiclescited by 9
- 2023VMA: Divide-and-Conquer Vectorized Map Annotation System for Large-Scale Driving Scenecited by 9
50 most cited of 126 All 126 (JSON)
- 2026LEAP: Learning Emergent Active Perception for Quadruped Navigation15 Sep 2026
- 2026MM-BEV: Enhancing Timeliness by Computing Where and When it Matters15 Aug 2026
- 2026OccAnyScene: Towards Unified Indoor-Outdoor 3D Occupancy Prediction9 Aug 2026
- 2026SimBEV2X: A Large-Scale Dataset and Data Generation Tool for Multi-Task Vehicle-to-Everything Cooperative Perception27 Jul 2026
- 2026GPOcc++: Unified Sparse Gaussian Occupancy Prediction with Visual Geometry Priors15 Jul 2026
- 2026CMTFormer: Marrying Transformer with Hierarchical Information Interaction for RGB-Event Object Detection28 Jun 2026
- 2026OneCanvas: 3D Scene Understanding via Panoramic Reprojection17 Jun 2026
- 2026Cross-View Urban Traffic Dataset: Drone-Supervised Ground Truth for Monocular Bird's-Eye View Localization5 Jun 2026
- 2026Lipschitz Optimization for Formal Verification of Homographies22 May 2026
- 2026Co-Fusion4D: Spatio-temporal Collaborative Fusion for Robust 3D Object Detection19 May 2026
- 2026Mitigating Multimodal Hallucination via Phase-wise Self-reward20 Apr 2026
- 2026Uncertainty-Aware Trajectory Prediction: A Unified Framework Harnessing Positional and Semantic Uncertainties31 Mar 2026
38 more
- 2026Towards Intrinsic-Aware Monocular 3D Object Detection28 Mar 2026
- 2026BEVLM: Distilling Semantic Knowledge from LLMs into Bird's-Eye View Representations6 Mar 2026
- 2026Privacy-Concealing Cooperative Perception for BEV Scene Segmentation14 Feb 2026
- 2025SCAFusion: A Multimodal 3D Detection Framework for Small Object Detection in Lunar Surface Exploration27 Dec 2025
- 2025StereoMV2D: A Sparse Temporal Stereo-Enhanced Framework for Robust Multi-View 3D Object Detection19 Dec 2025
- 2025Spatial Retrieval Augmented Autonomous Driving7 Dec 2025
- 2025BeLLA: End-to-End Birds Eye View Large Language Assistant for Autonomous Driving5 Dec 2025
- 2025Invisible Triggers, Visible Threats! Road-Style Adversarial Creation Attack for Visual 3D Detection in Autonomous Driving11 Nov 2025
- 2025Energy-Efficient Autonomous Driving with Adaptive Perception and Robust Decision29 Oct 2025
- 2025Rethinking Driving World Model as Synthetic Data Generator for Perception Tasks22 Oct 2025
- 2025Easy3D-Labels: Supervising Semantic Occupancy Estimation with 3D Pseudo-Labels for Automotive Perception30 Sep 2025
- 20254D Driving Scene Generation With Stereo Forcing24 Sep 2025
- 2025FishBEV: Distortion-Resilient Bird's Eye View Segmentation with Surround-View Fisheye Cameras17 Sep 2025
- 2025Adaptive Dual Uncertainty Optimization: Boosting Monocular 3D Object Detection under Test-Time Shifts28 Aug 2025
- 2025Neural Rendering for Sensor Adaptation in 3D Object Detection18 Aug 2025
- 2025CHARM3R: Towards Unseen Camera Height Robust Monocular 3D Detector15 Aug 2025
- 2025Humanoid Occupancy: Enabling A Generalized Multimodal Occupancy Perception System on Humanoid Robots27 Jul 2025
- 2025SafeMap: Robust HD Map Construction from Incomplete Observations1 Jul 2025
- 2025A Survey of Multi-sensor Fusion Perception for Embodied AI: Background, Methods, Challenges and Prospects24 Jun 2025
- 2025BEVCALIB: LiDAR-Camera Calibration via Geometry-Guided Bird's-Eye View Representations3 Jun 2025
- 2025See through the Dark: Learning Illumination-affined Representations for Nighttime Occupancy Prediction27 May 2025
- 2025Towards Latency-Aware 3D Streaming Perception for Autonomous Driving27 Apr 2025
- 2025InteractionMap: Improving Online Vectorized HDMap Construction with Interaction27 Mar 2025
- 2025Learning A Zero-shot Occupancy Network from Vision Foundation Models via Self-supervised Adaptation10 Mar 2025
- 2025HexPlane Representation for 3D Semantic Scene Understanding7 Mar 2025
- 2025CoSDH: Communication-Efficient Collaborative Perception via Supply-Demand Awareness and Intermediate-Late Hybridization5 Mar 2025
- 2025Leveraging V2X for Collaborative HD Maps Construction Using Scene Graph Generation14 Feb 2025
- 2025SimBEV: A Synthetic Multi-Task Multi-Sensor Driving Data Generation Tool and Dataset4 Feb 2025
- 2025LiMoE: Mixture of LiDAR Representation Learners from Automotive Scenes7 Jan 2025
- 2024HV-BEV: Decoupling Horizontal and Vertical Feature Sampling for Multi-View 3D Object Detection25 Dec 2024
- 2024GSRender: Deduplicated Occupancy Prediction via Weakly Supervised 3D Gaussian Splatting19 Dec 2024
- 2024TopView: Vectorising road users in a bird's eye view from uncalibrated street-level imagery with deep learning18 Dec 2024
- 2024A Black-Box Evaluation Framework for Semantic Robustness in Bird's Eye View Detection18 Dec 2024
- 2024LightOcc: Lightweight Spatial Embedding for Efficient Vision-based 3D Occupancy Prediction8 Dec 2024
- 2024A Resource Efficient Fusion Network for Object Detection in Bird's-Eye View using Camera and Raw Radar Data20 Nov 2024
- 2024SimpleBEV: Improved LiDAR-Camera Fusion Architecture for 3D Object Detection8 Nov 2024
- 2024GAFusion: Adaptive Fusing LiDAR and Camera with Multiple Guidance for 3D Object Detection1 Nov 2024
- 2024Focus on BEV: Self-calibrated Cycle View Transformation for Monocular Birds-Eye-View Segmentation21 Oct 2024
50 newest of 126 All 126 (JSON)
- 2023Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Reviewcited by 25
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunitiescited by 24
- 2024BEV-TSR: Text-Scene Retrieval in BEV Space for Autonomous Drivingcited by 10
- 2025Spatial Retrieval Augmented Autonomous Drivingcited by 5
- 2023An Overview about Emerging Technologies of Autonomous Drivingcited by 2
- 2025Energy-Efficient Autonomous Driving with Adaptive Perception and Robust Decisioncited by 0
- 2025Spatial Retrieval Augmented Autonomous Driving7 Dec 2025
- 2025Energy-Efficient Autonomous Driving with Adaptive Perception and Robust Decision29 Oct 2025
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities16 Jan 2024
- 2024BEV-TSR: Text-Scene Retrieval in BEV Space for Autonomous Driving2 Jan 2024
- 2023An Overview about Emerging Technologies of Autonomous Driving23 Jun 2023
- 2023Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Review2 Mar 2023
- 2026OneCanvas: 3D Scene Understanding via Panoramic Reprojection17 Jun 2026
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 72
- 2023Bird's-Eye-View Scene Graph for Vision-Language Navigationcited by 71
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 67
- 2023LXL: LiDAR Excluded Lean 3D Object Detection with 4D Imaging Radar and Camera Fusioncited by 57
- 2022Uncertainty-aware Vision-based Metric Cross-view Geolocalizationcited by 54
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
- 2024GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splattingcited by 50
- 2023RoboBEV: Towards Robust Bird's Eye View Perception under Corruptionscited by 42
- 2023InstaGraM: Instance-level Graph Modeling for Vectorized HD Map Learningcited by 40
12 most cited of 112 All 112 (JSON)
- 2026LEAP: Learning Emergent Active Perception for Quadruped Navigation15 Sep 2026
- 2026MM-BEV: Enhancing Timeliness by Computing Where and When it Matters15 Aug 2026
- 2026OccAnyScene: Towards Unified Indoor-Outdoor 3D Occupancy Prediction9 Aug 2026
- 2026SimBEV2X: A Large-Scale Dataset and Data Generation Tool for Multi-Task Vehicle-to-Everything Cooperative Perception27 Jul 2026
- 2026GPOcc++: Unified Sparse Gaussian Occupancy Prediction with Visual Geometry Priors15 Jul 2026
- 2026CMTFormer: Marrying Transformer with Hierarchical Information Interaction for RGB-Event Object Detection28 Jun 2026
- 2026Cross-View Urban Traffic Dataset: Drone-Supervised Ground Truth for Monocular Bird's-Eye View Localization5 Jun 2026
- 2026Lipschitz Optimization for Formal Verification of Homographies22 May 2026
- 2026Co-Fusion4D: Spatio-temporal Collaborative Fusion for Robust 3D Object Detection19 May 2026
- 2026Uncertainty-Aware Trajectory Prediction: A Unified Framework Harnessing Positional and Semantic Uncertainties31 Mar 2026
- 2026Towards Intrinsic-Aware Monocular 3D Object Detection28 Mar 2026
- 2026BEVLM: Distilling Semantic Knowledge from LLMs into Bird's-Eye View Representations6 Mar 2026
12 newest of 112 All 112 (JSON)