Progressive Bird's Eye View Perception for Safety-Critical Autonomous Driving: A Comprehensive Survey
On the map: End-to-end autonomous driving → VLMs for autonomous driving
Abstract (arXiv)
Bird's-Eye-View (BEV) perception has become a foundational paradigm in autonomous driving, enabling unified spatial representations that support robust multi-sensor fusion and multi-agent collaboration. As autonomous vehicles transition from controlled environments to real-world deployment, ensuring the safety and reliability of BEV perception in complex scenarios - such as occlusions, adverse weather, and dynamic traffic - remains a critical challenge. This survey provides the first comprehensive review of BEV perception from a safety-critical perspective, systematically analyzing state-of-the-art frameworks and implementation strategies across three progressive stages: single-modality vehicle-side, multimodal vehicle-side, and multi-agent collaborative perception. Furthermore, we examine public datasets encompassing vehicle-side, roadside, and collaborative settings, evaluating their relevance to safety and robustness. We also identify key open-world challenges - including open-set recognition, large-scale unlabeled data, sensor degradation, and inter-agent communication latency - and outline future research directions, such as integration with end-to-end autonomous driving systems, embodied intelligence, and large language models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in VLMs for autonomous driving, one of 9 directions in End-to-end autonomous driving. Builds on 69 of its 325 references that are in the map. First posted on arXiv 11 Aug 2025.
Builds on
69 of 325 references.
References · 69
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclescited by 493
- 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
- 2020Virtual KITTI 2cited by 353
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 341
- 2020V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Predictioncited by 292
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
- 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
38 more
- 2022CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformerscited by 227
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 2018Orthographic Feature Transform for Monocular 3D Object Detectioncited by 202
- 2022BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Drivingcited by 191
- 2020A2D2: Audi Autonomous Driving Datasetcited by 190
- 2019Pseudo-LiDAR++: Accurate Depth for 3D Object Detection in Autonomous Drivingcited by 188
- 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 178
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 176
- 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
- 2024An Extensible Framework for Open Heterogeneous Collaborative Perceptioncited by 87
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challengescited by 74
- 2022AutoAlign: Pixel-Instance Feature Aggregation for Multi-Modal 3D Object Detectioncited by 70
- 2023HM-ViT: Hetero-modal Vehicle-to-Vehicle Cooperative perception with vision transformercited by 70
- 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPTcited by 66
- 2022MSMDFusion: Fusing LiDAR and Camera at Multiple Scales with Multi-Depth Seeds for 3D Object Detectioncited by 62
- 2025A Survey of World Models for Autonomous Drivingcited by 60
- 2023Asynchrony-Robust Collaborative Perception via Bird's Eye View Flowcited by 58
- 2024Towards Realistic Data Generation for Real-World Super-Resolutioncited by 56
- 2022Polar Parametrization for Vision-based Surround-View 3D Detectioncited by 53
- 2022Learning for Vehicle-to-Vehicle Cooperative Perception under Lossy Communicationcited by 47
- 2023FastPillars: A Deployment-friendly Pillar-based 3D Detectorcited by 39
- 2020RangeRCNN: Towards Fast and Accurate 3D Object Detection with Range Image Representationcited by 37
- 2025YOLOE: Real-Time Seeing Anythingcited by 36
- 2023BEVFusion4D: Learning LiDAR-Camera Fusion Under Bird's-Eye-View via Cross-Modality Guidance and Temporal Aggregationcited by 31
- 2024V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Predictioncited by 31
- 2023BEVHeight++: Toward Robust Visual Centric 3D Object Detectioncited by 30
- 2024RoboTron-Drive: All-in-One Large Multimodal Model for Autonomous Drivingcited by 30
- 2024OmniHD-Scenes: A Next-Generation Multimodal Dataset for Autonomous Drivingcited by 27
- 2025V2V-LLM: Vehicle-to-Vehicle Cooperative Autonomous Driving with Multimodal Large Language Modelscited by 27
- 2023Vehicle-Infrastructure Cooperative 3D Object Detection via Feature Flow Predictioncited by 25
- 2024V2X-Radar: A Multi-modal Dataset with 4D Radar for Cooperative Perceptioncited by 22
- 2025MapFusion: A Novel BEV Feature Fusion Network for Multi-modal Map Constructioncited by 21
- 2024RoboFusion: Towards Robust Multi-Modal 3D Object Detection via SAMcited by 20
- 2025Toward Real-world BEV Perception: Depth Uncertainty Estimation via Gaussian Splattingcited by 20
- 2023CoBEV: Elevating Roadside 3D Object Detection with Depth and Height Complementaritycited by 18
- 2024V2X-R: Cooperative LiDAR-4D Radar Fusion with Denoising Diffusion for 3D Object Detectioncited by 18
- 2022CO^3: Cooperative Unsupervised 3D Representation Learning for Autonomous Drivingcited by 15
- 2023Calibration-free BEV Representation for Infrastructure Perceptioncited by 15
50 most cited of 69 All 69 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026RESBev: Making BEV Perception More Robust
- 2026Closed-Loop Evaluation of Bird's-Eye-View Maps from Cross-View Transformers as Inputs to Behavior-Cloning Policies
- 2023An Autonomous Driving Model Integrated with BEV-V2X Perception, Fusion Prediction of Motion and Occupancy, and Driving Planning, in Complex Traffic Intersections
- 2023Talk2BEV: Language-enhanced Bird's-eye View Maps for Autonomous Driving
- 2023M-BEV: Masked BEV Perception for Robust Autonomous Driving
- 2026A Reliable Context-Aware and Temporal Planning Framework for Autonomous Driving
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers
- 2026BEVLM: Distilling Semantic Knowledge from LLMs into Bird's-Eye View Representations