mlsanityData to 14 Oct 2026

Can BEV Perception Gracefully Degrade under Sensor Failures?

arXiv 2605.30983 ↗First posted 29 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite the remarkable success of multi-modal bird's-eye view (BEV) perception in autonomous driving, current systems exhibit a critical vulnerability: existing fusion mechanisms are highly brittle to sensor corruptions, often causing catastrophic performance degradation. This vulnerability largely stems from the fact that standard fusion frameworks typically integrate multi-modal representations in a static manner, leading to a precipitous performance collapse under missing or corrupted modalities. In contrast, we show that graceful degradation is achievable through active modality reliability assessment. To this end, we present Grace-BEV, a lightweight and plug-and-play framework that enforces active reliability awareness during multi-modal fusion. Instead of relying on computationally expensive cross-modal interactions, Grace-BEV leverages the aligned BEV space to explicitly assess modality trustworthiness via a TrustGate Router and dynamically recalibrate feature integration using the FailSafe Fusion Block. Furthermore, we devise a Three-Phase Training strategy with Modality Dropout to prevent modality dominance and encourage balanced cross-modal learning under unreliable inputs. Extensive experiments on nuScenes-R and nuScenes-C show that Grace-BEV maintains robust performance across diverse corruption settings. Notably, under catastrophic LiDAR failures where standard baselines collapse to 0.0% mean Average Precision (mAP), Grace-BEV restores performance to as high as 34.7% mAP. Moreover, it improves clean accuracy by up to 1.4%, achieving a strong trade-off between robustness and efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 46 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

29 of 46 references.

References · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  4. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  5. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  6. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
  7. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  8. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  9. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
  10. 2021Scaling Vision with Sparse Mixture of Expertscited by 747
  11. 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 732
  12. 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 724
17 more
  1. 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 658
  2. 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
  3. 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 466
  4. 2019Class-balanced Grouping and Sampling for Point Cloud 3D Object Detectioncited by 350
  5. 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 264
  6. 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
  7. 2022Sparse4D: Multi-view 3D Object Detection with Sparse Spatial-Temporal Fusioncited by 162
  8. 2019Self-Driving Cars: A Surveycited by 148
  9. 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 129
  10. 2022DeepInteraction: 3D Object Detection via Modality Interactioncited by 125
  11. 2021CAT: Cross Attention in Vision Transformercited by 92
  12. 2023LoGoNet: Towards Accurate 3D Object Detection with Local-to-Global Cross-Modal Fusioncited by 80
  13. 2023UniTR: A Unified and Efficient Multi-Modal Transformer for Bird's-Eye-View Representationcited by 74
  14. 2023Temporal Enhanced Training of Multi-view 3D Object Detector via Historical Object Predictioncited by 49
  15. 2023UniBEV: Multi-modal 3D Object Detection with Uniform BEV Encoders for Robustness against Missing Sensor Modalitiescited by 29
  16. 2024DeepInteraction++: Multi-Modality Interaction for Autonomous Drivingcited by 15
  17. 2025Resilient Sensor Fusion under Adverse Sensor Failures via Multi-Modal Expert Fusioncited by 14

Built on by

Not cited yet.