Robustness of Object Detectors in Degrading Weather Conditions
Not on the map. Why?
Abstract (arXiv)
State-of-the-art object detection systems for autonomous driving achieve promising results in clear weather conditions. However, such autonomous safety critical systems also need to work in degrading weather conditions, such as rain, fog and snow. Unfortunately, most approaches evaluate only on the KITTI dataset, which consists only of clear weather scenes. In this paper we address this issue and perform one of the most detailed evaluation on single and dual modality architectures on data captured in real weather conditions. We analyse the performance degradation of these architectures in degrading weather conditions. We demonstrate that an object detection architecture performing good in clear weather might not be able to handle degrading weather conditions. We also perform ablation studies on the dual modality architectures and show their limitations.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 37 of its 53 references that are in the map. First posted on arXiv 16 Jun 2021.
Builds on
37 of 53 references.
References · 37
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2015Fast R-CNNcited by 2,930
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2016YOLO9000: Better, Faster, Strongercited by 1,429
25 more
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,018
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 20203DSSD: Point-based 3D Single Stage Object Detectorcited by 440
- 2019Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Comingcited by 332
- 2017Joint 3D Proposal Generation and Object Detection from View Aggregationcited by 325
- 2020Deep Continuous Fusion for Multi-Sensor 3D Object Detectioncited by 263
- 2020Multi-Task Multi-Sensor Fusion for 3D Object Detectioncited by 203
- 2018Orthographic Feature Transform for Monocular 3D Object Detectioncited by 201
- 2019Stereo R-CNN based 3D Object Detection for Autonomous Drivingcited by 163
- 2019Fast Point R-CNNcited by 119
- 2019Monocular 3D Object Detection Leveraging Accurate Proposals and Shape Reconstructioncited by 106
- 2021Ground-aware Monocular 3D Object Detection for Autonomous Drivingcited by 65
- 2019A*3D Dataset: Towards Autonomous Driving in Challenging Environmentscited by 64
- 2019Physics-Based Rendering for Improving Robustness to Raincited by 49
- 2017CURE-TSR: Challenging Unreal and Real Environments for Traffic Sign Recognitioncited by 32
- 2019Object-Centric Stereo Matching for 3D Object Detectioncited by 29
- 2019Traffic Sign Detection under Challenging Conditions: A Deeper Look Into Performance Variations and Spectral Characteristicscited by 14
- 2019Challenging Environments for Traffic Sign Detection: Reliability Assessment under Inclement Conditionscited by 3
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 9; 2024: 5; 2025: 4; 2026: 3.
28 papers.
Sort:
By area:
- 2021The Norm Must Go On: Dynamic Unsupervised Domain Adaptation by Normalizationcited by 131
- 2022An Efficient Domain-Incremental Learning Approach to Drive in All Weather Conditionscited by 54
- 2022Benchmarking the Robustness of LiDAR-Camera Fusion for 3D Object Detectioncited by 49
- 2023Understanding the Robustness of 3D Object Detection with Bird's-Eye-View Representations in Autonomous Drivingcited by 37
- 2023Neuro-Modulated Hebbian Learning for Fully Test-Time Adaptationcited by 23
- 2023Survey on LiDAR Perception in Adverse Weather Conditionscited by 23
- 2022How Do We Fail? Stress Testing Perception in Autonomous Vehiclescited by 17
- 2024An Empirical Study of the Generalization Ability of Lidar 3D Object Detectors to Unseen Domainscited by 10
- 2025SAMFusion: Sensor-Adaptive Multimodal Fusion for 3D Object Detection in Adverse Weathercited by 10
- 2022Robust 3D Object Detection in Cold Weather Conditionscited by 7
- 2023Energy-based Detection of Adverse Weather Effects in LiDAR Datacited by 7
- 2024Learning Visual Conditioning Tokens to Correct Domain Shift for Fully Test-time Adaptationcited by 7
16 more
- 2022On the Robustness of 3D Object Detectorscited by 5
- 2023Radar Enlighten the Dark: Enhancing Low-Visibility Perception for Automated Vehicles with Camera-Radar Fusioncited by 4
- 2024Dual-Path Adversarial Lifting for Domain Shift Correction in Online Test-time Adaptationcited by 4
- 2023Benchmarking Robustness of AI-Enabled Multi-sensor Fusion Systems: Challenges and Opportunitiescited by 3
- 2024A Black-Box Evaluation Framework for Semantic Robustness in Bird's Eye View Detectioncited by 3
- 2021RiWNet: A moving object instance segmentation Network being Robust in adverse Weather conditionscited by 2
- 2023Towards Robust 3D Object Detection In Rainy Conditionscited by 2
- 2024Domain-Conditioned Transformer for Fully Test-time Adaptationcited by 2
- 2023Sit Back and Relax: Learning to Drive Incrementally in All Weather Conditionscited by 1
- 2025Enhanced 3D Object Detection via Diverse Feature Representations of 4D Radar Tensorcited by 1
- 2023DA-RAW: Domain Adaptive Object Detection for Real-World Adverse Weather Conditionscited by 0
- 2025A Multi-View High-Resolution Foot-Ankle Complex Point Cloud Dataset During Gait for Occlusion-Robust 3D Completioncited by 0
- 2025Progressive Conditioned Scale-Shift Recalibration of Self-Attention for Online Test-time Adaptationcited by 0
- 2026Enhancing Visual Perception in Foggy Conditions via Multiclass Fog Density Modelingcited by 0
- 2026Stereo 4D Radar for 3D Object Detection: Integrating Geometric Alignment and Absolute Velocity Estimationcited by 0
- 2026Beyond Benchmarks: Using VLMs to Reveal Systematic Classification Failures Under Real World Conditionscited by 0
- 2026Beyond Benchmarks: Using VLMs to Reveal Systematic Classification Failures Under Real World Conditions10 Sep 2026
- 2026Stereo 4D Radar for 3D Object Detection: Integrating Geometric Alignment and Absolute Velocity Estimation2 Sep 2026
- 2026Enhancing Visual Perception in Foggy Conditions via Multiclass Fog Density Modeling3 Aug 2026
- 2025Progressive Conditioned Scale-Shift Recalibration of Self-Attention for Online Test-time Adaptation14 Dec 2025
- 2025SAMFusion: Sensor-Adaptive Multimodal Fusion for 3D Object Detection in Adverse Weather22 Aug 2025
- 2025A Multi-View High-Resolution Foot-Ankle Complex Point Cloud Dataset During Gait for Occlusion-Robust 3D Completion15 Jul 2025
- 2025Enhanced 3D Object Detection via Diverse Feature Representations of 4D Radar Tensor10 Feb 2025
- 2024A Black-Box Evaluation Framework for Semantic Robustness in Bird's Eye View Detection18 Dec 2024
- 2024Domain-Conditioned Transformer for Fully Test-time Adaptation14 Oct 2024
- 2024Dual-Path Adversarial Lifting for Domain Shift Correction in Online Test-time Adaptation26 Aug 2024
- 2024Learning Visual Conditioning Tokens to Correct Domain Shift for Fully Test-time Adaptation27 Jun 2024
- 2024An Empirical Study of the Generalization Ability of Lidar 3D Object Detectors to Unseen Domains27 Feb 2024
16 more
- 2023Towards Robust 3D Object Detection In Rainy Conditions2 Oct 2023
- 2023DA-RAW: Domain Adaptive Object Detection for Real-World Adverse Weather Conditions15 Sep 2023
- 2023Benchmarking Robustness of AI-Enabled Multi-sensor Fusion Systems: Challenges and Opportunities6 Jun 2023
- 2023Sit Back and Relax: Learning to Drive Incrementally in All Weather Conditions30 May 2023
- 2023Radar Enlighten the Dark: Enhancing Low-Visibility Perception for Automated Vehicles with Camera-Radar Fusion27 May 2023
- 2023Energy-based Detection of Adverse Weather Effects in LiDAR Data25 May 2023
- 2023Survey on LiDAR Perception in Adverse Weather Conditions13 Apr 2023
- 2023Understanding the Robustness of 3D Object Detection with Bird's-Eye-View Representations in Autonomous Driving30 Mar 2023
- 2023Neuro-Modulated Hebbian Learning for Fully Test-Time Adaptation2 Mar 2023
- 2022On the Robustness of 3D Object Detectors20 Jul 2022
- 2022Benchmarking the Robustness of LiDAR-Camera Fusion for 3D Object Detection30 May 2022
- 2022Robust 3D Object Detection in Cold Weather Conditions24 May 2022
- 2022An Efficient Domain-Incremental Learning Approach to Drive in All Weather Conditions19 Apr 2022
- 2022How Do We Fail? Stress Testing Perception in Autonomous Vehicles26 Mar 2022
- 2021The Norm Must Go On: Dynamic Unsupervised Domain Adaptation by Normalization1 Dec 2021
- 2021RiWNet: A moving object instance segmentation Network being Robust in adverse Weather conditions4 Sep 2021
- 2021The Norm Must Go On: Dynamic Unsupervised Domain Adaptation by Normalizationcited by 131
- 2022An Efficient Domain-Incremental Learning Approach to Drive in All Weather Conditionscited by 54
- 2022Benchmarking the Robustness of LiDAR-Camera Fusion for 3D Object Detectioncited by 49
- 2023Understanding the Robustness of 3D Object Detection with Bird's-Eye-View Representations in Autonomous Drivingcited by 37
- 2023Neuro-Modulated Hebbian Learning for Fully Test-Time Adaptationcited by 23
- 2023Survey on LiDAR Perception in Adverse Weather Conditionscited by 23
- 2024An Empirical Study of the Generalization Ability of Lidar 3D Object Detectors to Unseen Domainscited by 10
- 2025SAMFusion: Sensor-Adaptive Multimodal Fusion for 3D Object Detection in Adverse Weathercited by 10
- 2022Robust 3D Object Detection in Cold Weather Conditionscited by 7
- 2023Energy-based Detection of Adverse Weather Effects in LiDAR Datacited by 7
- 2024Learning Visual Conditioning Tokens to Correct Domain Shift for Fully Test-time Adaptationcited by 7
- 2022On the Robustness of 3D Object Detectorscited by 5
12 most cited of 27 All 27 (JSON)
- 2026Beyond Benchmarks: Using VLMs to Reveal Systematic Classification Failures Under Real World Conditions10 Sep 2026
- 2026Stereo 4D Radar for 3D Object Detection: Integrating Geometric Alignment and Absolute Velocity Estimation2 Sep 2026
- 2026Enhancing Visual Perception in Foggy Conditions via Multiclass Fog Density Modeling3 Aug 2026
- 2025Progressive Conditioned Scale-Shift Recalibration of Self-Attention for Online Test-time Adaptation14 Dec 2025
- 2025SAMFusion: Sensor-Adaptive Multimodal Fusion for 3D Object Detection in Adverse Weather22 Aug 2025
- 2025A Multi-View High-Resolution Foot-Ankle Complex Point Cloud Dataset During Gait for Occlusion-Robust 3D Completion15 Jul 2025
- 2025Enhanced 3D Object Detection via Diverse Feature Representations of 4D Radar Tensor10 Feb 2025
- 2024A Black-Box Evaluation Framework for Semantic Robustness in Bird's Eye View Detection18 Dec 2024
- 2024Domain-Conditioned Transformer for Fully Test-time Adaptation14 Oct 2024
- 2024Dual-Path Adversarial Lifting for Domain Shift Correction in Online Test-time Adaptation26 Aug 2024
- 2024Learning Visual Conditioning Tokens to Correct Domain Shift for Fully Test-time Adaptation27 Jun 2024
- 2024An Empirical Study of the Generalization Ability of Lidar 3D Object Detectors to Unseen Domains27 Feb 2024
12 newest of 27 All 27 (JSON)