mlsanityData to 14 Oct 2026

A Data Efficiency Study of Synthetic Fog for Object Detection Using the Clear2Fog Pipeline

arXiv 2605.12608 ↗First posted 12 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Object detection in adverse weather is critical for the safety of autonomous vehicles; however, the scarcity of labelled, real-world foggy data remains a significant bottleneck. In this paper, we propose Clear2Fog (C2F), an end-to-end, physics-based pipeline that simulates fog for clear-weather datasets under a unified camera and LiDAR framework. C2F combines monocular depth estimation with a novel atmospheric light estimation method to improve the physical consistency of synthetic fog generation while reducing structural artefacts and chromatic biases observed in existing frameworks. Utilising a training set of 270,000 images from the Waymo Open Dataset, we conduct an extensive data efficiency study to investigate whether environmental diversity can reduce dataset scale requirements and improve model generalisation under varying fog conditions. Our findings reveal that models trained on mixed-density fog datasets at 75% scale achieve performance that is not statistically different from those trained on fixed-density datasets at 100% scale, reducing synthetic training data requirements by 25%. We observe that this efficiency trend is consistent across two representative detector architectures. Furthermore, we investigate the sim-to-real transfer by using C2F-generated data as a pre-training foundation before fine-tuning on real-world fog data. We demonstrate that, within the evaluated settings, a relative 10x increase in the default fine-tuning learning rate reduces the negative transfer caused by standard fine-tuning, resulting in an absolute increase of up to 0.0117 mAP beyond the real-only baseline. Overall, this work demonstrates the value of diverse synthetic fog as a pre-training tool for real-world adaptation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 64 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

27 of 64 references.

References · 27

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  3. 2020Scaling Laws for Neural Language Modelscited by 6,586
  4. 2022Generative Adversarial Networkscited by 5,627
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  6. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  7. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  8. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
  9. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
  10. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
  11. 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 919
  12. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
15 more
  1. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  2. 2017Semantic Foggy Scene Understanding with Synthetic Datacited by 403
  3. 2017Sparsity Invariant CNNscited by 326
  4. 2018The ApolloScape Open Dataset for Autonomous Driving and its Applicationcited by 190
  5. 2018IDD: A Dataset for Exploring Problems of Autonomous Navigation in Unconstrained Environmentscited by 163
  6. 2021Fog Simulation on Real LiDAR Point Clouds for 3D Object Detection in Adverse Weathercited by 97
  7. 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusioncited by 50
  8. 2021Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detectioncited by 43
  9. 2021ACDC: The Adverse Conditions Dataset with Correspondences for Robust Semantic Driving Scene Perceptioncited by 21
  10. 2021Weather GAN: Multi-Domain Weather Translation Using Generative Adversarial Networkscited by 18
  11. 2023WeatherDepth: Curriculum Contrastive Learning for Self-Supervised Depth Estimation under Adverse Weather Conditionscited by 15
  12. 2024Rethinking Data Augmentation for Robust LiDAR Semantic Segmentation in Adverse Weathercited by 14
  13. 2024MonoWAD: Weather-Adaptive Diffusion Model for Robust Monocular 3D Object Detectioncited by 10
  14. 2020What happens to a ToF LiDAR in fog?cited by 9
  15. 2025Unbiased Object Detection Beyond Frequency with Visually Prompted Image Synthesiscited by 4

Built on by

Not cited yet.