mlsanityData to 14 Oct 2026

From Filters to VLMs: Benchmarking Defogging Methods through Object Detection and Segmentation Performance

arXiv 2510.03906 ↗First posted 4 Oct 2025cs.CVcited by 3

On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection

Abstract (arXiv)

Autonomous driving perception systems are particularly vulnerable in foggy conditions, where light scattering reduces contrast and obscures fine details critical for safe operation. While numerous defogging methods exist, from handcrafted filters to learned restoration models, improvements in image fidelity do not consistently translate into better downstream detection and segmentation. Moreover, prior evaluations often rely on synthetic data, raising concerns about real-world transferability. We present a structured empirical study that benchmarks a comprehensive set of defogging pipelines, including classical dehazing filters, modern defogging networks, chained variants combining filters and models, and prompt-driven visual language image editing models applied directly to foggy images. To bridge the gap between simulated and physical environments, we evaluate these pipelines on both the synthetic Foggy Cityscapes dataset and the real-world Adverse Conditions Dataset with Correspondences (ACDC). We examine generalization by evaluating performance on synthetic fog and real-world conditions, assessing both image quality and downstream perception in terms of object detection mean average precision and segmentation panoptic quality. Our analysis identifies when defogging is effective, the impact of combining models, and how visual language models compare to traditional approaches. We additionally report qualitative rubric-based evaluations from both human and visual language model judges and analyze their alignment with downstream task metrics. Together, these results establish a transparent, task-oriented benchmark for defogging methods and identify the conditions under which pre-processing meaningfully improves autonomous perception in adverse weather. Project page: https://aradfir.github.io/filters-to-vlms-defogging-page/

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 35 of its 66 references that are in the map. First posted on arXiv 4 Oct 2025.

Builds on

35 of 66 references.

References · 35

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2017Mask R-CNNcited by 7,277
  4. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  5. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  6. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  7. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  8. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  9. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
  10. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  11. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
  12. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
23 more
  1. 2018Panoptic Segmentationcited by 802
  2. 2017The Perception-Distortion Tradeoffcited by 587
  3. 2017Semantic Foggy Scene Understanding with Synthetic Datacited by 403
  4. 2016DehazeNet: An End-to-End System for Single Image Haze Removalcited by 314
  5. 2019FFA-Net: Feature Fusion Attention Network for Single Image Dehazingcited by 307
  6. 2022Vision Transformers for Single Image Dehazingcited by 260
  7. 2019GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazingcited by 227
  8. 2024Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluationcited by 125
  9. 2021Both Style and Fog Matter: Cumulative Domain Adaptation for Semantic Foggy Scene Understandingcited by 26
  10. 2017End-to-End United Video Dehazing and Detectioncited by 24
  11. 2021ACDC: The Adverse Conditions Dataset with Correspondences for Robust Semantic Driving Scene Perceptioncited by 21
  12. 2025Top-H Decoding: Adapting the Creativity and Coherence with Bounded Entropy in Text Generationcited by 9
  13. 2022FogAdapt: Self-Supervised Domain Adaptation for Semantic Segmentation of Foggy Imagescited by 7
  14. 2024Convolutional Learning on Directed Acyclic Graphscited by 6
  15. 2025VISTA: Vision-Language Inference for Training-Free Stock Time-Series Analysiscited by 6
  16. 2024Advanced Predictive Modeling for Enhanced Mortality Prediction in ICU Stroke Patients Using Clinical Datacited by 4
  17. 2024Optimizing Mortality Prediction for ICU Heart Failure Patients: Leveraging XGBoost and Advanced Machine Learning with the MIMIC-III Databasecited by 4
  18. 2025Large Language Model-based Nonnegative Matrix Factorization For Cardiorespiratory Sound Separationcited by 4
  19. 2025FAIR-SIGHT: Fairness Assurance in Image Recognition via Simultaneous Conformal Thresholding and Dynamic Output Repaircited by 4
  20. 2025A Feasibility Study of Task-Based fMRI at 0.55 Tcited by 4
  21. 2024Fever Detection with Infrared Thermography: Enhancing Accuracy through Machine Learning Techniquescited by 3
  22. 2025A Novel Multi-Task Teacher-Student Architecture with Self-Supervised Pretraining for 48-Hour Vasoactive-Inotropic Trend Analysis in Sepsis Mortality Predictioncited by 3
  23. 2024FriendNet: Detection-Friendly Dehazing Networkcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024SynFog: A Photo-realistic Synthetic Fog Dataset based on End-to-end Imaging Simulation for Advancing Real-World Defogging in Autonomous Driving
  2. 2025Clear Roads, Clear Vision: Advancements in Multi-Weather Restoration for Smart Transportation
  3. 2023Leveraging the Edge and Cloud for V2X-Based Real-Time Object Detection in Autonomous Driving
  4. 2026ObsDriveBench: Benchmarking Multimodal Understanding under Adverse Weather with Observability Awareness
  5. 2025BEVDiffuser: Plug-and-Play Diffusion Model for BEV Denoising with Ground-Truth Guidance
  6. 2024DiffSSC: Semantic LiDAR Scan Completion using Denoising Diffusion Probabilistic Models
  7. 2025All You Need for Object Detection: From Pixels, Points, and Prompts to Next-Gen Fusion and Multimodal LLMs/VLMs in Autonomous Vehicles
  8. 2023WEDGE: A multi-weather autonomous driving dataset built from generative vision-language models