mlsanityData to 7 Oct 2026

DiffYOLO: Object Detection for Anti-Noise via YOLO and Diffusion Models

arXiv 2401.01659 ↗First posted 3 Jan 2024cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Object detection models represented by YOLO series have been widely used and have achieved great results on the high quality datasets, but not all the working conditions are ideal. To settle down the problem of locating targets on low quality datasets, the existing methods either train a new object detection network, or need a large collection of low-quality datasets to train. However, we propose a framework in this paper and apply it on the YOLO models called DiffYOLO. Specifically, we extract feature maps from the denoising diffusion probabilistic models to enhance the well-trained models, which allows us fine-tune YOLO on high-quality datasets and test on low-quality datasets. The results proved this framework can not only prove the performance on noisy datasets, but also prove the detection results on high-quality test datasets. We will supplement more experiments later (with various datasets and network architectures).

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 16 of its 17 references that are in the map. First posted on arXiv 3 Jan 2024.

Builds on

16 of 17 references.

References · 16

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  3. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  4. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  5. 2015Fast R-CNNcited by 2,930
  6. 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
  7. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
  8. 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 279
  9. 2017Noisy Networks for Explorationcited by 262
  10. 2021Image-Adaptive YOLO for Object Detection in Adverse Weather Conditionscited by 85
  11. 2021DANNet: A One-Stage Domain Adaptation Network for Unsupervised Nighttime Semantic Segmentationcited by 80
  12. 2023Anomaly Detection with Conditioned Denoising Diffusion Modelscited by 56
4 more
  1. 2023Neonatal Face and Facial Landmark Detection from Video Recordingscited by 5
  2. 2022Brain Cancer Segmentation Using YOLOv5 Deep Neural Networkcited by 3
  3. 2023Towards Better Certified Segmentation via Diffusion Modelscited by 2
  4. 2019Vehicle detection and counting from VHR satellite images: efforts and open issuescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022DiffusionDet: Diffusion Model for Object Detection
  2. 2025CoDiff: Conditional Diffusion Model for Collaborative 3D Object Detection
  3. 2025Robust Single-Stage Fully Sparse 3D Object Detection via Detachable Latent Diffusion
  4. 2023DiffusionEngine: Diffusion Model is Scalable Data Engine for Object Detection
  5. 2024Mamba YOLO: A Simple Baseline for Object Detection with State Space Model
  6. 2024YOLO-RD: Introducing Relevant and Compact Explicit Knowledge to YOLO by Retriever-Dictionary
  7. 2025Generalized Diffusion Detector: Mining Robust Features from Diffusion Models for Domain-Generalized Detection
  8. 2023DiffusionTrack: Diffusion Model For Multi-Object Tracking