mlsanityData to 14 Oct 2026

DiffusionDet: Diffusion Model for Object Detection

arXiv 2211.09788 ↗First posted 17 Nov 2022cs.CVcited by 354

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

We propose DiffusionDet, a new framework that formulates object detection as a denoising diffusion process from noisy boxes to object boxes. During the training stage, object boxes diffuse from ground-truth boxes to random distribution, and the model learns to reverse this noising process. In inference, the model refines a set of randomly generated boxes to the output results in a progressive way. Our work possesses an appealing property of flexibility, which enables the dynamic number of boxes and iterative evaluation. The extensive experiments on the standard benchmarks show that DiffusionDet achieves favorable performance compared to previous well-established detectors. For example, DiffusionDet achieves 5.3 AP and 4.8 AP gains when evaluated with more boxes and iteration steps, under a zero-shot transfer setting from COCO to CrowdHuman. Our code is available at https://github.com/ShoufaChen/DiffusionDet.

Key facts. Cited by 354 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 99 of its 118 references that are in the map. First posted on arXiv 17 Nov 2022.

Builds on

99 of 118 references.

Closest ancestors · 5

Same direction, newest first

  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
  5. 2021Blended Diffusion for Text-driven Editing of Natural Images29 Nov

Other references · 94

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  8. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  9. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  10. 2020End-to-End Object Detection with Transformerscited by 7,414
  11. 2017Mask R-CNNcited by 7,277
  12. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
38 more
  1. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  2. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  3. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  4. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  5. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  6. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  7. 2015SSD: Single Shot MultiBox Detectorcited by 3,130
  8. 2015Fast R-CNNcited by 2,933
  9. 2022Video Diffusion Modelscited by 2,305
  10. 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
  11. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  12. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  13. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  14. 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
  15. 2016YOLO9000: Better, Faster, Strongercited by 1,431
  16. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
  17. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
  18. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  19. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
  20. 2019Objects as Pointscited by 1,175
  21. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
  22. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
  23. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
  24. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
  25. 2018Panoptic Segmentationcited by 802
  26. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  27. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
  28. 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 677
  29. 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
  30. 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 573
  31. 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 537
  32. 2016MOT16: A Benchmark for Multi-Object Trackingcited by 532
  33. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 516
  34. 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 499
  35. 2020Sparse R-CNN: End-to-End Object Detection with Learnable Proposalscited by 495
  36. 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 488
  37. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
  38. 2017AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actionscited by 449

50 most cited of 94 All 94 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 4; 2023: 114; 2024: 115; 2025: 85; 2026: 36.

354 papers.

Sort:

By area:

  1. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  2. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
  3. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 301
  4. 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 269
  5. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
  6. 2023A Survey on Video Diffusion Modelscited by 206
  7. 2023Structural Pruning for Diffusion Modelscited by 195
  8. 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
  9. 2023The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open Worldcited by 116
  10. 2022How to Backdoor Diffusion Models?cited by 104
  11. 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
  12. 2023DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimationcited by 82
38 more
  1. 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 82
  2. 2023HumanMAC: Masked Motion Completion for Human Motion Predictioncited by 81
  3. 2023Dense Distinct Query for End-to-End Object Detectioncited by 77
  4. 2023Dream the Impossible: Outlier Imagination with Diffusion Modelscited by 77
  5. 2023Diffusion Action Segmentationcited by 74
  6. 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Modelcited by 73
  7. 2023VillanDiffusion: A Unified Backdoor Attack Framework for Diffusion Modelscited by 68
  8. 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Datacited by 67
  9. 2023MomentDiff: Generative Video Moment Retrieval from Random to Realcited by 58
  10. 2023Diffusion Models Beat GANs on Image Classificationcited by 58
  11. 2023Dif-Fusion: Towards High Color Fidelity in Infrared and Visible Image Fusion with Diffusion Modelscited by 56
  12. 2023GeoDiffusion: Text-Prompted Geometric Control for Object Detection Data Generationcited by 56
  13. 2025No Other Representation Component Is Needed: Diffusion Transformers Can Provide Representation Guidance by Themselvescited by 56
  14. 2023DiffusionRet: Generative Text-Video Retrieval with Diffusion Modelcited by 52
  15. 2022DiffusionInst: Diffusion Model for Instance Segmentationcited by 49
  16. 2024Learning to Localize Objects Improves Spatial Reasoning in Visual-LLMscited by 49
  17. 2024Lexicon3D: Probing Visual Foundation Models for Complex 3D Scene Understandingcited by 49
  18. 2023Point Cloud Pre-training with Diffusion Modelscited by 47
  19. 2023DiffusionAD: Norm-guided One-step Denoising Diffusion for Anomaly Detectioncited by 46
  20. 2024DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLMcited by 46
  21. 2024CleanDIFT: Diffusion Features without Noisecited by 44
  22. 2023TransFusion -- A Transparency-Based Diffusion Model for Anomaly Detectioncited by 43
  23. 2024Abductive Ego-View Accident Video Understanding for Safe Driving Perceptioncited by 43
  24. 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
  25. 2023TokenCompose: Text-to-Image Diffusion with Token-level Supervisioncited by 40
  26. 2023Relation-Aware Diffusion Model for Controllable Poster Layout Generationcited by 37
  27. 2023DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimationcited by 36
  28. 2025Efficient Diffusion Models: A Surveycited by 35
  29. 2023Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inferencecited by 34
  30. 2023Ref-Diff: Zero-shot Referring Image Segmentation with Generative Modelscited by 33
  31. 2023Do text-free diffusion models learn discriminative visual representations?cited by 33
  32. 2023DiAD: A Diffusion-based Framework for Multi-class Anomaly Detectioncited by 33
  33. 2024DiffusionEdge: Diffusion Probabilistic Model for Crisp Edge Detectioncited by 33
  34. 2024DiffAssemble: A Unified Graph-Diffusion Model for 2D and 3D Reassemblycited by 33
  35. 2023DiffMIC: Dual-Guidance Diffusion Network for Medical Image Classificationcited by 32
  36. 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimatorscited by 31
  37. 2023DiffBEV: Conditional Diffusion Model for Bird's Eye View Perceptioncited by 30
  38. 2023Controllable Mind Visual Diffusion Modelcited by 30

50 most cited of 354 All 354 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Diffusion Model for Camouflaged Object Detection
  2. 2023DiffusionEngine: Diffusion Model is Scalable Data Engine for Object Detection
  3. 2025Diffusion Domain Teacher: Diffusion Guided Domain Adaptive Object Detector
  4. 2025Generalized Diffusion Detector: Mining Robust Features from Diffusion Models for Domain-Generalized Detection
  5. 2024Diffusion Models in Low-Level Vision: A Survey
  6. 2024Learning on Less: Constraining Pre-trained Model Learning for Generalizable Diffusion-Generated Image Detection
  7. 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discovery
  8. 2023CamoDiffusion: Camouflaged Object Detection via Conditional Diffusion Models