mlsanityData to 7 Oct 2026

Diagnosing Aerial-View Object Detectors with Foundational Image Generative Models

arXiv 2607.02718 ↗First posted 2 Jul 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in large-scale image generative models enable photorealistic scene synthesis with controllable attributes. Beyond data augmentation, their potential as diagnostic tools for trained vision systems remains unexplored in the aerial and remote sensing domains. We introduce a synthetic diagnostic framework for aerial-view vehicle detection that combines text-guided generation, attribute-controlled editing, and automated attribute verification to construct a controllable synthetic testbed. This enables fine-grained evaluation of pretrained detectors under diverse scene types and environmental conditions that are difficult to isolate in real datasets. Across three detection architectures and three real aerial datasets, synthetic scene-wise performance trends closely match real-world weaknesses. Guided by these diagnostics, targeted supplementation with small real datasets from the identified weak categories yields improvements of up to 13% AP50 while requiring substantially fewer additional samples than non-targeted augmentation. Our results show that controlled synthetic probing can predict real-domain performance gaps and guide efficient data collection. The proposed diagnostic framework is modular and can incorporate alternative generative or vision-language models as capabilities evolve. Our code and datasets are available here: https://humansensinglab.github.io/AVODDiag/

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 54 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

37 of 54 references.

References · 37

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  8. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  10. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  12. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
25 more
  1. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
  2. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
  3. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  4. 2016Playing for Data: Ground Truth from Computer Gamescited by 816
  5. 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
  6. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  7. 2018Domain Adaptive Faster R-CNN for Object Detection in the Wildcited by 442
  8. 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 340
  9. 2023Your Diffusion Model is Secretly a Zero-Shot Classifiercited by 301
  10. 2018Strong-Weak Distribution Alignment for Adaptive Object Detectioncited by 269
  11. 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 202
  12. 2020Unbiased Mean Teacher for Cross-domain Object Detectioncited by 158
  13. 2023Text-to-Image Diffusion Models are Zero-Shot Classifierscited by 140
  14. 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 122
  15. 2020TIDE: A General Toolbox for Identifying Object Detection Errorscited by 113
  16. 2018InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Datasetcited by 87
  17. 2023Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Modelscited by 82
  18. 2020RarePlanes: Synthetic Data Takes Flightcited by 48
  19. 2017Sim4CV: A Photo-Realistic Simulator for Computer Vision Applicationscited by 31
  20. 2024Imagen 3cited by 26
  21. 2022xView3-SAR: Detecting Dark Fishing Activity Using Synthetic Aperture Radar Imagerycited by 25
  22. 2023Discovering Failure Modes of Text-guided Diffusion Models via Adversarial Searchcited by 25
  23. 2023Remote Sensing Object Detection Meets Deep Learning: A Meta-review of Challenges and Advancescited by 20
  24. 2025GeoVLM-R1: Reinforcement Fine-Tuning for Improved Remote Sensing Reasoningcited by 15
  25. 2025Adapting Vehicle Detectors for Aerial Imagery to Unseen Domains with Weak Supervisioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Synthetic Object Compositions for Scalable and Accurate Learning in Detection, Segmentation, and Grounding
  2. 2026Visual Prototype Conditioned Focal Region Generation for UAV-Based Object Detection
  3. 2025The Impact of Synthetic Data on Object Detection Model Performance: A Comparative Analysis with Real-World Data
  4. 2023Gen2Det: Generate to Detect
  5. 2026Domain shift-robust object detection with GenAI image editing
  6. 2023Stable Diffusion For Aerial Object Detection
  7. 2026RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains
  8. 2026Scalable Evaluation of the Realism of Synthetic Environmental Augmentations in Images