Diagnosing Aerial-View Object Detectors with Foundational Image Generative Models
Not on the map. Why?
Abstract (arXiv)
Recent advances in large-scale image generative models enable photorealistic scene synthesis with controllable attributes. Beyond data augmentation, their potential as diagnostic tools for trained vision systems remains unexplored in the aerial and remote sensing domains. We introduce a synthetic diagnostic framework for aerial-view vehicle detection that combines text-guided generation, attribute-controlled editing, and automated attribute verification to construct a controllable synthetic testbed. This enables fine-grained evaluation of pretrained detectors under diverse scene types and environmental conditions that are difficult to isolate in real datasets. Across three detection architectures and three real aerial datasets, synthetic scene-wise performance trends closely match real-world weaknesses. Guided by these diagnostics, targeted supplementation with small real datasets from the identified weak categories yields improvements of up to 13% AP50 while requiring substantially fewer additional samples than non-targeted augmentation. Our results show that controlled synthetic probing can predict real-domain performance gaps and guide efficient data collection. The proposed diagnostic framework is modular and can incorporate alternative generative or vision-language models as capabilities evolve. Our code and datasets are available here: https://humansensinglab.github.io/AVODDiag/
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 54 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
37 of 54 references.
References · 37
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
25 more
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2016Playing for Data: Ground Truth from Computer Gamescited by 816
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2018Domain Adaptive Faster R-CNN for Object Detection in the Wildcited by 442
- 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 340
- 2023Your Diffusion Model is Secretly a Zero-Shot Classifiercited by 301
- 2018Strong-Weak Distribution Alignment for Adaptive Object Detectioncited by 269
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 202
- 2020Unbiased Mean Teacher for Cross-domain Object Detectioncited by 158
- 2023Text-to-Image Diffusion Models are Zero-Shot Classifierscited by 140
- 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 122
- 2020TIDE: A General Toolbox for Identifying Object Detection Errorscited by 113
- 2018InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Datasetcited by 87
- 2023Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Modelscited by 82
- 2020RarePlanes: Synthetic Data Takes Flightcited by 48
- 2017Sim4CV: A Photo-Realistic Simulator for Computer Vision Applicationscited by 31
- 2024Imagen 3cited by 26
- 2022xView3-SAR: Detecting Dark Fishing Activity Using Synthetic Aperture Radar Imagerycited by 25
- 2023Discovering Failure Modes of Text-guided Diffusion Models via Adversarial Searchcited by 25
- 2023Remote Sensing Object Detection Meets Deep Learning: A Meta-review of Challenges and Advancescited by 20
- 2025GeoVLM-R1: Reinforcement Fine-Tuning for Improved Remote Sensing Reasoningcited by 15
- 2025Adapting Vehicle Detectors for Aerial Imagery to Unseen Domains with Weak Supervisioncited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Synthetic Object Compositions for Scalable and Accurate Learning in Detection, Segmentation, and Grounding
- 2026Visual Prototype Conditioned Focal Region Generation for UAV-Based Object Detection
- 2025The Impact of Synthetic Data on Object Detection Model Performance: A Comparative Analysis with Real-World Data
- 2023Gen2Det: Generate to Detect
- 2026Domain shift-robust object detection with GenAI image editing
- 2023Stable Diffusion For Aerial Object Detection
- 2026RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains
- 2026Scalable Evaluation of the Realism of Synthetic Environmental Augmentations in Images