# Perceptual Generative Adversarial Networks for Small Object Detection

arXiv: https://arxiv.org/abs/1706.05274 · HTML: https://mlsanity.com/paper/1706.05274/

## Key facts

- Cited by 76 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 16 Jun 2017.

## Built on by (most cited first, 30 of 76)

- [Towards Large-Scale Small Object Detection: Survey and Benchmarks](https://mlsanity.com/paper/2207.14096/) (2022)
- [Diffusion Models for Image Restoration and Enhancement: A Comprehensive Survey](https://mlsanity.com/paper/2308.09388/) (2023)
- [QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detection](https://mlsanity.com/paper/2103.09136/) (2021)
- [Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmark](https://mlsanity.com/paper/2206.13996/) (2022)
- [A Normalized Gaussian Wasserstein Distance for Tiny Object Detection](https://mlsanity.com/paper/2110.13389/) (2021)
- [RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object Detection](https://mlsanity.com/paper/2208.08738/) (2022)
- [Dynamic Coarse-to-Fine Learning for Oriented Tiny Object Detection](https://mlsanity.com/paper/2304.08876/) (2023)
- [Selective Synthetic Augmentation with HistoGAN for Improved Histopathology Image Classification](https://mlsanity.com/paper/2111.06399/) (2021)
- [UFPMP-Det: Toward Accurate and Efficient Object Detection on Drone Imagery](https://mlsanity.com/paper/2112.10415/) (2021)
- [Deep Learning for UAV-based Object Detection and Tracking: A Survey](https://mlsanity.com/paper/2110.12638/) (2021)
- [LOHO: Latent Optimization of Hairstyles via Orthogonalization](https://mlsanity.com/paper/2103.03891/) (2021)
- [Small Object Detection via Coarse-to-fine Proposal Generation and Imitation Learning](https://mlsanity.com/paper/2308.09534/) (2023)
- [3D Human Pose, Shape and Texture from Low-Resolution Images and Videos](https://mlsanity.com/paper/2103.06498/) (2021)
- [A Comprehensive Review of Deep Learning-based Single Image Super-resolution](https://mlsanity.com/paper/2102.09351/) (2021)
- [Dogfight: Detecting Drones from Drones Videos](https://mlsanity.com/paper/2103.17242/) (2021)
- [Cascaded Zoom-in Detector for High Resolution Aerial Images](https://mlsanity.com/paper/2303.08747/) (2023)
- [UDoc-GAN: Unpaired Document Illumination Correction with Background Light Prior](https://mlsanity.com/paper/2210.08216/) (2022)
- [Dataset Condensation via Generative Model](https://mlsanity.com/paper/2309.07698/) (2023)
- [MUST: The First Dataset and Unified Framework for Multispectral UAV Single Object Tracking](https://mlsanity.com/paper/2503.17699/) (2025)
- [A Guide to Image and Video based Small Object Detection using Deep Learning : Case Study of Maritime Surveillance](https://mlsanity.com/paper/2207.12926/) (2022)
- [FBRT-YOLO: Faster and Better for Real-Time Aerial Image Detection](https://mlsanity.com/paper/2504.20670/) (2025)
- [Adversarial Shape Learning for Building Extraction in VHR Remote Sensing Images](https://mlsanity.com/paper/2102.11262/) (2021)
- [Improved YOLOv5 network for real-time multi-scale traffic sign detection](https://mlsanity.com/paper/2112.08782/) (2021)
- [Generative Adversarial Networks for Image Super-Resolution: A Survey](https://mlsanity.com/paper/2204.13620/) (2022)
- [A Systematic Performance Analysis of Deep Perceptual Loss Networks: Breaking Transfer Learning Conventions](https://mlsanity.com/paper/2302.04032/) (2023)
- [YOLC: You Only Look Clusters for Tiny Object Detection in Aerial Images](https://mlsanity.com/paper/2404.06180/) (2024)
- [A Comparative Review of Recent Few-Shot Object Detection Algorithms](https://mlsanity.com/paper/2111.00201/) (2021)
- [Visible and Clear: Finding Tiny Objects in Difference Map](https://mlsanity.com/paper/2405.11276/) (2024)
- [Unsupervised domain adaptation for clinician pose estimation and instance segmentation in the operating room](https://mlsanity.com/paper/2108.11801/) (2021)
- [Joint Learning of Blind Super-Resolution and Crack Segmentation for Realistic Degraded Images](https://mlsanity.com/paper/2302.12491/) (2023)

## Abstract (arXiv)

Detecting small objects is notoriously challenging due to their low resolution and noisy representation. Existing object detection pipelines usually detect small objects through learning representations of all the objects at multiple scales. However, the performance gain of such ad hoc architectures is usually limited to pay off the computational cost. In this work, we address the small object detection problem by developing a single architecture that internally lifts representations of small objects to "super-resolved" ones, achieving similar characteristics as large objects and thus more discriminative for detection. For this purpose, we propose a new Perceptual Generative Adversarial Network (Perceptual GAN) model that improves small object detection through narrowing representation difference of small objects from the large ones. Specifically, its generator learns to transfer perceived poor representations of the small objects to super-resolved ones that are similar enough to real large objects to fool a competing discriminator. Meanwhile its discriminator competes with the generator to identify the generated representation and imposes an additional perceptual requirement - generated representations of small objects must be beneficial for detection purpose - on the generator. Extensive evaluations on the challenging Tsinghua-Tencent 100K and the Caltech benchmark well demonstrate the superiority of Perceptual GAN in detecting small objects, including traffic signs and pedestrians, over well-established state-of-the-arts.
