Augmentation for small object detection
Not on the map. Why?
Abstract (arXiv)
In recent years, object detection has experienced impressive progress. Despite these improvements, there is still a significant gap in the performance between the detection of small and large objects. We analyze the current state-of-the-art model, Mask-RCNN, on a challenging dataset, MS COCO. We show that the overlap between small ground-truth objects and the predicted anchors is much lower than the expected IoU threshold. We conjecture this is due to two factors; (1) only a few images are containing small objects, and (2) small objects do not appear enough even within each image containing them. We thus propose to oversample those images with small objects and augment each of those images by copy-pasting small objects many times. It allows us to trade off the quality of the detector on large objects with that on small objects. We evaluate different pasting augmentation strategies, and ultimately, we achieve 9.7% relative improvement on the instance segmentation and 7.1% on the object detection of small objects, compared to the current state of the art method on MS COCO.
Key facts. Cited by 73 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 16; 2023: 12; 2024: 10; 2025: 14; 2026: 8.
73 papers.
Sort:
By area:
- 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 119
- 2022Slicing Aided Hyper Inference and Fine-tuning for Small Object Detectioncited by 101
- 2021QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detectioncited by 70
- 2022Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmarkcited by 56
- 2022RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object Detectioncited by 51
- 2024AeroGen: Enhancing Remote Sensing Object Detection with Diffusion-Driven Data Generationcited by 32
- 2024DQ-DETR: DETR with Dynamic Query for Tiny Object Detectioncited by 27
- 2025Enhance Then Search: An Augmentation-Search Strategy with Foundation Models for Cross-Domain Few-Shot Object Detectioncited by 24
- 2022Focus-and-Detect: A Small Object Detection Framework for Aerial Imagescited by 19
- 2021Remote Sensing Image Super-resolution and Object Detection: Benchmark and State of the Artcited by 17
- 2022Back to Reality: Weakly-supervised 3D Object Detection with Shape-guided Label Enhancementcited by 17
38 more
- 2021SSPNet: Scale Selection Pyramid Network for Tiny Person Detection from UAV Imagescited by 16
- 2022A Guide to Image and Video based Small Object Detection using Deep Learning : Case Study of Maritime Surveillancecited by 14
- 2024Relaxed Equivariance via Multitask Learningcited by 13
- 2025FBRT-YOLO: Faster and Better for Real-Time Aerial Image Detectioncited by 13
- 2021YOLO-Z: Improving small object detection in YOLOv5 for autonomous vehiclescited by 12
- 2022Tiny Object Tracking: A Large-scale Dataset and A Baselinecited by 11
- 2021A Comparative Review of Recent Few-Shot Object Detection Algorithmscited by 10
- 2022Self-supervised Transparent Liquid Segmentation for Robotic Pouringcited by 9
- 2024Visible and Clear: Finding Tiny Objects in Difference Mapcited by 9
- 2024A Simple Background Augmentation Method for Object Detection with Diffusion Modelcited by 9
- 2022Learning to Act with Affordance-Aware Multimodal Neural SLAMcited by 8
- 2021A Comprehensive Approach for UAV Small Object Detection with Simulation-based Transfer Learning and Adaptive Fusioncited by 7
- 2023Oriented object detection in optical remote sensing images using deep learning: a surveycited by 7
- 2023EdgeYOLO: An Edge-Real-Time Object Detectorcited by 6
- 2025Dome-DETR: DETR with Density-Oriented Feature-Query Manipulation for Efficient Tiny Object Detectioncited by 6
- 2026YOLO26: An Analysis of NMS-Free End to End Framework for Real-Time Object Detectioncited by 6
- 2021Tackling the Background Bias in Sparse Object Detection via Cropped Windowscited by 5
- 2024Similarity Distance-Based Label Assignment for Tiny Object Detectioncited by 5
- 2022Self-Supervised Learning as a Means To Reduce the Need for Labeled Data in Medical Image Analysiscited by 4
- 20233D Small Object Detection with Dynamic Spatial Pruningcited by 4
- 2023VIPriors 3: Visual Inductive Priors for Data-Efficient Deep Learning Challengescited by 4
- 2024Domain Adaptive Detection of MAVs: A Benchmark and Noise Suppression Networkcited by 4
- 2021A Survey on Deep Domain Adaptation and Tiny Object Detection Challenges, Techniques and Datasetscited by 3
- 2022Global Meets Local: Effective Multi-Label Image Classification via Category-Aware Weak Supervisioncited by 3
- 2023Rethinking Intersection Over Union for Small Object Detection in Few-Shot Regimecited by 3
- 2026EFSI-DETR: Efficient Frequency-Semantic Integration for Real-Time Small Object Detection in UAV Imagerycited by 3
- 2022Light In The Black: An Evaluation of Data Augmentation Techniques for COVID-19 CT's Semantic Segmentationcited by 2
- 2023Deep-NFA: a Deep textita contrario Framework for Small Object Detectioncited by 2
- 2023Uncertainty-Aware Gradient Stabilization for Small Object Detectioncited by 2
- 2025PointSplit: Towards On-device 3D Object Detection with Heterogeneous Low-power Acceleratorscited by 2
- 2021Estimates of maize plant density from UAV RGB images using Faster-RCNN detection model: impact of the spatial resolutioncited by 1
- 2021Small Object Detection for Near Real-Time Egocentric Perception in a Manual Assembly Scenariocited by 1
- 2022Birds' Eye View: Measuring Behavior and Posture of Chickens as a Metric for Their Well-Beingcited by 1
- 2023YOLO-Drone:Airborne real-time detection of dense small objects from high-altitude perspectivecited by 1
- 2024Small Object Tracking in LiDAR Point Cloud: Learning the Target-awareness Prototype and Fine-grained Search Regioncited by 1
- 2024Simple In-place Data Augmentation for Surveillance Object Detectioncited by 1
- 2025YOLO-RS: Remote Sensing Enhanced Crop Detection Methodscited by 1
- 2025Cross-DINO: Cross the Deep MLP and Transformer for Small Object Detectioncited by 1
50 most cited of 73 All 73 (JSON)
- 2026Reading Decoder Trajectories: Training-Free Counterfactual Query-Trajectory Reliability for Small-Object Detection6 Sep 2026
- 2026DRAFE: Domain-Robust Asymmetric Fusion of Heterogeneous Detection Transformers for Cross-City Fine-Grained Traffic Object Detection17 Aug 2026
- 2026DyFrDet: Towards Accurate Small Object Detection via Dynamic Frequency Suppression with Label Disambiguation3 Aug 2026
- 2026Adaptive Spectrum-Aware Feature Disentangled Network for Small Object Detection27 Jun 2026
- 2026Adaptive Slicing-Assisted Hyper Inference for Enhanced Small Object Detection in High-Resolution Imagery21 Apr 2026
- 2026EFSI-DETR: Efficient Frequency-Semantic Integration for Real-Time Small Object Detection in UAV Imagery26 Jan 2026
- 2026YOLO26: An Analysis of NMS-Free End to End Framework for Real-Time Object Detection19 Jan 2026
- 2026Noise-Robust Tiny Object Localization with Flows2 Jan 2026
- 2025Small Object Detection for Birds with Swin Transformer27 Nov 2025
- 2025Physics-Guided Fusion for Robust 3D Tracking of Fast Moving Small Objects23 Oct 2025
- 2025Enhanced Detection of Tiny Objects in Aerial Images21 Sep 2025
- 2025Robust Object Detection for Autonomous Driving via Curriculum-Guided Group Relative Policy Optimization19 Sep 2025
38 more
- 2025A Data-Driven RetinaNet Model for Small Object Detection in Aerial Images3 Sep 2025
- 2025CEM-FBGTinyDet: Context-Enhanced Foreground Balance with Gradient Tuning for tiny Objects11 Jun 2025
- 2025Data Augmentation For Small Object using Fast AutoAugment10 Jun 2025
- 2025Data-Efficient Challenges in Visual Inductive Priors: A Retrospective10 Jun 2025
- 2025Cross-DINO: Cross the Deep MLP and Transformer for Small Object Detection28 May 2025
- 2025Dome-DETR: DETR with Density-Oriented Feature-Query Manipulation for Efficient Tiny Object Detection9 May 2025
- 2025FBRT-YOLO: Faster and Better for Real-Time Aerial Image Detection29 Apr 2025
- 2025YOLO-RS: Remote Sensing Enhanced Crop Detection Methods15 Apr 2025
- 2025Enhance Then Search: An Augmentation-Search Strategy with Foundation Models for Cross-Domain Few-Shot Object Detection6 Apr 2025
- 2025PointSplit: Towards On-device 3D Object Detection with Heterogeneous Low-power Accelerators4 Mar 2025
- 2024AeroGen: Enhancing Remote Sensing Object Detection with Diffusion-Driven Data Generation23 Nov 2024
- 2024Relaxed Equivariance via Multitask Learning23 Oct 2024
- 2024A Simple Background Augmentation Method for Object Detection with Diffusion Model1 Aug 2024
- 2024Similarity Distance-Based Label Assignment for Tiny Object Detection2 Jul 2024
- 2024VIPriors 4: Visual Inductive Priors for Data-Efficient Deep Learning Challenges26 Jun 2024
- 2024Visible and Clear: Finding Tiny Objects in Difference Map18 May 2024
- 2024Simple In-place Data Augmentation for Surveillance Object Detection17 Apr 2024
- 2024DQ-DETR: DETR with Dynamic Query for Tiny Object Detection4 Apr 2024
- 2024Domain Adaptive Detection of MAVs: A Benchmark and Noise Suppression Network25 Mar 2024
- 2024Small Object Tracking in LiDAR Point Cloud: Learning the Target-awareness Prototype and Fine-grained Search Region24 Jan 2024
- 2023Two-Stage Adaptive Network for Semi-Supervised Cross-Domain Crater Detection under Varying Scenario Distributions11 Dec 2023
- 2023On the Importance of Large Objects in CNN Based Object Detection Algorithms20 Nov 2023
- 2023Gravity Network for end-to-end small lesion detection22 Sep 2023
- 2023Document Layout Analysis on BaDLAD Dataset: A Comprehensive MViTv2 Based Approach31 Aug 2023
- 2023Rethinking Intersection Over Union for Small Object Detection in Few-Shot Regime17 Jul 2023
- 2023VIPriors 3: Visual Inductive Priors for Data-Efficient Deep Learning Challenges31 May 2023
- 20233D Small Object Detection with Dynamic Spatial Pruning5 May 2023
- 2023YOLO-Drone:Airborne real-time detection of dense small objects from high-altitude perspective14 Apr 2023
- 2023Uncertainty-Aware Gradient Stabilization for Small Object Detection3 Mar 2023
- 2023Deep-NFA: a Deep textita contrario Framework for Small Object Detection2 Mar 2023
- 2023Oriented object detection in optical remote sensing images using deep learning: a survey21 Feb 2023
- 2023EdgeYOLO: An Edge-Real-Time Object Detector15 Feb 2023
- 2022An advanced YOLOv3 method for small object detection6 Dec 2022
- 2022Global Meets Local: Effective Multi-Label Image Classification via Category-Aware Weak Supervision23 Nov 2022
- 2022Chosen methods of improving small object recognition with weak recognizable features29 Aug 2022
- 2022RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object Detection18 Aug 2022
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarks28 Jul 2022
- 2022A Guide to Image and Video based Small Object Detection using Deep Learning : Case Study of Maritime Surveillance26 Jul 2022
50 newest of 73 All 73 (JSON)
- 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 119
- 2022Slicing Aided Hyper Inference and Fine-tuning for Small Object Detectioncited by 101
- 2021QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detectioncited by 70
- 2022Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmarkcited by 56
- 2022RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object Detectioncited by 51
- 2024AeroGen: Enhancing Remote Sensing Object Detection with Diffusion-Driven Data Generationcited by 32
- 2024DQ-DETR: DETR with Dynamic Query for Tiny Object Detectioncited by 27
- 2025Enhance Then Search: An Augmentation-Search Strategy with Foundation Models for Cross-Domain Few-Shot Object Detectioncited by 24
- 2022Focus-and-Detect: A Small Object Detection Framework for Aerial Imagescited by 19
- 2021Remote Sensing Image Super-resolution and Object Detection: Benchmark and State of the Artcited by 17
- 2022Back to Reality: Weakly-supervised 3D Object Detection with Shape-guided Label Enhancementcited by 17
12 most cited of 71 All 71 (JSON)
- 2026Reading Decoder Trajectories: Training-Free Counterfactual Query-Trajectory Reliability for Small-Object Detection6 Sep 2026
- 2026DRAFE: Domain-Robust Asymmetric Fusion of Heterogeneous Detection Transformers for Cross-City Fine-Grained Traffic Object Detection17 Aug 2026
- 2026DyFrDet: Towards Accurate Small Object Detection via Dynamic Frequency Suppression with Label Disambiguation3 Aug 2026
- 2026Adaptive Spectrum-Aware Feature Disentangled Network for Small Object Detection27 Jun 2026
- 2026Adaptive Slicing-Assisted Hyper Inference for Enhanced Small Object Detection in High-Resolution Imagery21 Apr 2026
- 2026EFSI-DETR: Efficient Frequency-Semantic Integration for Real-Time Small Object Detection in UAV Imagery26 Jan 2026
- 2026YOLO26: An Analysis of NMS-Free End to End Framework for Real-Time Object Detection19 Jan 2026
- 2026Noise-Robust Tiny Object Localization with Flows2 Jan 2026
- 2025Small Object Detection for Birds with Swin Transformer27 Nov 2025
- 2025Physics-Guided Fusion for Robust 3D Tracking of Fast Moving Small Objects23 Oct 2025
- 2025Enhanced Detection of Tiny Objects in Aerial Images21 Sep 2025
- 2025A Data-Driven RetinaNet Model for Small Object Detection in Aerial Images3 Sep 2025
12 newest of 71 All 71 (JSON)