Focal Loss for Dense Object Detection
Not on the map. Why?
Abstract (arXiv)
The highest accuracy object detectors to date are based on a two-stage approach popularized by R-CNN, where a classifier is applied to a sparse set of candidate object locations. In contrast, one-stage detectors that are applied over a regular, dense sampling of possible object locations have the potential to be faster and simpler, but have trailed the accuracy of two-stage detectors thus far. In this paper, we investigate why this is the case. We discover that the extreme foreground-background class imbalance encountered during training of dense detectors is the central cause. We propose to address this class imbalance by reshaping the standard cross entropy loss such that it down-weights the loss assigned to well-classified examples. Our novel Focal Loss focuses training on a sparse set of hard examples and prevents the vast number of easy negatives from overwhelming the detector during training. To evaluate the effectiveness of our loss, we design and train a simple dense detector we call RetinaNet. Our results show that when trained with the focal loss, RetinaNet is able to match the speed of previous one-stage detectors while surpassing the accuracy of all existing state-of-the-art two-stage detectors. Code is at: https://github.com/facebookresearch/Detectron.
Key facts. Cited by 749 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Aug 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 261; 2022: 236; 2023: 221; 2024: 11; 2025: 11; 2026: 9.
749 papers.
Sort:
By area:
- 2023Segment Anythingcited by 8,158
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
- 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
38 more
- 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 612
- 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 569
- 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
- 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 510
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
- 2021Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modelingcited by 429
- 2021Conditional DETR for Fast Training Convergencecited by 422
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 351
- 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 345
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 341
- 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 326
- 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 315
- 2021Towards Open World Object Detectioncited by 297
- 2022Vision Transformer with Deformable Attentioncited by 293
- 2021Focal Self-attention for Local-Global Interactions in Vision Transformerscited by 286
- 2021Distilling Knowledge via Knowledge Reviewcited by 285
- 2022YOLOv6: A Single-Stage Object Detection Framework for Industrial Applicationscited by 273
- 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 273
- 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 262
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2021Mobile-Former: Bridging MobileNet and Transformercited by 234
- 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 221
- 2021TOOD: Task-aligned One-stage Object Detectioncited by 218
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2021K-Net: Towards Unified Image Segmentationcited by 211
- 2023Scene as Occupancycited by 208
- 2021Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encodingcited by 207
- 2021DetCo: Unsupervised Contrastive Learning for Object Detectioncited by 205
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2021Dynamic Head: Unifying Object Detection Heads with Attentionscited by 185
- 2022Language as Queries for Referring Video Object Segmentationcited by 180
- 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Modelscited by 169
- 2021Multimodal Virtual Point 3D Detectioncited by 166
- 2021Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Losscited by 156
- 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 155
50 most cited of 749 All 749 (JSON)
- 2026Which Tokens Should SFT Actually Learn? A Token-Trimming Perspective on Mathematical Reasoning9 Sep 2026
- 2026Hybrid Imbalanced Regression Through Unified Data-Level and Algorithm-Level Balancing31 May 2026
- 2026REFNet++: Multi-Task Efficient Fusion of Camera and Radar Sensor Data in Bird's-Eye Polar View12 May 2026
- 2026Region4Web: Rethinking Observation Space Granularity for Web Agents8 May 2026
- 2026DirPA: Addressing Prior Shift in Imbalanced Few-shot Crop-type Classification13 Mar 2026
- 2026Chain-of-Look Spatial Reasoning for Dense Surgical Instrument Counting11 Feb 2026
- 2026TiCLS : Tightly Coupled Language Text Spotter3 Feb 2026
- 2026MORPHFED: Federated Learning for Cross-institutional Blood Morphology Analysis7 Jan 2026
- 2026LSP-DETR: Efficient and Scalable Nuclei Segmentation in Whole-Slide Images6 Jan 2026
- 2025Pre-Attention Expert Prediction and Prefetching for Mixture-of-Experts Large Language Models10 Nov 2025
- 2025KAMERA: Enhancing Aerial Surveys of Ice-associated Seals in Arctic Environments23 Sep 2025
- 2025Comparative Analysis of CNN and Transformer Architectures with Heart Cycle Normalization for Automated Phonocardiogram Classification8 Jul 2025
38 more
- 2025BeltCrack: the First Sequential-image Industrial Conveyor Belt Crack Detection Dataset and Its Baseline with Triple-domain Feature Learning22 Jun 2025
- 2025Semantic-decoupled Spatial Partition Guided Point-supervised Oriented Object Detection12 Jun 2025
- 2025Explainable Scene Understanding with Qualitative Representations and Graph Neural Networks17 Apr 2025
- 2025Inland Waterway Object Detection in Multi-environment: Dataset and Approach7 Apr 2025
- 2025Predictive Modeling: BIM Command Recommendation Based on Large-scale Usage Logs23 Feb 2025
- 2025PerPO: Perceptual Preference Optimization via Discriminative Rewarding5 Feb 2025
- 2025IROAM: Improving Roadside Monocular 3D Object Detection Learning from Autonomous Vehicle Data Domain30 Jan 2025
- 2025Deep Distance Map Regression Network with Shape-aware Loss for Imbalanced Medical Image Segmentation15 Jan 2025
- 2024GLOVER: Generalizable Open-Vocabulary Affordance Reasoning for Task-Oriented Grasping19 Nov 2024
- 2024Classifier Chain Networks for Multi-Label Classification4 Nov 2024
- 2024Training Language Models to Critique With Multi-agent Feedback20 Oct 2024
- 2024Sustaining model performance for covid-19 detection from dynamic audio data: Development and evaluation of a comprehensive drift-adaptive framework28 Sep 2024
- 2024Efficient Human-Object-Interaction (EHOI) Detection via Interaction Label Coding and Conditional Decision13 Aug 2024
- 2024A Recurrent YOLOv8-based framework for Event-Based Object Detection9 Aug 2024
- 2024eagerlearners at SemEval2024 Task 5: The Legal Argument Reasoning Task in Civil Procedure24 Jun 2024
- 2024Multi-level Shared Knowledge Guided Learning for Knowledge Graph Completion8 May 2024
- 2024LATUP-Net: A Lightweight 3D Attention U-Net with Parallel Convolutions for Brain Tumor Segmentation9 Apr 2024
- 2024Few-Shot Object Detection: Research Advances and Challenges7 Apr 2024
- 2024FlightScope: An Experimental Comparative Review of Aircraft Detection Algorithms in Satellite Imagery3 Apr 2024
- 2023BLSTM-Based Confidence Estimation for End-to-End Speech Recognition22 Dec 2023
- 2023Domain Adaptive Object Detection via Balancing Between Self-Training and Adversarial Learning8 Nov 2023
- 2023HIPTrack: Visual Tracking with Historical Prompts3 Nov 2023
- 2023Towards Generalizable Multi-Camera 3D Object Detection via Perspective Debiasing17 Oct 2023
- 2023Multi-Resolution Audio-Visual Feature Fusion for Temporal Action Localization5 Oct 2023
- 2023Outage-Watch: Early Prediction of Outages using Extreme Event Regularizer29 Sep 2023
- 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Space26 Sep 2023
- 2023Unsupervised 3D Perception with 2D Vision-Language Distillation for Autonomous Driving25 Sep 2023
- 2023Gravity Network for end-to-end small lesion detection22 Sep 2023
- 2023Fully Transformer-Equipped Architecture for End-to-End Referring Video Object Segmentation21 Sep 2023
- 2023CaSAR: Contact-aware Skeletal Action Recognition17 Sep 2023
- 2023BEA: Revisiting anchor-based object detection DNN using Budding Ensemble Architecture14 Sep 2023
- 2023Remote Sensing Object Detection Meets Deep Learning: A Meta-review of Challenges and Advances13 Sep 2023
- 2023Dynamic Spectrum Mixer for Visual Recognition13 Sep 2023
- 2023Language Prompt for Autonomous Driving8 Sep 2023
- 2023How Can We Tame the Long-Tail of Chest X-ray Datasets?8 Sep 2023
- 2023Temporal Collection and Distribution for Referring Video Object Segmentation7 Sep 2023
- 2023Multi-label affordance mapping from egocentric vision5 Sep 2023
- 2023Learning Cross-Modal Affinity for Referring Video Object Segmentation Targeting Limited Samples5 Sep 2023
50 newest of 749 All 749 (JSON)
- 2021Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modelingcited by 429
- 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Modelscited by 169
- 2021A Simple Long-Tailed Recognition Baseline via Vision-Language Modelcited by 49
- 2023GridCLIP: One-Stage Object Detection by Grid-Level CLIP Representation Learningcited by 15
- 2025PerPO: Perceptual Preference Optimization via Discriminative Rewardingcited by 9
- 2023Weakly-Supervised HOI Detection from Interaction Labels Only and Language/Vision-Language Priorscited by 6
- 2025PerPO: Perceptual Preference Optimization via Discriminative Rewarding5 Feb 2025
- 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Models29 Aug 2023
- 2023GridCLIP: One-Stage Object Detection by Grid-Level CLIP Representation Learning16 Mar 2023
- 2023Weakly-Supervised HOI Detection from Interaction Labels Only and Language/Vision-Language Priors9 Mar 2023
- 2021A Simple Long-Tailed Recognition Baseline via Vision-Language Model29 Nov 2021
- 2021Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling6 Nov 2021
- 2024GLOVER: Generalizable Open-Vocabulary Affordance Reasoning for Task-Oriented Graspingcited by 15
- 2026Chain-of-Look Spatial Reasoning for Dense Surgical Instrument Countingcited by 2
- 2026Region4Web: Rethinking Observation Space Granularity for Web Agentscited by 1
- 2024eagerlearners at SemEval2024 Task 5: The Legal Argument Reasoning Task in Civil Procedurecited by 0
- 2026Which Tokens Should SFT Actually Learn? A Token-Trimming Perspective on Mathematical Reasoningcited by 0
- 2026Which Tokens Should SFT Actually Learn? A Token-Trimming Perspective on Mathematical Reasoning9 Sep 2026
- 2026Region4Web: Rethinking Observation Space Granularity for Web Agents8 May 2026
- 2026Chain-of-Look Spatial Reasoning for Dense Surgical Instrument Counting11 Feb 2026
- 2024GLOVER: Generalizable Open-Vocabulary Affordance Reasoning for Task-Oriented Grasping19 Nov 2024
- 2024eagerlearners at SemEval2024 Task 5: The Legal Argument Reasoning Task in Civil Procedure24 Jun 2024
- 2023Language Prompt for Autonomous Drivingcited by 110
- 2023Unsupervised 3D Perception with 2D Vision-Language Distillation for Autonomous Drivingcited by 37
- 2022Driving in Real Life with Inverse Reinforcement Learningcited by 18
- 2022Doubly Contrastive End-to-End Semantic Segmentation for Autonomous Driving under Adverse Weathercited by 1
- 2023Unsupervised 3D Perception with 2D Vision-Language Distillation for Autonomous Driving25 Sep 2023
- 2023Language Prompt for Autonomous Driving8 Sep 2023
- 2022Doubly Contrastive End-to-End Semantic Segmentation for Autonomous Driving under Adverse Weather21 Nov 2022
- 2022Driving in Real Life with Inverse Reinforcement Learning7 Jun 2022
- 2023Segment Anythingcited by 8,158
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
- 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
12 most cited of 727 All 727 (JSON)
- 2026Hybrid Imbalanced Regression Through Unified Data-Level and Algorithm-Level Balancing31 May 2026
- 2026REFNet++: Multi-Task Efficient Fusion of Camera and Radar Sensor Data in Bird's-Eye Polar View12 May 2026
- 2026DirPA: Addressing Prior Shift in Imbalanced Few-shot Crop-type Classification13 Mar 2026
- 2026TiCLS : Tightly Coupled Language Text Spotter3 Feb 2026
- 2026MORPHFED: Federated Learning for Cross-institutional Blood Morphology Analysis7 Jan 2026
- 2026LSP-DETR: Efficient and Scalable Nuclei Segmentation in Whole-Slide Images6 Jan 2026
- 2025KAMERA: Enhancing Aerial Surveys of Ice-associated Seals in Arctic Environments23 Sep 2025
- 2025Comparative Analysis of CNN and Transformer Architectures with Heart Cycle Normalization for Automated Phonocardiogram Classification8 Jul 2025
- 2025BeltCrack: the First Sequential-image Industrial Conveyor Belt Crack Detection Dataset and Its Baseline with Triple-domain Feature Learning22 Jun 2025
- 2025Semantic-decoupled Spatial Partition Guided Point-supervised Oriented Object Detection12 Jun 2025
- 2025Explainable Scene Understanding with Qualitative Representations and Graph Neural Networks17 Apr 2025
- 2025Inland Waterway Object Detection in Multi-environment: Dataset and Approach7 Apr 2025
12 newest of 727 All 727 (JSON)