Learning High-Precision Bounding Box for Rotated Object Detection via Kullback-Leibler Divergence
Not on the map. Why?
Abstract (arXiv)
Existing rotated object detectors are mostly inherited from the horizontal detection paradigm, as the latter has evolved into a well-developed area. However, these detectors are difficult to perform prominently in high-precision detection due to the limitation of current regression loss design, especially for objects with large aspect ratios. Taking the perspective that horizontal detection is a special case for rotated object detection, in this paper, we are motivated to change the design of rotation regression loss from induction paradigm to deduction methodology, in terms of the relation between rotation and horizontal detection. We show that one essential challenge is how to modulate the coupled parameters in the rotation regression loss, as such the estimated parameters can influence to each other during the dynamic joint optimization, in an adaptive and synergetic way. Specifically, we first convert the rotated bounding box into a 2-D Gaussian distribution, and then calculate the Kullback-Leibler Divergence (KLD) between the Gaussian distributions as the regression loss. By analyzing the gradient of each parameter, we show that KLD (and its derivatives) can dynamically adjust the parameter gradients according to the characteristics of the object. It will adjust the importance (gradient weight) of the angle parameter according to the aspect ratio. This mechanism can be vital for high-precision detection as a slight angle error would cause a serious accuracy drop for large aspect ratios objects. More importantly, we have proved that KLD is scale invariant. We further show that the KLD loss can be degenerated into the popular ln-norm loss for horizontal detection. Experimental results on seven datasets using different detectors show its consistent superiority, and codes are available at https://github.com/yangxue0827/RotationDetection and https://github.com/open-mmlab/mmrotate.
Key facts. Cited by 130 papers in the map (data through 13 Oct 2026). Builds on 41 of its 62 references that are in the map. First posted on arXiv 3 Jun 2021.
Builds on
41 of 62 references.
References · 41
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2014Microsoft COCO: Common Objects in Contextcited by 17,550
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,625
- 2020End-to-End Object Detection with Transformerscited by 7,396
- 2016Feature Pyramid Networks for Object Detectioncited by 5,027
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,840
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,417
- 2015SSD: Single Shot MultiBox Detectorcited by 3,128
- 2015Fast R-CNNcited by 2,933
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,544
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,575
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,362
29 more
- 2019Objects as Pointscited by 1,173
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
- 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 455
- 2017Deep Layer Aggregationcited by 436
- 2016R-FCN: Object Detection via Region-based Fully Convolutional Networkscited by 414
- 2019RepPoints: Point Set Representation for Object Detectioncited by 264
- 2021ReDet: A Rotation-equivariant Detector for Aerial Object Detectioncited by 202
- 2019R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Objectcited by 194
- 2020Align Deep Features for Oriented Object Detectioncited by 187
- 2017Arbitrary-Oriented Scene Text Detection via Rotation Proposalscited by 176
- 2021Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Losscited by 156
- 2019Gliding vertex on the horizontal bounding box for multi-oriented object detectioncited by 134
- 2020Dense Label Encoding for Boundary Discontinuity Free Rotation Detectioncited by 79
- 2019Learning Modulated Loss for Rotated Object Detectioncited by 73
- 2020Dynamic Refinement Network for Oriented and Densely Packed Object Detectioncited by 72
- 2020Dynamic Anchor Learning for Arbitrary-Oriented Object Detectioncited by 70
- 2020Oriented Object Detection in Aerial Images with Box Boundary-Aware Vectorscited by 63
- 2020SCRDet++: Detecting Small, Cluttered and Rotated Objects via Instance-Level Feature Denoising and Rotation Loss Smoothingcited by 62
- 2020PIoU Loss: Towards Accurate Oriented Object Detection in Complex Environmentscited by 56
- 2018Automatic Ship Detection of Remote Sensing Images from Google Earth in Complex Scenes Based on Multi-Scale Rotation Dense Feature Pyramid Networkscited by 54
- 2017R2CNN: Rotational Region CNN for Orientation Robust Scene Text Detectioncited by 51
- 2018Towards Multi-class Object Detection in Unconstrained Remote Sensing Imagerycited by 46
- 2019Oriented Objects as pairs of Middle Linescited by 43
- 2020On the Arbitrary-Oriented Object Detection: Classification based Approaches Revisitedcited by 32
- 2021CFC-Net: A Critical Feature Capturing Network for Arbitrary-Oriented Object Detection in Remote Sensing Imagescited by 29
- 2021Optimization for Arbitrary-Oriented Object Detection via Representation Invariance Losscited by 27
- 2020PolarDet: A Fast, More Precise Detector for Rotated Target in Aerial Imagescited by 25
- 2018Position Detection and Direction Prediction for Arbitrary-Oriented Ships via Multitask Rotation Region Convolutional Neural Networkcited by 13
Built on by
Citing papers per year: 2021: 12; 2022: 22; 2023: 35; 2024: 24; 2025: 19; 2026: 18.
130 papers.
Sort:
By area:
- 2022RTMDet: An Empirical Study of Designing Real-Time Object Detectorscited by 194
- 2022Advancing Plain Vision Transformer Towards Remote Sensing Foundation Modelcited by 149
- 2022MMRotate: A Rotated Object Detection Benchmark using PyTorchcited by 115
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 101
- 2023Large Selective Kernel Network for Remote Sensing Object Detectioncited by 98
- 2023Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentationcited by 76
- 2022The KFIoU Loss for Rotated Object Detectioncited by 73
- 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretrainingcited by 66
- 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
- 2023C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detectioncited by 58
- 2022AO2-DETR: Arbitrary-Oriented Object Detection Transformercited by 55
- 2024Poly Kernel Inception Network for Remote Sensing Detectioncited by 52
38 more
- 2022RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object Detectioncited by 51
- 2023Adaptive Rotated Convolution for Rotated Object Detectioncited by 51
- 2022Translation, Scale and Rotation: Cross-Modal Alignment Meets RGB-Infrared Vehicle Detectioncited by 50
- 2024LSKNet: A Foundation Lightweight Backbone for Remote Sensingcited by 44
- 2022Phase-Shifting Coder: Predicting Accurate Orientation in Oriented Object Detectioncited by 43
- 2023Dynamic Coarse-to-Fine Learning for Oriented Tiny Object Detectioncited by 43
- 2022Detecting Rotated Objects as Gaussian Distributions and Its 3-D Generalizationcited by 36
- 2022H2RBox: Horizontal Box Annotation is All You Need for Oriented Object Detectioncited by 36
- 20245%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Taskscited by 34
- 2023ARS-DETR: Aspect Ratio-Sensitive Detection Transformer for Aerial Oriented Object Detectioncited by 32
- 2024STAR: A First-Ever Dataset and A Large-Scale Benchmark for Scene Graph Generation in Large-Size Satellite Imagerycited by 31
- 2023H2RBox-v2: Incorporating Symmetry for Boosting Horizontal Box Supervised Oriented Object Detectioncited by 28
- 2023PointOBB: Learning Oriented Object Detection via Single Point Supervisioncited by 25
- 2024PointSAM: Pointly-Supervised Segment Anything Model for Remote Sensing Imagescited by 24
- 2021A General Gaussian Heatmap Label Assignment for Arbitrary-Oriented Object Detectioncited by 22
- 2023Point2RBox: Combine Knowledge from Synthetic Visual Patterns for End-to-end Oriented Object Detection with Single Point Supervisioncited by 21
- 2022G-Rep: Gaussian Representation for Arbitrary-Oriented Object Detectioncited by 20
- 2023Remote Sensing Object Detection Meets Deep Learning: A Meta-review of Challenges and Advancescited by 20
- 2022Localization Distillation for Object Detectioncited by 19
- 2023SOOD: Towards Semi-Supervised Oriented Object Detectioncited by 19
- 2022Object Localization under Single Coarse Point Supervisioncited by 18
- 2021Gaussian Bounding Boxes and Probabilistic Intersection-over-Union for Object Detectioncited by 17
- 2023Learning to Holistically Detect Bridges from Large-Size VHR Remote Sensing Imagerycited by 17
- 2021RSDet++: Point-based Modulated Loss for More Accurate Rotated Object Detectioncited by 16
- 2023Generating Driving Scenes with Diffusioncited by 16
- 2023Rethinking Boundary Discontinuity Problem for Oriented Object Detectioncited by 15
- 2025Strip R-CNN: Large Strip Convolution for Remote Sensing Object Detectioncited by 14
- 2024GRA: Detecting Oriented Objects through Group-wise Rotating and Attentioncited by 13
- 2024PointOBB-v2: Towards Simpler, Faster, and Stronger Single Point Supervised Oriented Object Detectioncited by 13
- 2023Knowledge Combination to Learn Rotated Detection Without Rotated Annotationcited by 12
- 2023Spatial Transform Decoupling for Oriented Object Detectioncited by 12
- 2025RSAR: Restricted State Angle Resolver and Rotated SAR Benchmarkcited by 12
- 2025Point2RBox-v2: Rethinking Point-supervised Oriented Object Detection with Spatial Layout Among Instancescited by 11
- 2021FCOSR: A Simple Anchor-free Rotated Detector for Aerial Object Detectioncited by 10
- 2023Rotation Invariant Transformer for Recognizing Object in UAVscited by 10
- 2025Frequency-Dynamic Attention Modulation for Dense Predictioncited by 10
- 2023Hausdorff Distance Matching with Adaptive Query Denoising for Rotated Detection Transformercited by 9
- 2023Turning a CLIP Model into a Scene Text Spottercited by 9
50 most cited of 130 All 130 (JSON)
- 2026FoCal: Frequency-Oriented Cross-Modal Interaction and Spectral Calibration for Aerial Visible-Infrared Object Detection24 Sep 2026
- 2026A Unified Framework and Dataset for Oriented Object Visual Grounding in Remote Sensing23 Sep 2026
- 2026GTR: Gated Token Recurrence for Efficient Dense Prediction22 Sep 2026
- 2026Bridging Severe Cross-Modal Misalignment: End-to-End Visible-Infrared Object Detection via Explicit Feature-Domain Affine Registration11 Aug 2026
- 2026Geometry Meets Semantics: Fractional Gradient Stabilization for Semantic-Driven Bounding Box Optimization in Visual Detection Tasks26 Jul 2026
- 2026LOGOS: Language-guided Oriented Object Detection in Aerial Scenes9 Jul 2026
- 2026Geometric Causal Models6 Jul 2026
- 2026ConRTF: Edge-Constrained Boundary Distribution Refinement for Realtime TransFormer Table Structure Recognition1 Jul 2026
- 2026Learn Temporal Consistency For Robust Satellite Video Detector13 Jun 2026
- 2026SLIP-RS: Structured-Attribute Language-Image Pre-Training for Remote Sensing Object Detection22 May 2026
- 2026Fourier Series Coder: A Novel Perspective on Angle Boundary Discontinuity Problem for Oriented Object Detection22 Apr 2026
- 2026PKINet-v2: Towards Powerful and Efficient Poly-Kernel Remote Sensing Object Detection17 Mar 2026
38 more
- 2026Real-Time Oriented Object Detection Transformer in Remote Sensing Images16 Mar 2026
- 2026From Horizontal to Rotated: Cross-View Object Geo-Localization with Orientation Awareness16 Mar 2026
- 2026RiO-DETR: DETR for Real-time Oriented Object Detection10 Mar 2026
- 2026Fourier Angle Alignment for Oriented Object Detection in Remote Sensing27 Feb 2026
- 2026Explore Intrinsic Geometry for Query-based Tiny and Oriented Object Detector with Momentum-based Bipartite Matching14 Feb 2026
- 2026RFAssigner: A Generic Label Assignment Strategy for Dense Object Detection3 Jan 2026
- 2025ABBSPO: Adaptive Bounding Box Scaling and Symmetric Prior based Orientation Prediction for Detecting Aerial Image Objects10 Dec 2025
- 2025Gaussian Combined Distance: A Generic Metric for Object Detection31 Oct 2025
- 2025Enhancing Rotated Object Detection via Anisotropic Gaussian Bounding Box and Bhattacharyya Distance18 Oct 2025
- 2025Visual Instruction Pretraining for Domain-Specific Foundation Models22 Sep 2025
- 2025Towards Large Scale Geostatistical Methane Monitoring with Part-based Object Detection24 Jul 2025
- 2025Frequency-Dynamic Attention Modulation for Dense Prediction16 Jul 2025
- 2025Measuring the Impact of Rotation Equivariance on Aerial Object Detection14 Jul 2025
- 2025Semantic-decoupled Spatial Partition Guided Point-supervised Oriented Object Detection12 Jun 2025
- 2025More Clear, More Flexible, More Precise: A Comprehensive Oriented Object Detection benchmark for UAV28 Apr 2025
- 2025EagleVision: Object-level Attribute Multimodal LLM for Remote Sensing30 Mar 2025
- 2025LEGNet: A Lightweight Edge-Gaussian Network for Low-Quality Remote Sensing Image Object Detection18 Mar 2025
- 2025RFWNet: A Lightweight Remote Sensing Object Detector Integrating Multiscale Receptive Fields and Foreground Focus Mechanism1 Mar 2025
- 2025Wholly-WOOD: Wholly Leveraging Diversified-quality Labels for Weakly-supervised Oriented Object Detection13 Feb 2025
- 2025Point2RBox-v2: Rethinking Point-supervised Oriented Object Detection with Spatial Layout Among Instances6 Feb 2025
- 2025GauCho: Gaussian Distributions with Cholesky Decomposition for Oriented Object Detection3 Feb 2025
- 2025The Capabilities and Limitations of Weak-to-Strong Generalization: Generalization and Calibration3 Feb 2025
- 2025PointOBB-v3: Expanding Performance Boundaries of Single Point-Supervised Oriented Object Detection23 Jan 2025
- 2025RSAR: Restricted State Angle Resolver and Rotated SAR Benchmark8 Jan 2025
- 2025Strip R-CNN: Large Strip Convolution for Remote Sensing Object Detection7 Jan 2025
- 2024Efficient Oriented Object Detection with Enhanced Small Object Recognition in Aerial Images17 Dec 2024
- 2024Oriented Tiny Object Detection: A Dataset, Benchmark, and Dynamic Unbiased Learning16 Dec 2024
- 2024Structure Tensor Representation for Robust Oriented Object Detection15 Nov 2024
- 2024Exploiting Unlabeled Data with Multiple Expert Teachers for Open Vocabulary Aerial Object Detection and Its Orientation Adaptation4 Nov 2024
- 2024PointOBB-v2: Towards Simpler, Faster, and Stronger Single Point Supervised Oriented Object Detection10 Oct 2024
- 2024PointSAM: Pointly-Supervised Segment Anything Model for Remote Sensing Images20 Sep 2024
- 20245%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Tasks15 Aug 2024
- 2024Flexible 3D Lane Detection by Hierarchical Shape MatchingFlexible 3D Lane Detection by Hierarchical Shape Matching13 Aug 2024
- 2024Semi-Supervised Object Detection: A Survey on Progress from CNN to Transformer11 Jul 2024
- 2024Category-Aware Dynamic Label Assignment with High-Quality Oriented Proposal3 Jul 2024
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun 2024
- 2024STAR: A First-Ever Dataset and A Large-Scale Benchmark for Scene Graph Generation in Large-Size Satellite Imagery13 Jun 2024
- 2024FPDIoU Loss: A Loss Function for Efficient Bounding Box Regression of Rotated Object Detection16 May 2024
50 newest of 130 All 130 (JSON)
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 101
- 2025EagleVision: Object-level Attribute Multimodal LLM for Remote Sensingcited by 8
- 2026A Unified Framework and Dataset for Oriented Object Visual Grounding in Remote Sensingcited by 0
- 2026A Unified Framework and Dataset for Oriented Object Visual Grounding in Remote Sensing23 Sep 2026
- 2025EagleVision: Object-level Attribute Multimodal LLM for Remote Sensing30 Mar 2025
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun 2024
- 2022RTMDet: An Empirical Study of Designing Real-Time Object Detectorscited by 194
- 2022Advancing Plain Vision Transformer Towards Remote Sensing Foundation Modelcited by 149
- 2022MMRotate: A Rotated Object Detection Benchmark using PyTorchcited by 115
- 2023Large Selective Kernel Network for Remote Sensing Object Detectioncited by 98
- 2023Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentationcited by 76
- 2022The KFIoU Loss for Rotated Object Detectioncited by 73
- 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretrainingcited by 66
- 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
- 2023C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detectioncited by 58
- 2022AO2-DETR: Arbitrary-Oriented Object Detection Transformercited by 55
- 2024Poly Kernel Inception Network for Remote Sensing Detectioncited by 52
- 2022RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object Detectioncited by 51
12 most cited of 124 All 124 (JSON)
- 2026FoCal: Frequency-Oriented Cross-Modal Interaction and Spectral Calibration for Aerial Visible-Infrared Object Detection24 Sep 2026
- 2026GTR: Gated Token Recurrence for Efficient Dense Prediction22 Sep 2026
- 2026Bridging Severe Cross-Modal Misalignment: End-to-End Visible-Infrared Object Detection via Explicit Feature-Domain Affine Registration11 Aug 2026
- 2026Geometry Meets Semantics: Fractional Gradient Stabilization for Semantic-Driven Bounding Box Optimization in Visual Detection Tasks26 Jul 2026
- 2026LOGOS: Language-guided Oriented Object Detection in Aerial Scenes9 Jul 2026
- 2026Geometric Causal Models6 Jul 2026
- 2026ConRTF: Edge-Constrained Boundary Distribution Refinement for Realtime TransFormer Table Structure Recognition1 Jul 2026
- 2026Learn Temporal Consistency For Robust Satellite Video Detector13 Jun 2026
- 2026SLIP-RS: Structured-Attribute Language-Image Pre-Training for Remote Sensing Object Detection22 May 2026
- 2026Fourier Series Coder: A Novel Perspective on Angle Boundary Discontinuity Problem for Oriented Object Detection22 Apr 2026
- 2026PKINet-v2: Towards Powerful and Efficient Poly-Kernel Remote Sensing Object Detection17 Mar 2026
- 2026Real-Time Oriented Object Detection Transformer in Remote Sensing Images16 Mar 2026
12 newest of 124 All 124 (JSON)