Bounding Box Regression with Uncertainty for Accurate Object Detection
Not on the map. Why?
Abstract (arXiv)
Large-scale object detection datasets (e.g., MS-COCO) try to define the ground truth bounding boxes as clear as possible. However, we observe that ambiguities are still introduced when labeling the bounding boxes. In this paper, we propose a novel bounding box regression loss for learning bounding box transformation and localization variance together. Our loss greatly improves the localization accuracies of various architectures with nearly no additional computation. The learned localization variance allows us to merge neighboring bounding boxes during non-maximum suppression (NMS), which further improves the localization performance. On MS-COCO, we boost the Average Precision (AP) of VGG-16 Faster R-CNN from 23.6% to 29.1%. More importantly, for ResNet-50-FPN Mask R-CNN, our method improves the AP and AP90 by 1.8% and 6.2% respectively, which significantly outperforms previous state-of-the-art bounding box refinement methods. Our code and models are available at: github.com/yihui-he/KL-Loss
Key facts. Cited by 143 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 43; 2022: 31; 2023: 31; 2024: 17; 2025: 12; 2026: 9.
143 papers.
Sort:
By area:
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 202
- 2021Objects are Different: Flexible Monocular 3D Object Detectioncited by 184
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 2021MonoRUn: Monocular 3D Object Detection by Reconstruction and Uncertainty Propagationcited by 82
- 2023EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimationcited by 79
- 2022AdaMixer: A Fast-Converging Query-Based Object Detectorcited by 78
- 2022Unbiased Teacher v2: Semi-supervised Object Detection for Anchor-free and Anchor-based Detectorscited by 69
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
- 2023MFT: Long-Term Tracking of Every Pixelcited by 61
- 2021Learning Probabilistic Ordinal Embeddings for Uncertainty-Aware Regressioncited by 58
- 2021Localization Distillation for Dense Object Detectioncited by 55
38 more
- 2021Adaptive Class Suppression Loss for Long-Tail Object Detectioncited by 55
- 2022Few-shot Object Counting and Detectioncited by 55
- 2021EPNet++: Cascade Bi-directional Fusion for Multi-Modal 3D Object Detectioncited by 49
- 2023A Survey on Few-Shot Class-Incremental Learningcited by 48
- 2022Uncertainty Quantification of Collaborative Detection for Self-Drivingcited by 46
- 2021Rethinking Pseudo Labels for Semi-Supervised Object Detectioncited by 45
- 2022OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal Regressioncited by 44
- 2021Spatial Uncertainty-Aware Semi-Supervised Crowd Countingcited by 38
- 2021Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectorscited by 37
- 2023Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecastingcited by 33
- 2023RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimationcited by 33
- 2021SOLO: A Simple Framework for Instance Segmentationcited by 32
- 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrievalcited by 32
- 2021CFC-Net: A Critical Feature Capturing Network for Arbitrary-Oriented Object Detection in Remote Sensing Imagescited by 29
- 2021Few-shot Keypoint Detection with Uncertainty Learning for Unseen Speciescited by 27
- 2023Collaborative Multi-Object Tracking with Conformal Uncertainty Propagationcited by 27
- 2021Uncertainty for Identifying Open-Set Errors in Visual Object Detectioncited by 26
- 2024SARATR-X: Toward Building A Foundation Model for SAR Target Recognitioncited by 25
- 2021A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applicationscited by 24
- 2022GLENet: Boosting 3D Object Detectors with Generative Label Uncertainty Estimationcited by 24
- 2024Adaptive Bounding Box Uncertainties via Two-Step Conformal Predictioncited by 23
- 2021Rank & Sort Loss for Object Detection and Instance Segmentationcited by 22
- 2022Representation Uncertainty in Self-Supervised Learning as Variational Inferencecited by 22
- 2023Calibrating Uncertainty for Semi-Supervised Crowd Countingcited by 22
- 2022Robust Object Detection With Inaccurate Bounding Boxescited by 20
- 2022Localization Distillation for Object Detectioncited by 19
- 2022iFS-RCNN: An Incremental Few-shot Instance Segmentercited by 19
- 2023Towards Building Self-Aware Object Detectors via Reliable Uncertainty Quantification and Calibrationcited by 19
- 2024ScanFormer: Referring Expression Comprehension by Iteratively Scanningcited by 18
- 2023MoCaE: Mixture of Calibrated Experts Significantly Improves Object Detectioncited by 17
- 2021I Find Your Lack of Uncertainty in Computer Vision Disturbingcited by 16
- 2021Gradient-Based Quantification of Epistemic Uncertainty for Deep Object Detectorscited by 16
- 2021Circle Representation for Medical Object Detectioncited by 15
- 2021Autoregressive Quantile Flows for Predictive Uncertainty Estimationcited by 15
- 2022You Should Look at All Objectscited by 12
- 2021Robust Monocular Localization in Sparse HD Maps Leveraging Multi-Task Uncertainty Estimationcited by 11
- 2021Improved YOLOv5 network for real-time multi-scale traffic sign detectioncited by 11
- 2023MUBen: Benchmarking the Uncertainty of Molecular Representation Modelscited by 11
50 most cited of 143 All 143 (JSON)
- 2026Uncertainty-Aware Multimodal Anti-UAV Detection via Evidential Fusion and Conflict-Discounted Belief Aggregation29 Aug 2026
- 2026DyFrDet: Towards Accurate Small Object Detection via Dynamic Frequency Suppression with Label Disambiguation3 Aug 2026
- 2026Rethinking Detection Calibration: A Coordinate and Direction Perspective31 Jul 2026
- 2026From Keypoints to Predictive Distributions: Post-Hoc Uncertainty for YOLO-Pose Models29 Jul 2026
- 2026MVDGC: Joint 3D and 2D Multi-view Pedestrian Detection via Dual Geometric Constraints30 Jun 2026
- 2026Calibrating Probabilistic Object Detectors with Annotator Disagreement23 May 2026
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2026Query2Uncertainty: Robust Uncertainty Quantification and Calibration for 3D Object Detection under Distribution Shift6 May 2026
- 2026Noise-Robust Tiny Object Localization with Flows2 Jan 2026
- 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrieval2 Dec 2025
- 2025Difficulty-Aware Label-Guided Denoising for Monocular 3D Object Detection17 Nov 2025
- 2025URNet: Uncertainty-aware Refinement Network for Event-based Stereo Depth Estimation18 Sep 2025
38 more
- 2025CrowdQuery: Density-Guided Query Module for Enhanced 2D and 3D Detection in Crowded Scenes10 Sep 2025
- 2025Learning to Detect Label Errors by Making Them: A Method for Segmentation and Object Detection Datasets25 Aug 2025
- 2025Communication-Efficient Multi-Agent 3D Detection via Hybrid Collaboration9 Aug 2025
- 2025Deterministic Object Pose Confidence Region Estimation28 Jun 2025
- 2025Feature Hallucination for Self-supervised Action Recognition25 Jun 2025
- 2025Differentiable NMS via Sinkhorn Matching for End-to-End Fabric Defect Detection11 May 2025
- 2025Lessons from Deploying Learning-based CSI Localization on a Large-Scale ISAC Platform24 Apr 2025
- 2025Density-based Object Detection in Crowded Scenes14 Apr 2025
- 2025Uncertainty-Aware Online Extrinsic Calibration: A Conformal Prediction Approach12 Jan 2025
- 2024Impact of Evidence Theory Uncertainty on Training Object Detection Models23 Dec 2024
- 2024MMLF: Multi-modal Multi-class Late Fusion for Object Detection with Uncertainty Estimation11 Oct 2024
- 2024Accelerating Non-Maximum Suppression: A Graph Theory Perspective30 Sep 2024
- 2024Enhancing Fruit and Vegetable Detection in Unconstrained Environment with a Novel Dataset20 Sep 2024
- 2024FMI-TAL: Few-shot Multiple Instances Temporal Action Localization by Probability Distribution Learning and Interval Cluster Refinement25 Aug 2024
- 2024Harnessing Uncertainty-aware Bounding Boxes for Unsupervised 3D Object Detection1 Aug 2024
- 2024Semi-Supervised Teacher-Reference-Student Architecture for Action Quality Assessment29 Jul 2024
- 2024Pseudo-Labeling by Multi-Policy Viewfinder Network for Image Cropping2 Jul 2024
- 2024ScanFormer: Referring Expression Comprehension by Iteratively Scanning26 Jun 2024
- 2024SARATR-X: Toward Building A Foundation Model for SAR Target Recognition15 May 2024
- 2024From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networks9 May 2024
- 2024MonoBox: Tightness-free Box-supervised Polyp Segmentation using Monotonicity Constraint1 Apr 2024
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstruction18 Mar 2024
- 2024Adaptive Bounding Box Uncertainties via Two-Step Conformal Prediction12 Mar 2024
- 2024Separating common from salient patterns with Contrastive Representation Learning19 Feb 2024
- 2024Robust Tiny Object Detection in Aerial Images amidst Label Noise16 Jan 2024
- 2024Answering from Sure to Uncertain: Uncertainty-Aware Curriculum Learning for Video Question Answering3 Jan 2024
- 2023Not Every Side Is Equal: Localization Uncertainty Estimation for Semi-Supervised 3D Object Detection16 Dec 2023
- 2023RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimation12 Dec 2023
- 2023Is Underwater Image Enhancement All Object Detectors Need?30 Nov 2023
- 2023Smart Traffic Management of Vehicles using Faster R-CNN based Deep Learning Method3 Nov 2023
- 2023Out-of-distribution Object Detection through Bayesian Uncertainty Estimation29 Oct 2023
- 2023PrObeD: Proactive Object Detection Wrapper28 Oct 2023
- 2023Prompt-Driven Building Footprint Extraction in Aerial Images with Offset-Building Model25 Oct 2023
- 2023Anchor-Intermediate Detector: Decoupling and Coupling Bounding Boxes for Accurate Object Detection9 Oct 2023
- 2023MoCaE: Mixture of Calibrated Experts Significantly Improves Object Detection26 Sep 2023
- 2023Being Aware of Localization Accuracy By Generating Predicted-IoU-Guided Quality Scores23 Sep 2023
- 2023MEDL-U: Uncertainty-aware 3D Automatic Annotation based on Evidential Deep Learning18 Sep 2023
- 2023A Theoretical and Practical Framework for Evaluating Uncertainty Calibration in Object Detection1 Sep 2023
50 newest of 143 All 143 (JSON)
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 202
- 2021Objects are Different: Flexible Monocular 3D Object Detectioncited by 184
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 2021MonoRUn: Monocular 3D Object Detection by Reconstruction and Uncertainty Propagationcited by 82
- 2023EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimationcited by 79
- 2022AdaMixer: A Fast-Converging Query-Based Object Detectorcited by 78
- 2022Unbiased Teacher v2: Semi-supervised Object Detection for Anchor-free and Anchor-based Detectorscited by 69
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
- 2023MFT: Long-Term Tracking of Every Pixelcited by 61
- 2021Learning Probabilistic Ordinal Embeddings for Uncertainty-Aware Regressioncited by 58
- 2021Localization Distillation for Dense Object Detectioncited by 55
12 most cited of 142 All 142 (JSON)
- 2026Uncertainty-Aware Multimodal Anti-UAV Detection via Evidential Fusion and Conflict-Discounted Belief Aggregation29 Aug 2026
- 2026DyFrDet: Towards Accurate Small Object Detection via Dynamic Frequency Suppression with Label Disambiguation3 Aug 2026
- 2026Rethinking Detection Calibration: A Coordinate and Direction Perspective31 Jul 2026
- 2026From Keypoints to Predictive Distributions: Post-Hoc Uncertainty for YOLO-Pose Models29 Jul 2026
- 2026MVDGC: Joint 3D and 2D Multi-view Pedestrian Detection via Dual Geometric Constraints30 Jun 2026
- 2026Calibrating Probabilistic Object Detectors with Annotator Disagreement23 May 2026
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2026Query2Uncertainty: Robust Uncertainty Quantification and Calibration for 3D Object Detection under Distribution Shift6 May 2026
- 2026Noise-Robust Tiny Object Localization with Flows2 Jan 2026
- 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrieval2 Dec 2025
- 2025Difficulty-Aware Label-Guided Denoising for Monocular 3D Object Detection17 Nov 2025
- 2025URNet: Uncertainty-aware Refinement Network for Event-based Stereo Depth Estimation18 Sep 2025
12 newest of 142 All 142 (JSON)