TIDE: A General Toolbox for Identifying Object Detection Errors
Not on the map. Why?
Abstract (arXiv)
We introduce TIDE, a framework and associated toolbox for analyzing the sources of error in object detection and instance segmentation algorithms. Importantly, our framework is applicable across datasets and can be applied directly to output prediction files without required knowledge of the underlying prediction system. Thus, our framework can be used as a drop-in replacement for the standard mAP computation while providing a comprehensive analysis of each model's strengths and weaknesses. We segment errors into six types and, crucially, are the first to introduce a technique for measuring the contribution of each error in a way that isolates its effect on overall performance. We show that such a representation is critical for drawing accurate, comprehensive conclusions through in-depth analysis across 4 datasets and 7 recognition models. Available at https://dbolya.github.io/tide/
Key facts. Cited by 113 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 26; 2023: 24; 2024: 13; 2025: 10; 2026: 19.
113 papers.
Sort:
By area:
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2021Boundary IoU: Improving Object-Centric Image Segmentation Evaluationcited by 186
- 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
- 2021FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagerycited by 143
- 2021Delving into Localization Errors for Monocular 3D Object Detectioncited by 138
- 2021Benchmarking Detection Transfer Learning with Vision Transformerscited by 130
- 2021You Only Look One-level Featurecited by 116
- 2022VL-CheckList: Evaluating Pre-trained Vision-Language Models with Objects, Attributes and Relationscited by 113
- 2023V3Det: Vast Vocabulary Visual Detection Datasetcited by 81
- 2021FASA: Feature Augmentation and Sampling Adaptation for Long-Tailed Instance Segmentationcited by 76
- 2023The effectiveness of MAE pre-pretraining for billion-scale pretrainingcited by 68
- 2022Sparse Instance Activation for Real-Time Instance Segmentationcited by 63
38 more
- 2021Points as Queries: Weakly Semi-supervised Object Detection by Pointscited by 60
- 2021Robust and Accurate Object Detection via Adversarial Learningcited by 42
- 2021Decoupled Adaptation for Cross-Domain Object Detectioncited by 37
- 2022BigDetection: A Large-scale Benchmark for Improved Object Detector Pre-trainingcited by 33
- 2022Progressive End-to-End Object Detection in Crowded Scenescited by 31
- 2023Towards Building Self-Aware Object Detectors via Reliable Uncertainty Quantification and Calibrationcited by 19
- 2021Improving Object Detection by Label Assignment Distillationcited by 17
- 2023Cascaded Zoom-in Detector for High Resolution Aerial Imagescited by 17
- 2023MoCaE: Mixture of Calibrated Experts Significantly Improves Object Detectioncited by 17
- 2022Prediction-Guided Distillation for Dense Object Detectioncited by 14
- 2022Ergo, SMIRK is Safe: A Safety Case for a Machine Learning Component in a Pedestrian Automatic Emergency Brake Systemcited by 14
- 20221st Workshop on Maritime Computer Vision (MaCVi) 2023: Challenge Resultscited by 14
- 2024Open-Set Recognition in the Age of Vision-Language Modelscited by 13
- 2023Diagnosing Human-object Interaction Detectorscited by 11
- 2023ObjectLab: Automated Diagnosis of Mislabeled Images in Object Detection Datacited by 11
- 2024On Calibration of Object Detectors: Pitfalls, Evaluation and Baselinescited by 11
- 2022Point-Teaching: Weakly Semi-Supervised Object Detection with Point Annotationscited by 10
- 2022Beyond RGB: Scene-Property Synthesis with Neural Radiance Fieldscited by 10
- 2022ELUDE: Generating interpretable explanations via a decomposition into labelled and unlabelled featurescited by 10
- 2021USB: Universal-Scale Object Detection Benchmarkcited by 9
- 2023Bridging the Sim2Real gap with CARE: Supervised Detection Adaptation with Conditional Alignment and Reweightingcited by 9
- 2023Is Underwater Image Enhancement All Object Detectors Need?cited by 9
- 2022Logit Normalization for Long-tail Object Detectioncited by 8
- 2023A Unified Interactive Model Evaluation for Classification, Object Detection, and Instance Segmentation in Computer Visioncited by 8
- 2024Underwater Object Detection in the Era of Artificial Intelligence: Current, Challenge, and Futurecited by 8
- 2021Few-Shot Video Object Detectioncited by 7
- 2022What's in the Black Box? The False Negative Mechanisms Inside Object Detectorscited by 7
- 2023PrObeD: Proactive Object Detection Wrappercited by 7
- 2022On Hyperbolic Embeddings in 2D Object Detectioncited by 6
- 2022Beyond mAP: Towards better evaluation of instance segmentationcited by 6
- 2022Inverse Image Frequency for Long-tailed Image Recognitioncited by 6
- 2023Bridging Cross-task Protocol Inconsistency for Distillation in Dense Object Detectioncited by 6
- 2025Fine-Tune an SLM or Prompt an LLM? The Case of Generating Low-Code Workflowscited by 6
- 2021Tackling the Background Bias in Sparse Object Detection via Cropped Windowscited by 5
- 2021Chanakya: Learning Runtime Decisions for Adaptive Real-Time Perceptioncited by 5
- 2023DSD-DA: Distillation-based Source Debiasing for Domain Adaptive Object Detectioncited by 5
- 2024Fractal Calibration for long-tailed object detectioncited by 5
- 2021Diagnosing Errors in Video Relation Detectorscited by 4
50 most cited of 113 All 113 (JSON)
- 2026Losing the name before the box: measuring and repairing what narrow fine-tuning costs a detector outside its deployment vocabulary29 Sep 2026
- 2026From internal representations to model improvement through prediction errors28 Sep 2026
- 2026Attribution Gaps in Zero-Training LLM+OVOD Pipelines: A Fine-Grained Analysis of the CAAP--SNAP Discrepancy26 Sep 2026
- 2026Enhanced Knowledge Distillation for Detection Transformer via Teacher Prediction Refinement17 Sep 2026
- 2026Small Object Detection in Drone Aerial Imagery with LAF-YOLOv1013 Sep 2026
- 2026Investigating White Blood Cells as a Source of False-Positive Malaria Parasite Detection in African Blood-Smear Images30 Aug 2026
- 2026YOLO26-RD: An End-to-End Road Damage Detection Network With Learnable Contrast Enhancement and Edge-Guided Downsampling16 Aug 2026
- 2026Diagnosing Aerial-View Object Detectors with Foundational Image Generative Models2 Jul 2026
- 2026From Spatial to Spectral: An Efficient, Frequency-Guided Feature Representation Learner for Small Object Detection22 Jun 2026
- 2026Differences in Detection: Explainability Where it Matters5 Jun 2026
- 2026Diagnosis of Human Object Interaction Detectors for Real World Educational Applications1 Jun 2026
- 2026MicroscopyMatching: Towards a Ready-to-use Framework for Microscopy Image Analysis in Diverse Conditions14 May 2026
38 more
- 2026Class-specific diffusion models improve military object detection in a low-data domain20 Apr 2026
- 2026DetPO: In-Context Learning with Multi-Modal LLMs for Few-Shot Object Detection24 Mar 2026
- 2026LED: A Benchmark for Evaluating Layout Error Detection in Document Analysis18 Mar 2026
- 2026LAF-YOLOv10 with Partial Convolution Backbone, Attention-Guided Feature Pyramid, Auxiliary P2 Head, and Wise-IoU Loss for Small Object Detection in Drone Aerial Imagery13 Feb 2026
- 2026Active Label Cleaning for Reliable Detection of Electron Dense Deposits in Transmission Electron Microscopy Images5 Feb 2026
- 2026Evaluating Large Vision-language Models for Surgical Tool Detection23 Jan 2026
- 2026Harmonizing the Deep: A Unified Information Pipeline for Robust Marine Biodiversity Assessment Across Heterogeneous Domains20 Jan 2026
- 2025Are All Marine Species Created Equal? Performance Disparities in Underwater Object Detection26 Aug 2025
- 2025TRKT: Weakly Supervised Dynamic Scene Graph Generation with Temporal-enhanced Relation-aware Knowledge Transferring7 Aug 2025
- 2025LED Benchmark: Diagnosing Structural Layout Errors for Document Layout Analysis31 Jul 2025
- 2025Boosting Domain Generalized and Adaptive Detection with Diffusion Models: Fitness, Generalization, and Transferability26 Jun 2025
- 2025Pseudo-Labeling Driven Refinement of Benchmark Object Detection Datasets via Analysis of Learning Patterns1 Jun 2025
- 2025Fine-Tune an SLM or Prompt an LLM? The Case of Generating Low-Code Workflows30 May 2025
- 2025MoKD: Multi-Task Optimization for Knowledge Distillation13 May 2025
- 2025Examining the Impact of Optical Aberrations to Image Classification and Object Detection Models25 Apr 2025
- 2025Benchmarking Object Detectors under Real-World Distribution Shifts in Satellite Imagery24 Mar 2025
- 2025Gaseous Object Detection18 Feb 2025
- 2024Box for Mask and Mask for Box: weak losses for multi-task partially supervised learning26 Nov 2024
- 2024Beneath the Surface: The Role of Underwater Image Enhancement in Object Detection21 Nov 2024
- 2024RenderBender: A Survey on Adversarial Attacks Using Differentiable Rendering14 Nov 2024
- 2024Optimizing Edge Offloading Decisions for Object Detection24 Oct 2024
- 2024Fractal Calibration for long-tailed object detection15 Oct 2024
- 2024Underwater Object Detection in the Era of Artificial Intelligence: Current, Challenge, and Future8 Oct 2024
- 2024From COCO to COCO-FP: A Deep Dive into Background False Positives for COCO Detectors12 Sep 2024
- 2024BFA-YOLO: A balanced multiscale object detection network for building faccade attachments detection6 Sep 2024
- 2024Segmentation Dataset for Reinforced Concrete Construction12 Jul 2024
- 2024Cross Domain Object Detection via Multi-Granularity Confidence Alignment based Mean Teacher10 Jul 2024
- 2024On Calibration of Object Detectors: Pitfalls, Evaluation and Baselines30 May 2024
- 2024Criteria for Uncertainty-based Corner Cases Detection in Instance Segmentation17 Apr 2024
- 2024Open-Set Recognition in the Age of Vision-Language Models25 Mar 2024
- 2023Universal Noise Annotation: Unveiling the Impact of Noisy annotation on Object Detection21 Dec 2023
- 2023Is Underwater Image Enhancement All Object Detectors Need?30 Nov 2023
- 2023Security Fence Inspection at Airports Using Object Detection18 Nov 2023
- 2023DSD-DA: Distillation-based Source Debiasing for Domain Adaptive Object Detection17 Nov 2023
- 2023Data exploitation: multi-task learning of object detection and semantic segmentation on partially annotated data7 Nov 2023
- 2023PrObeD: Proactive Object Detection Wrapper28 Oct 2023
- 2023Towards Fair and Comprehensive Comparisons for Image-Based 3D Object Detection9 Oct 2023
- 2023MoCaE: Mixture of Calibrated Experts Significantly Improves Object Detection26 Sep 2023
50 newest of 113 All 113 (JSON)
- 2022VL-CheckList: Evaluating Pre-trained Vision-Language Models with Objects, Attributes and Relationscited by 113
- 2024Open-Set Recognition in the Age of Vision-Language Modelscited by 13
- 2026DetPO: In-Context Learning with Multi-Modal LLMs for Few-Shot Object Detectioncited by 2
- 2026Evaluating Large Vision-language Models for Surgical Tool Detectioncited by 1
- 2026LED: A Benchmark for Evaluating Layout Error Detection in Document Analysiscited by 1
- 2026DetPO: In-Context Learning with Multi-Modal LLMs for Few-Shot Object Detection24 Mar 2026
- 2026LED: A Benchmark for Evaluating Layout Error Detection in Document Analysis18 Mar 2026
- 2026Evaluating Large Vision-language Models for Surgical Tool Detection23 Jan 2026
- 2024Open-Set Recognition in the Age of Vision-Language Models25 Mar 2024
- 2022VL-CheckList: Evaluating Pre-trained Vision-Language Models with Objects, Attributes and Relations1 Jul 2022
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2021Boundary IoU: Improving Object-Centric Image Segmentation Evaluationcited by 186
- 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
- 2021FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagerycited by 143
- 2021Delving into Localization Errors for Monocular 3D Object Detectioncited by 138
- 2021Benchmarking Detection Transfer Learning with Vision Transformerscited by 130
- 2021You Only Look One-level Featurecited by 116
- 2023V3Det: Vast Vocabulary Visual Detection Datasetcited by 81
- 2021FASA: Feature Augmentation and Sampling Adaptation for Long-Tailed Instance Segmentationcited by 76
- 2023The effectiveness of MAE pre-pretraining for billion-scale pretrainingcited by 68
- 2022Sparse Instance Activation for Real-Time Instance Segmentationcited by 63
- 2021Points as Queries: Weakly Semi-supervised Object Detection by Pointscited by 60
12 most cited of 105 All 105 (JSON)
- 2026Losing the name before the box: measuring and repairing what narrow fine-tuning costs a detector outside its deployment vocabulary29 Sep 2026
- 2026From internal representations to model improvement through prediction errors28 Sep 2026
- 2026Attribution Gaps in Zero-Training LLM+OVOD Pipelines: A Fine-Grained Analysis of the CAAP--SNAP Discrepancy26 Sep 2026
- 2026Enhanced Knowledge Distillation for Detection Transformer via Teacher Prediction Refinement17 Sep 2026
- 2026Small Object Detection in Drone Aerial Imagery with LAF-YOLOv1013 Sep 2026
- 2026Investigating White Blood Cells as a Source of False-Positive Malaria Parasite Detection in African Blood-Smear Images30 Aug 2026
- 2026YOLO26-RD: An End-to-End Road Damage Detection Network With Learnable Contrast Enhancement and Edge-Guided Downsampling16 Aug 2026
- 2026Diagnosing Aerial-View Object Detectors with Foundational Image Generative Models2 Jul 2026
- 2026From Spatial to Spectral: An Efficient, Frequency-Guided Feature Representation Learner for Small Object Detection22 Jun 2026
- 2026Differences in Detection: Explainability Where it Matters5 Jun 2026
- 2026Diagnosis of Human Object Interaction Detectors for Real World Educational Applications1 Jun 2026
- 2026MicroscopyMatching: Towards a Ready-to-use Framework for Microscopy Image Analysis in Diverse Conditions14 May 2026
12 newest of 105 All 105 (JSON)