Training Region-based Object Detectors with Online Hard Example Mining
Not on the map. Why?
Abstract (arXiv)
The field of object detection has made significant advances riding on the wave of region-based ConvNets, but their training procedure still includes many heuristics and hyperparameters that are costly to tune. We present a simple yet surprisingly effective online hard example mining (OHEM) algorithm for training region-based ConvNet detectors. Our motivation is the same as it has always been -- detection datasets contain an overwhelming number of easy examples and a small number of hard examples. Automatic selection of these hard examples can make training more effective and efficient. OHEM is a simple and intuitive algorithm that eliminates several heuristics and hyperparameters in common use. But more importantly, it yields consistent and significant boosts in detection performance on benchmarks like PASCAL VOC 2007 and 2012. Its effectiveness increases as datasets become larger and more difficult, as demonstrated by the results on the MS COCO dataset. Moreover, combined with complementary advances in the field, OHEM leads to state-of-the-art results of 78.9% and 76.3% mAP on PASCAL VOC 2007 and 2012 respectively.
Key facts. Cited by 577 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Apr 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 137; 2022: 119; 2023: 105; 2024: 82; 2025: 49; 2026: 85.
577 papers.
Sort:
By area:
- 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 390
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
- 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 315
- 2021Unbiased Teacher for Semi-Supervised Object Detectioncited by 305
- 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 299
- 2021Curriculum Learning: A Surveycited by 257
- 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 216
- 2021Localizing Visual Sounds the Hard Waycited by 169
- 2021FSCE: Few-Shot Object Detection via Contrastive Proposal Encodingcited by 168
- 2023EfficientAD: Accurate Visual Anomaly Detection at Millisecond-Level Latenciescited by 157
- 2021Delving into Localization Errors for Monocular 3D Object Detectioncited by 138
- 2021General Instance Distillation for Object Detectioncited by 113
38 more
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
- 2024Improving the Training of Rectified Flowscited by 106
- 2021Semi-supervised Left Atrium Segmentation with Mutual Consistency Trainingcited by 104
- 2022Improving Generalization in Federated Learning by Seeking Flat Minimacited by 98
- 2021A Survey of Modern Deep Learning based Object Detection Modelscited by 97
- 2021Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenescited by 89
- 2022PIDNet: A Real-time Semantic Segmentation Network Inspired by PID Controllerscited by 84
- 2021Fourier Contour Embedding for Arbitrary-Shaped Text Detectioncited by 80
- 2022TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 78
- 2021FASA: Feature Augmentation and Sampling Adaptation for Long-Tailed Instance Segmentationcited by 76
- 2021ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesiscited by 76
- 2022A Survey on Long-Tailed Visual Recognitioncited by 75
- 2024A Unified Anomaly Synthesis Strategy with Gradient Ascent for Industrial Anomaly Detection and Localizationcited by 74
- 2021Context Decoupling Augmentation for Weakly Supervised Semantic Segmentationcited by 69
- 2021Learning Fast Sample Re-weighting Without Reward Datacited by 69
- 2022R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesiscited by 69
- 2022Unbiased Teacher v2: Semi-supervised Object Detection for Anchor-free and Anchor-based Detectorscited by 69
- 2021Ground-aware Monocular 3D Object Detection for Autonomous Drivingcited by 65
- 2021PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Textcited by 65
- 2022PolyLoss: A Polynomial Expansion Perspective of Classification Loss Functionscited by 62
- 2023FreeMask: Synthetic Images with Dense Annotations Make Stronger Segmentation Modelscited by 61
- 2023Multiple Instance Learning Framework with Masked Hard Instance Mining for Whole Slide Image Classificationcited by 58
- 2023FocalFormer3D : Focusing on Hard Instance for 3D Object Detectioncited by 58
- 2021Focal and Efficient IOU Loss for Accurate Bounding Box Regressioncited by 57
- 2022Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmarkcited by 56
- 2023Hard Patches Mining for Masked Image Modelingcited by 56
- 2024UniMatch V2: Pushing the Limit of Semi-Supervised Semantic Segmentationcited by 53
- 2023EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answeringcited by 51
- 2021On Exposing the Challenging Long Tail in Future Prediction of Traffic Actorscited by 48
- 2021Data-Uncertainty Guided Multi-Phase Learning for Semi-Supervised Object Detectioncited by 48
- 2021Hard Sample Aware Noise Robust Learning for Histopathology Image Classificationcited by 48
- 2021Adaptive Boundary Proposal Network for Arbitrary Shape Text Detectioncited by 47
- 2022Equalized Focal Loss for Dense Long-Tailed Object Detectioncited by 46
- 2022Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detectioncited by 46
- 2022Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentationcited by 46
- 2021Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translationcited by 45
- 2023CorrMatch: Label Propagation via Correlation Matching for Semi-Supervised Semantic Segmentationcited by 43
- 2024Not All Voxels Are Equal: Hardness-Aware Semantic Scene Completion with Self-Distillationcited by 43
50 most cited of 577 All 577 (JSON)
- 2026SALD: Self-Referenced Advantage Learning for Diffusion Models1 Oct 2026
- 2026Less Data, Better Timing: Student-Curriculum Coupling for VLM On-Policy Distillation in Temporal Video Grounding30 Sep 2026
- 2026Weeding Out Bad Seeds: Initial-Noise-Robust Unlearning for Text-to-Image Diffusion Models29 Sep 2026
- 2026Mutually Adversarial Self-Training with Evolving Data for Unified Multimodal Models28 Sep 2026
- 2026Age of Learning: Temporal Persistence of Prediction Errors as a Learning Signal26 Sep 2026
- 2026GCUL: Ambiguity Identification in Text Emotion Classification via Cluster-Guided Learning24 Sep 2026
- 2026STEVE: Stabilizing Textual Gradient-Based Prompt Optimization via Error-Driven Refinement and Regularized Verification20 Sep 2026
- 2026Efficient Reasoning Distillation: Small Video-Language Models via Synthetic CoT and Difficulty-Aware Fine-Tuning14 Sep 2026
- 2026Curriculum Learning as Transport: Understanding Curricula with Wasserstein Geodesics8 Sep 2026
- 2026TriCCOT: Tri-part Convolutional Conformal Transformer for Onboard Space Object Detection8 Sep 2026
- 2026TrojanWorld: Backdooring World-Model Agents via Imagination Steering7 Sep 2026
- 2026FTU-Seek: Foundation Model-Guided Hard-Negative Learning for Sparse Functional Tissue Unit Segmentation1 Sep 2026
38 more
- 2026When and What to Teach: Budget-Aware Online Adaptation for Web Agents31 Aug 2026
- 2026Detection of Christmas tree plantations from high-resolution aerial imagery. A case study in the French Morvan27 Aug 2026
- 2026Loss-Based Active Learning for Neural Abstractive Summarization26 Aug 2026
- 2026Difficulty-Aware Sample Allocation for Adaptive Data Augmentation in Semantic Segmentation26 Aug 2026
- 2026RedLight-VLA: Models for traffic-rule grounding and behavioral emphasis in driving policies21 Aug 2026
- 2026Capacity-Dependent Effects of Data Selection for Reasoning13 Aug 2026
- 2026TongueReenact: Geometry-Anchored Tongue Synthesis for Face Reenactment30 Jul 2026
- 2026SafeBuild-Bench: A Temporal-Robust Construction Safety Benchmark with Graph-Enhanced Data Mining29 Jul 2026
- 2026Leak-Free Cross-Validated Stacking with Per-Architecture Calibration for Sand-Boil Segmentation in Earthen Levees28 Jul 2026
- 2026DPNeXt: A Lightweight Multi-Scale Feature Fusion Framework for Efficient ViT-Based Multi-Task Dense Prediction17 Jul 2026
- 2026Learning Faster without Deeper Networks: A*-Inspired Batch Selection for Efficient CNN Training17 Jul 2026
- 2026The Devil is in the Dark Pixels: Toward Brightness Bias-Robust Denoising15 Jul 2026
- 2026Steering Diffusion Models via Class-Contrastive Influence for Few-Shot Medical Classification14 Jul 2026
- 2026NEEDL-Bench: Dataset for Swiss Needle Cast and Stomata Detection in Microscopy Images13 Jul 2026
- 2026Position: Stop Reactively Patching Your Model Every Time and Start Proactive Test-Driven AI Development10 Jul 2026
- 2026Selective Timestep Weighting and Advantage-Based Replay for Sample-Efficient Diffusion RLHF8 Jul 2026
- 2026Asymmetric Focal Loss Improves Graph Neural Network Prediction of Drug-Drug Interactions8 Jul 2026
- 2026TACoS: Weakly Supervised Learning of Two-Dimensional Materials from Scribble Annotations to Precise Segmentation8 Jul 2026
- 2026Enhanced Seam Segmentation for Automated Welding Robot in Construction Through Transfer Learning: Addressing Limitations of Bilateral Segmentation Network7 Jul 2026
- 2026Preserve the Hard, Regenerate the Rest: Uncertainty-Guided Synthetic Training Data Augmentation with Diffusion Models30 Jun 2026
- 2026DriftGuard: Safety-Aware Multi-Monitor Detection and Selective Adaptation for Evolving Toxicity Moderation27 Jun 2026
- 2026DeCoFlow: Structural Decomposition of Normalizing Flows for Continual Anomaly Detection25 Jun 2026
- 2026GRAIN: Group Aggregation via Min-Norm Objective22 Jun 2026
- 2026Specificity- and Calibration-Aware Breast Ultrasound Segmentation via Entropy-Guided Boundary Supervision21 Jun 2026
- 2026Boundary Embedding Shaping with Adaptive Contrastive Learning for Graph Structural Disentanglement18 Jun 2026
- 2026RODS: Reward-Driven Online Data Synthesis for Multi-Turn Tool-Use Agents17 Jun 2026
- 2026MamBOA: State-Space Architecture for Video Recognition13 Jun 2026
- 2026PP-OCRv6: From 1.5M to 34.5M Parameters, Surpassing Billion-Scale VLMs on OCR Tasks11 Jun 2026
- 2026Using Explainability as a Training-Time Reliability Signal for Efficient ECG Classification10 Jun 2026
- 2026Support Vector Rubrics: Closing the Gap Between Self-Generated and Human Rubrics6 Jun 2026
- 2026Spend Your Rollouts Where It Counts: Rollout Allocation for Group-Based RL Post-Training26 May 2026
- 2026Frequency-Guided Fusion For RGB-Thermal Semantic Segmentation25 May 2026
- 2026ATV-Net: Adaptive Triple-View Network with Dynamic Feature Fusion25 May 2026
- 2026Learning-Zone Energy: Online Data Selection for Efficient RL Post-Training16 May 2026
- 2026Interaction-Aware Influence Functions for Group Attribution15 May 2026
- 2026Bounded-Rationality, Hedging, and Generalization14 May 2026
- 2026Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancing11 May 2026
- 2026DA-SegFormer: Damage-Aware Semantic Segmentation for Fine-Grained Disaster Assessment11 May 2026
50 newest of 577 All 577 (JSON)
- 2024Improving the Training of Rectified Flowscited by 106
- 2023DiffMIC: Dual-Guidance Diffusion Network for Medical Image Classificationcited by 32
- 2024Continuous Concepts Removal in Text-to-image Diffusion Modelscited by 6
- 2025A Closer Look on Memorization in Tabular Diffusion Model: A Data-Centric Perspectivecited by 1
- 2024Anisotropic Diffusion Probabilistic Model for Imbalanced Image Classificationcited by 0
- 2026Mitigating Long-Tail Bias via Prompt-Controlled Diffusion Augmentationcited by 0
- 2026Preserve the Hard, Regenerate the Rest: Uncertainty-Guided Synthetic Training Data Augmentation with Diffusion Modelscited by 0
- 2026Steering Diffusion Models via Class-Contrastive Influence for Few-Shot Medical Classificationcited by 0
- 2026Weeding Out Bad Seeds: Initial-Noise-Robust Unlearning for Text-to-Image Diffusion Modelscited by 0
- 2026SALD: Self-Referenced Advantage Learning for Diffusion Modelscited by 0
- 2026SALD: Self-Referenced Advantage Learning for Diffusion Models1 Oct 2026
- 2026Weeding Out Bad Seeds: Initial-Noise-Robust Unlearning for Text-to-Image Diffusion Models29 Sep 2026
- 2026Steering Diffusion Models via Class-Contrastive Influence for Few-Shot Medical Classification14 Jul 2026
- 2026Preserve the Hard, Regenerate the Rest: Uncertainty-Guided Synthetic Training Data Augmentation with Diffusion Models30 Jun 2026
- 2026Mitigating Long-Tail Bias via Prompt-Controlled Diffusion Augmentation4 Feb 2026
- 2025A Closer Look on Memorization in Tabular Diffusion Model: A Data-Centric Perspective28 May 2025
- 2024Continuous Concepts Removal in Text-to-image Diffusion Models30 Nov 2024
- 2024Anisotropic Diffusion Probabilistic Model for Imbalanced Image Classification22 Sep 2024
- 2024Improving the Training of Rectified Flows30 May 2024
- 2023DiffMIC: Dual-Guidance Diffusion Network for Medical Image Classification19 Mar 2023
- 2025YoChameleon: Personalized Vision and Language Generationcited by 20
- 2022Vision-Language Pre-Training for Boosting Scene Text Detectorscited by 18
- 2026PP-OCRv6: From 1.5M to 34.5M Parameters, Surpassing Billion-Scale VLMs on OCR Taskscited by 12
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agentscited by 9
- 2025LLaVAction: evaluating and training multi-modal large language models for action understandingcited by 3
- 2026OODBench: Out-of-Distribution Benchmark for Large Vision-Language Modelscited by 1
- 2026DenseMLLM: Standard Multimodal LLMs for Dense Predictioncited by 0
- 2026Cross-Modal Semantic-Enhanced Diffusion Framework for Diabetic Retinopathy Gradingcited by 0
- 2026CrossVL: Complexity-Aware Feature Routing and Paired Curriculum for Cross-View Vision-Language Detectioncited by 0
- 2026Less Data, Better Timing: Student-Curriculum Coupling for VLM On-Policy Distillation in Temporal Video Groundingcited by 0
- 2026Less Data, Better Timing: Student-Curriculum Coupling for VLM On-Policy Distillation in Temporal Video Grounding30 Sep 2026
- 2026PP-OCRv6: From 1.5M to 34.5M Parameters, Surpassing Billion-Scale VLMs on OCR Tasks11 Jun 2026
- 2026CrossVL: Complexity-Aware Feature Routing and Paired Curriculum for Cross-View Vision-Language Detection10 May 2026
- 2026Cross-Modal Semantic-Enhanced Diffusion Framework for Diabetic Retinopathy Grading10 May 2026
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agents12 Mar 2026
- 2026OODBench: Out-of-Distribution Benchmark for Large Vision-Language Models20 Feb 2026
- 2026DenseMLLM: Standard Multimodal LLMs for Dense Prediction15 Feb 2026
- 2025YoChameleon: Personalized Vision and Language Generation29 Apr 2025
- 2025LLaVAction: evaluating and training multi-modal large language models for action understanding24 Mar 2025
- 2022Vision-Language Pre-Training for Boosting Scene Text Detectors29 Apr 2022
- 2025No Labels, No Problem: Training Visual Reasoners with Multimodal Verifierscited by 3
- 2026Learning-Zone Energy: Online Data Selection for Efficient RL Post-Trainingcited by 2
- 2026Adaptive Negative Reinforcement for LLM Reasoning:Dynamically Balancing Correction and Diversity in RLVRcited by 1
- 2026TableNet A Large-Scale Table Dataset with LLM-Powered Autonomouscited by 0
- 2026Efficient Reasoning Distillation: Small Video-Language Models via Synthetic CoT and Difficulty-Aware Fine-Tuningcited by 0
- 2026Efficient Reasoning Distillation: Small Video-Language Models via Synthetic CoT and Difficulty-Aware Fine-Tuning14 Sep 2026
- 2026Learning-Zone Energy: Online Data Selection for Efficient RL Post-Training16 May 2026
- 2026Adaptive Negative Reinforcement for LLM Reasoning:Dynamically Balancing Correction and Diversity in RLVR8 May 2026
- 2026TableNet A Large-Scale Table Dataset with LLM-Powered Autonomous27 Feb 2026
- 2025No Labels, No Problem: Training Visual Reasoners with Multimodal Verifiers9 Dec 2025
- 2022Embedding Synthetic Off-Policy Experience for Autonomous Driving via Zero-Shot Curriculacited by 17
- 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunitiescited by 6
- 2026RedLight-VLA: Models for traffic-rule grounding and behavioral emphasis in driving policiescited by 0
- 2026RedLight-VLA: Models for traffic-rule grounding and behavioral emphasis in driving policies21 Aug 2026
- 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunities22 Aug 2024
- 2022Embedding Synthetic Off-Policy Experience for Autonomous Driving via Zero-Shot Curricula2 Dec 2022
- 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 390
- 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 315
- 2021Unbiased Teacher for Semi-Supervised Object Detectioncited by 305
- 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 299
- 2021Curriculum Learning: A Surveycited by 257
- 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 216
- 2021Localizing Visual Sounds the Hard Waycited by 169
- 2021FSCE: Few-Shot Object Detection via Contrastive Proposal Encodingcited by 168
- 2023EfficientAD: Accurate Visual Anomaly Detection at Millisecond-Level Latenciescited by 157
- 2021Delving into Localization Errors for Monocular 3D Object Detectioncited by 138
- 2021General Instance Distillation for Object Detectioncited by 113
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
12 most cited of 533 All 533 (JSON)
- 2026Mutually Adversarial Self-Training with Evolving Data for Unified Multimodal Models28 Sep 2026
- 2026Age of Learning: Temporal Persistence of Prediction Errors as a Learning Signal26 Sep 2026
- 2026GCUL: Ambiguity Identification in Text Emotion Classification via Cluster-Guided Learning24 Sep 2026
- 2026STEVE: Stabilizing Textual Gradient-Based Prompt Optimization via Error-Driven Refinement and Regularized Verification20 Sep 2026
- 2026Curriculum Learning as Transport: Understanding Curricula with Wasserstein Geodesics8 Sep 2026
- 2026TriCCOT: Tri-part Convolutional Conformal Transformer for Onboard Space Object Detection8 Sep 2026
- 2026FTU-Seek: Foundation Model-Guided Hard-Negative Learning for Sparse Functional Tissue Unit Segmentation1 Sep 2026
- 2026Detection of Christmas tree plantations from high-resolution aerial imagery. A case study in the French Morvan27 Aug 2026
- 2026Loss-Based Active Learning for Neural Abstractive Summarization26 Aug 2026
- 2026Difficulty-Aware Sample Allocation for Adaptive Data Augmentation in Semantic Segmentation26 Aug 2026
- 2026Capacity-Dependent Effects of Data Selection for Reasoning13 Aug 2026
- 2026TongueReenact: Geometry-Anchored Tongue Synthesis for Face Reenactment30 Jul 2026
12 newest of 533 All 533 (JSON)