Image-Level or Object-Level? A Tale of Two Resampling Strategies for Long-Tailed Detection
Not on the map. Why?
Abstract (arXiv)
Training on datasets with long-tailed distributions has been challenging for major recognition tasks such as classification and detection. To deal with this challenge, image resampling is typically introduced as a simple but effective approach. However, we observe that long-tailed detection differs from classification since multiple classes may be present in one image. As a result, image resampling alone is not enough to yield a sufficiently balanced distribution at the object level. We address object-level resampling by introducing an object-centric memory replay strategy based on dynamic, episodic memory banks. Our proposed strategy has two benefits: 1) convenient object-level resampling without significant extra computation, and 2) implicit feature-level augmentation from model updates. We show that image-level and object-level resamplings are both important, and thus unify them with a joint resampling strategy (RIO). Our method outperforms state-of-the-art long-tailed detection and segmentation methods on LVIS v0.5 across various backbones. Code is available at https://github.com/NVlabs/RIO.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Builds on 25 of its 35 references that are in the map. First posted on arXiv 12 Apr 2021.
Builds on
25 of 35 references.
References · 25
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2017Mask R-CNNcited by 7,277
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,287
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
13 more
- 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
- 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 705
- 2019A Closer Look at Few-shot Classificationcited by 684
- 2018Exploring the Limits of Weakly Supervised Pretrainingcited by 605
- 2020Equalization Loss for Long-Tailed Object Recognitioncited by 285
- 2020Frustratingly Simple Few-Shot Object Detectioncited by 282
- 2018Low-Shot Learning from Imaginary Datacited by 181
- 2020Overcoming Classifier Imbalance for Long-tail Object Detection with Balanced Group Softmaxcited by 152
- 2020Seesaw Loss for Long-Tailed Instance Segmentationcited by 146
- 2015Relay Backpropagation for Effective Learning of Deep Convolutional Neural Networkscited by 115
- 2020Learning to Segment the Tailcited by 54
- 2020Forest R-CNN: Large-Vocabulary Long-Tailed Object Detection and Instance Segmentationcited by 41
Built on by
Citing papers per year: 2021: 2; 2022: 10; 2023: 4; 2024: 7; 2025: 2; 2026: 2.
27 papers.
Sort:
- 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 614
- 2022RankSim: Ranking Similarity Regularization for Deep Imbalanced Regressioncited by 52
- 2022Discovering Objects that Can Movecited by 44
- 2021On Model Calibration for Long-Tailed Object Detection and Instance Segmentationcited by 39
- 2022BigDetection: A Large-scale Benchmark for Improved Object Detector Pre-trainingcited by 33
- 2024A Systematic Review on Long-Tailed Learningcited by 28
- 2021Taxonomy of Machine Learning Safety: A Survey and Primercited by 25
- 2022Open Vocabulary Object Detection with Proposal Mining and Prediction Equalizationcited by 23
- 2022Relieving Long-tailed Instance Segmentation via Pairwise Class Balancecited by 18
- 2024Trapped in texture bias? A large scale comparison of deep instance segmentationcited by 10
- 2024Continuous Contrastive Learning for Long-Tailed Semi-Supervised Recognitioncited by 10
- 2024Open-Vocabulary Object Detection via Language Hierarchycited by 10
15 more
- 2022Learning with Free Object Segments for Long-Tailed Instance Segmentationcited by 8
- 2024Underwater Object Detection in the Era of Artificial Intelligence: Current, Challenge, and Futurecited by 8
- 2023Instance-Aware Repeat Factor Sampling for Long-Tailed Object Detectioncited by 7
- 2022Bridging Images and Videos: A Simple Learning Framework for Large Vocabulary Video Object Detectioncited by 6
- 2025TAET: Two-Stage Adversarial Equalization Training on Long-Tailed Distributionscited by 6
- 2023Balanced Classification: A Unified Framework for Long-Tailed Object Detectioncited by 5
- 2022Cannot See the Forest for the Trees: Aggregating Multiple Viewpoints to Better Classify Objects in Videoscited by 2
- 2023Semi-Supervised and Long-Tailed Object Detection with CascadeMatchcited by 2
- 2023Ranking Regularization for Critical Rare Classes: Minimizing False Positives at a High True Positive Ratecited by 1
- 2024A Bilevel Optimization Framework for Imbalanced Data Classificationcited by 1
- 2026TMI: Text-to-Image Meets Image-to-Image for Complementary Data Synthesis to Boost Long-Tailed Instance Segmentationcited by 1
- 2022Improving Long-tailed Object Detection with Image-Level Supervision by Multi-Task Collaborative Learningcited by 0
- 2024Rethinking Class-Incremental Learning from a Dynamic Imbalanced Learning Perspectivecited by 0
- 2025Sampling Imbalanced Data with Multi-objective Bilevel Optimizationcited by 0
- 2026Information Density Imbalance in Visual Object Detectioncited by 0
- 2026Information Density Imbalance in Visual Object Detection2 Sep 2026
- 2026TMI: Text-to-Image Meets Image-to-Image for Complementary Data Synthesis to Boost Long-Tailed Instance Segmentation9 Jul 2026
- 2025Sampling Imbalanced Data with Multi-objective Bilevel Optimization12 Jun 2025
- 2025TAET: Two-Stage Adversarial Equalization Training on Long-Tailed Distributions2 Mar 2025
- 2024Open-Vocabulary Object Detection via Language Hierarchy27 Oct 2024
- 2024A Bilevel Optimization Framework for Imbalanced Data Classification15 Oct 2024
- 2024Continuous Contrastive Learning for Long-Tailed Semi-Supervised Recognition8 Oct 2024
- 2024Underwater Object Detection in the Era of Artificial Intelligence: Current, Challenge, and Future8 Oct 2024
- 2024A Systematic Review on Long-Tailed Learning1 Aug 2024
- 2024Rethinking Class-Incremental Learning from a Dynamic Imbalanced Learning Perspective24 May 2024
- 2024Trapped in texture bias? A large scale comparison of deep instance segmentation17 Jan 2024
- 2023Balanced Classification: A Unified Framework for Long-Tailed Object Detection4 Aug 2023
15 more
- 2023Semi-Supervised and Long-Tailed Object Detection with CascadeMatch24 May 2023
- 2023Instance-Aware Repeat Factor Sampling for Long-Tailed Object Detection14 May 2023
- 2023Ranking Regularization for Critical Rare Classes: Minimizing False Positives at a High True Positive Rate31 Mar 2023
- 2022Bridging Images and Videos: A Simple Learning Framework for Large Vocabulary Video Object Detection20 Dec 2022
- 2022Improving Long-tailed Object Detection with Image-Level Supervision by Multi-Task Collaborative Learning11 Oct 2022
- 2022Open Vocabulary Object Detection with Proposal Mining and Prediction Equalization22 Jun 2022
- 2022Cannot See the Forest for the Trees: Aggregating Multiple Viewpoints to Better Classify Objects in Videos5 Jun 2022
- 2022RankSim: Ranking Similarity Regularization for Deep Imbalanced Regression30 May 2022
- 2022BigDetection: A Large-scale Benchmark for Improved Object Detector Pre-training24 Mar 2022
- 2022Discovering Objects that Can Move18 Mar 2022
- 2022Learning with Free Object Segments for Long-Tailed Instance Segmentation22 Feb 2022
- 2022Relieving Long-tailed Instance Segmentation via Pairwise Class Balance8 Jan 2022
- 2022Detecting Twenty-thousand Classes using Image-level Supervision7 Jan 2022
- 2021On Model Calibration for Long-Tailed Object Detection and Instance Segmentation5 Jul 2021
- 2021Taxonomy of Machine Learning Safety: A Survey and Primer9 Jun 2021
- 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 614
- 2022RankSim: Ranking Similarity Regularization for Deep Imbalanced Regressioncited by 52
- 2022Discovering Objects that Can Movecited by 44
- 2021On Model Calibration for Long-Tailed Object Detection and Instance Segmentationcited by 39
- 2022BigDetection: A Large-scale Benchmark for Improved Object Detector Pre-trainingcited by 33
- 2024A Systematic Review on Long-Tailed Learningcited by 28
- 2021Taxonomy of Machine Learning Safety: A Survey and Primercited by 25
- 2022Open Vocabulary Object Detection with Proposal Mining and Prediction Equalizationcited by 23
- 2022Relieving Long-tailed Instance Segmentation via Pairwise Class Balancecited by 18
- 2024Trapped in texture bias? A large scale comparison of deep instance segmentationcited by 10
- 2024Continuous Contrastive Learning for Long-Tailed Semi-Supervised Recognitioncited by 10
- 2024Open-Vocabulary Object Detection via Language Hierarchycited by 10
12 most cited of 27 All 27 (JSON)
- 2026Information Density Imbalance in Visual Object Detection2 Sep 2026
- 2026TMI: Text-to-Image Meets Image-to-Image for Complementary Data Synthesis to Boost Long-Tailed Instance Segmentation9 Jul 2026
- 2025Sampling Imbalanced Data with Multi-objective Bilevel Optimization12 Jun 2025
- 2025TAET: Two-Stage Adversarial Equalization Training on Long-Tailed Distributions2 Mar 2025
- 2024Open-Vocabulary Object Detection via Language Hierarchy27 Oct 2024
- 2024A Bilevel Optimization Framework for Imbalanced Data Classification15 Oct 2024
- 2024Continuous Contrastive Learning for Long-Tailed Semi-Supervised Recognition8 Oct 2024
- 2024Underwater Object Detection in the Era of Artificial Intelligence: Current, Challenge, and Future8 Oct 2024
- 2024A Systematic Review on Long-Tailed Learning1 Aug 2024
- 2024Rethinking Class-Incremental Learning from a Dynamic Imbalanced Learning Perspective24 May 2024
- 2024Trapped in texture bias? A large scale comparison of deep instance segmentation17 Jan 2024
- 2023Balanced Classification: A Unified Framework for Long-Tailed Object Detection4 Aug 2023
12 newest of 27 All 27 (JSON)