LTRL: Boosting Long-tail Recognition via Reflective Learning
Not on the map. Why?
Abstract (arXiv)
In real-world scenarios, where knowledge distributions exhibit long-tail. Humans manage to master knowledge uniformly across imbalanced distributions, a feat attributed to their diligent practices of reviewing, summarizing, and correcting errors. Motivated by this learning process, we propose a novel learning paradigm, called reflecting learning, in handling long-tail recognition. Our method integrates three processes for reviewing past predictions during training, summarizing and leveraging the feature relation across classes, and correcting gradient conflict for loss functions. These designs are lightweight enough to plug and play with existing long-tail learning methods, achieving state-of-the-art performance in popular long-tail visual benchmarks. The experimental results highlight the great potential of reflecting learning in dealing with long-tail recognition.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 44 of its 56 references that are in the map. First posted on arXiv 17 Jul 2024.
Builds on
44 of 56 references.
References · 44
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
- 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 920
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
- 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 705
- 2020Long-tail learning via logit adjustmentcited by 618
32 more
- 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 513
- 2016Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learningcited by 441
- 2021Deep Long-Tailed Learning: A Surveycited by 417
- 2019BBN: Bilateral-Branch Network with Cumulative Learning for Long-Tailed Visual Recognitioncited by 403
- 2020Balanced Meta-Softmax for Long-Tailed Visual Recognitioncited by 400
- 2020Long-tailed Recognition by Routing Diverse Distribution-Aware Expertscited by 271
- 2018What is the Effect of Importance Weighting in Deep Learning?cited by 251
- 2014Learning with Pseudo-Ensemblescited by 241
- 2021Parametric Contrastive Learningcited by 217
- 2020Rethinking the Value of Labels for Improving Class-Imbalanced Learningcited by 216
- 2021Improving Calibration for Long-Tailed Recognitioncited by 212
- 2020Learning From Multiple Experts: Self-paced Knowledge Distillation for Long-tailed Classificationcited by 175
- 2015Cost Sensitive Learning of Deep Feature Representations from Imbalanced Datacited by 167
- 2020Remix: Rebalanced Mixupcited by 144
- 2022Balanced Contrastive Learning for Long-Tailed Visual Recognitioncited by 144
- 2021Contrastive Learning based Hybrid Networks for Long-Tailed Image Classificationcited by 130
- 2020Deep Representation Learning on Long-tailed Data: A Learnable Embedding Augmentation Perspectivecited by 120
- 2022Long-Tailed Recognition via Weight Balancingcited by 107
- 2021Self-Supervised Aggregation of Diverse Experts for Test-Agnostic Long-Tailed Recognitioncited by 95
- 2021ACE: Ally Complementary Experts for Solving Long-Tailed Recognition in One-Shotcited by 86
- 2021Distilling Virtual Examples for Long-tailed Recognitioncited by 72
- 2022Nested Collaborative Learning for Long-Tailed Visual Recognitioncited by 63
- 2024LTGC: Long-tail Recognition via Leveraging LLMs-driven Generated Contentcited by 33
- 2017The iNaturalist Species Classification and Detection Datasetcited by 29
- 2022Constructing Balance from Imbalance for Long-tailed Image Recognitioncited by 25
- 2024Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackerscited by 24
- 2022Balanced Product of Calibrated Experts for Long-Tailed Recognitioncited by 20
- 2023MDCS: More Diverse Experts with Consistency Self-distillation for Long-tailed Recognitioncited by 19
- 2021Long-tail Recognition via Compositional Knowledge Transfercited by 16
- 2020Memory-based Jitter: Improving Visual Recognition on Long-tailed Data with Diversity In Memorycited by 15
- 2023Decoupled Training for Long-Tailed Classification With Stochastic Representationscited by 13
- 2018Left-Right Comparative Recurrent Model for Stereo Matchingcited by 12
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025Divide, Weight, and Route: Difficulty-Aware Optimization with Dynamic Expert Fusion for Long-tailed Recognitioncited by 1
- 2025LT-Soups: Bridging Head and Tail Classes via Subsampled Model Soupscited by 1
- 2026Deep Convolutional Large-Margin ℓp-SVDD for Visual Anomaly Detectioncited by 0
- 2026CLEAR: Class-wise Expert Aggregation with Structured Sampling for Long-Tailed Classificationcited by 0
- 2026VICAL: Vicinal Consistency Alignment for Long-Tailed Visual Recognitioncited by 0
- 2026Rethinking Class Imbalance for Single-Cell Foundation Models: A Systematic Benchmark Across Architectures and Long-Tail Loss Functionscited by 0
- 2026Rethinking Class Imbalance for Single-Cell Foundation Models: A Systematic Benchmark Across Architectures and Long-Tail Loss Functions20 Sep 2026
- 2026VICAL: Vicinal Consistency Alignment for Long-Tailed Visual Recognition4 Sep 2026
- 2026CLEAR: Class-wise Expert Aggregation with Structured Sampling for Long-Tailed Classification11 Aug 2026
- 2026Deep Convolutional Large-Margin ℓp-SVDD for Visual Anomaly Detection24 Jul 2026
- 2025LT-Soups: Bridging Head and Tail Classes via Subsampled Model Soups11 Nov 2025
- 2025Divide, Weight, and Route: Difficulty-Aware Optimization with Dynamic Expert Fusion for Long-tailed Recognition27 Aug 2025