Deep Representation Learning on Long-tailed Data: A Learnable Embedding Augmentation Perspective
Not on the map. Why?
Abstract (arXiv)
This paper considers learning deep features from long-tailed data. We observe that in the deep feature space, the head classes and the tail classes present different distribution patterns. The head classes have a relatively large spatial span, while the tail classes have significantly small spatial span, due to the lack of intra-class diversity. This uneven distribution between head and tail classes distorts the overall feature space, which compromises the discriminative ability of the learned features. Intuitively, we seek to expand the distribution of the tail classes by transferring from the head classes, so as to alleviate the distortion of the feature space. To this end, we propose to construct each feature into a "feature cloud". If a sample belongs to a tail class, the corresponding feature cloud will have relatively large distribution range, in compensation to its lack of diversity. It allows each tail sample to push the samples from other classes far away, recovering the intra-class diversity of tail classes. Extensive experimental evaluations on person re-identification and face recognition tasks confirm the effectiveness of our method.
Key facts. Cited by 120 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 32; 2022: 33; 2023: 27; 2024: 15; 2025: 6; 2026: 7.
120 papers.
Sort:
By area:
- 2021Deep Long-Tailed Learning: A Surveycited by 417
- 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 300
- 2021CReST: A Class-Rebalancing Self-Training Framework for Imbalanced Semi-Supervised Learningcited by 175
- 2023Towards Open Vocabulary Learning: A Surveycited by 166
- 2021Free Lunch for Few-shot Learning: Distribution Calibrationcited by 165
- 2022Registration based Few-Shot Anomaly Detectioncited by 133
- 2021Contrastive Learning based Hybrid Networks for Long-Tailed Image Classificationcited by 130
- 2021Self-supervised Learning is More Robust to Dataset Imbalancecited by 123
- 2022Retrieval Augmented Classification for Long-Tail Visual Recognitioncited by 106
- 2021MetaSAug: Meta Semantic Augmentation for Long-Tailed Visual Recognitioncited by 99
- 2021Distributional Robustness Loss for Long-tail Learningcited by 84
- 2021FASA: Feature Augmentation and Sampling Adaptation for Long-Tailed Instance Segmentationcited by 76
38 more
- 2022A Survey on Long-Tailed Visual Recognitioncited by 75
- 2021Lifelong Person Re-Identification via Adaptive Knowledge Accumulationcited by 57
- 2021Trustworthy Long-Tailed Classificationcited by 51
- 2021Adversarial Robustness under Long-Tailed Distributioncited by 50
- 2021A Simple Long-Tailed Recognition Baseline via Vision-Language Modelcited by 49
- 2023Class-Balancing Diffusion Modelscited by 48
- 2023MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentationcited by 35
- 2022Invariant Feature Learning for Generalized Long-Tailed Classificationcited by 34
- 2021GistNet: a Geometric Structure Transfer Network for Long-Tailed Recognitioncited by 31
- 2024MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classificationcited by 30
- 2024A Systematic Review on Long-Tailed Learningcited by 28
- 2021Class-Balanced Distillation for Long-Tailed Visual Recognitioncited by 27
- 2021Imagine by Reasoning: A Reasoning-Based Implicit Semantic Data Augmentation for Long-Tailed Classificationcited by 24
- 2021Balanced Knowledge Distillation for Long-tailed Learningcited by 23
- 2022Delving into Semantic Scale Imbalancecited by 22
- 2023Use Your Head: Improving Long-Tail Video Recognitioncited by 22
- 2023Feature Fusion from Head to Tail for Long-Tailed Visual Recognitioncited by 20
- 2021A Tale Of Two Long Tailscited by 19
- 2021Cross-Domain Empirical Risk Minimization for Unbiased Long-tailed Classificationcited by 19
- 2022Identifying Hard Noise in Long-Tailed Sample Distributioncited by 19
- 2022Imbalanced Semi-supervised Learning with Bias Adaptive Classifiercited by 18
- 2024Delving into the Trajectory Long-tail Distribution for Muti-object Trackingcited by 18
- 2023Fed-GraB: Federated Long-tailed Learning with Self-Adjusting Gradient Balancercited by 17
- 2021Graph Classification by Mixture of Diverse Expertscited by 16
- 2021Rethinking Re-Sampling in Imbalanced Semi-Supervised Learningcited by 16
- 2021Pure Noise to the Rescue of Insufficient Data: Improving Imbalanced Classification by Training on Random Noise Imagescited by 16
- 2022Towards better understanding and better generalization of few-shot classification in histology images with contrastive learningcited by 16
- 2023Distributionally Robust Post-hoc Classifiers under Prior Shiftscited by 16
- 2022Hierarchical Memory Learning for Fine-Grained Scene Graph Generationcited by 15
- 2022Spatial-Temporal Federated Learning for Lifelong Person Re-identification on Distributed Edgescited by 12
- 2023Transfer Knowledge from Head to Tail: Uncertainty Calibration under Long-tailed Distributioncited by 12
- 2024RepAugment: Input-Agnostic Representation-Level Augmentation for Respiratory Sound Classificationcited by 12
- 2021Predicate correlation learning for scene graph generationcited by 11
- 2022ELM: Embedding and Logit Margins for Long-Tail Learningcited by 10
- 2023Single-Stage Heavy-Tailed Food Classificationcited by 10
- 2024Geometric Prior Guided Feature Representation Learning for Long-Tailed Classificationcited by 10
- 2025A Comprehensive Survey on Imbalanced Data Learningcited by 10
- 2021Breadcrumbs: Adversarial Class-Balanced Sampling for Long-tailed Recognitioncited by 9
50 most cited of 120 All 120 (JSON)
- 2026A Strong Balanced-Softmax Classifier-Retraining Baseline for Long-Tailed Recognition10 Jul 2026
- 2026DARC-CLIP: Dynamic Adaptive Refinement with Cross-Attention for Meme Understanding25 Apr 2026
- 2026Self-Reinforcing Controllable Synthesis of Rare Relational Data via Bayesian Calibration18 Apr 2026
- 2026Why Do Vision Language Models Struggle To Recognize Human Emotions?16 Apr 2026
- 2026Semi-Supervised Learning with Balanced Deep Representation Distributions22 Mar 2026
- 2026Beyond the Majority: Long-tail Imitation Learning for Robotic Manipulation6 Feb 2026
- 2026APEX: Probing Neural Networks via Activation Perturbation3 Feb 2026
- 2025Generative Active Learning for Long-tail Trajectory Prediction via Controllable Diffusion Model30 Jul 2025
- 2025ViRN: Variational Inference and Distribution Trilateration for Long-Tailed Continual Representation Learning23 Jul 2025
- 2025Compositional Attribute Imbalance in Vision Datasets17 Jun 2025
- 2025A Comprehensive Survey on Imbalanced Data Learning13 Feb 2025
- 2025Long-tailed Medical Diagnosis with Relation-aware Representation Learning and Iterative Classifier Calibration5 Feb 2025
38 more
- 2025Making Reliable and Flexible Decisions in Long-tailed Classification23 Jan 2025
- 2024Partial Knowledge Distillation for Alleviating the Inherent Inter-Class Discrepancy in Federated Learning23 Nov 2024
- 2024Learning De-Biased Representations for Remote-Sensing Imagery6 Oct 2024
- 2024Multiplicative Logit Adjustment Approximates Neural-Collapse-Aware Decision Boundary Adjustment26 Sep 2024
- 2024MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classification23 Sep 2024
- 2024Subspace Prototype Guidance for Mitigating Class Imbalance in Point Cloud Semantic Segmentation20 Aug 2024
- 2024Can DPO Learn Diverse Human Values? A Theoretical Scaling Law6 Aug 2024
- 2024A Systematic Review on Long-Tailed Learning1 Aug 2024
- 2024LTRL: Boosting Long-tail Recognition via Reflective Learning17 Jul 2024
- 2024Auto Cherry-Picker: Learning from High-quality Generative Data Driven by Language28 Jun 2024
- 2024RepAugment: Input-Agnostic Representation-Level Augmentation for Respiratory Sound Classification5 May 2024
- 2024Delving into the Trajectory Long-tail Distribution for Muti-object Tracking7 Mar 2024
- 2024Taming the Tail in Class-Conditional GANs: Knowledge Sharing via Unconditional Training at Lower Resolutions26 Feb 2024
- 2024Geometric Prior Guided Feature Representation Learning for Long-Tailed Classification21 Jan 2024
- 2024Enhanced Few-Shot Class-Incremental Learning via Ensemble Models14 Jan 2024
- 2024Class-Imbalanced Semi-Supervised Learning for Large-Scale Point Cloud Semantic Segmentation via Decoupling Optimization13 Jan 2024
- 2023Data-Centric Long-Tailed Image Recognition3 Nov 2023
- 2023Re-weighting Tokens: A Simple and Effective Active Learning Strategy for Named Entity Recognition2 Nov 2023
- 2023Orthogonal Uncertainty Representation of Data Manifold for Robust Long-Tailed Learning16 Oct 2023
- 2023Long-Tailed Classification Based on Coarse-Grained Leading Forest and Multi-Center Loss12 Oct 2023
- 2023Fed-GraB: Federated Long-tailed Learning with Self-Adjusting Gradient Balancer11 Oct 2023
- 2023DST-Det: Simple Dynamic Self-Training for Open-Vocabulary Object Detection2 Oct 2023
- 2023MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentation22 Sep 2023
- 2023Distributionally Robust Post-hoc Classifiers under Prior Shifts16 Sep 2023
- 2023LatentDR: Improving Model Generalization Through Sample-Aware Latent Degradation and Restoration28 Aug 2023
- 2023Dual Compensation Residual Networks for Class Imbalanced Learning25 Aug 2023
- 2023RAHNet: Retrieval Augmented Hybrid Network for Long-tailed Graph Classification4 Aug 2023
- 2023Free-Form Composition Networks for Egocentric Action Recognition13 Jul 2023
- 2023Single-Stage Heavy-Tailed Food Classification1 Jul 2023
- 2023Towards Open Vocabulary Learning: A Survey28 Jun 2023
- 2023Feature Fusion from Head to Tail for Long-Tailed Visual Recognition12 Jun 2023
- 2023Instance-based Max-margin for Practical Few-shot Recognition27 May 2023
- 2023Exploring Weight Balancing on Long-Tailed Recognition Problem26 May 2023
- 2023Few-Shot Learning with Visual Distribution Calibration and Cross-Modal Distribution Alignment19 May 2023
- 2023Adjusting Logit in Gaussian Form for Long-Tailed Visual Recognition18 May 2023
- 2023Class-Balancing Diffusion Models30 Apr 2023
- 2023Transfer Knowledge from Head to Tail: Uncertainty Calibration under Long-tailed Distribution13 Apr 2023
- 2023Use Your Head: Improving Long-Tail Video Recognition3 Apr 2023
50 newest of 120 All 120 (JSON)
- 2023Class-Balancing Diffusion Modelscited by 48
- 2023MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentationcited by 35
- 2025Generative Active Learning for Long-tail Trajectory Prediction via Controllable Diffusion Modelcited by 6
- 2024Auto Cherry-Picker: Learning from High-quality Generative Data Driven by Languagecited by 4
- 2025Generative Active Learning for Long-tail Trajectory Prediction via Controllable Diffusion Model30 Jul 2025
- 2024Auto Cherry-Picker: Learning from High-quality Generative Data Driven by Language28 Jun 2024
- 2023MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentation22 Sep 2023
- 2023Class-Balancing Diffusion Models30 Apr 2023
- 2021Deep Long-Tailed Learning: A Surveycited by 417
- 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 300
- 2021CReST: A Class-Rebalancing Self-Training Framework for Imbalanced Semi-Supervised Learningcited by 175
- 2023Towards Open Vocabulary Learning: A Surveycited by 166
- 2021Free Lunch for Few-shot Learning: Distribution Calibrationcited by 165
- 2022Registration based Few-Shot Anomaly Detectioncited by 133
- 2021Contrastive Learning based Hybrid Networks for Long-Tailed Image Classificationcited by 130
- 2021Self-supervised Learning is More Robust to Dataset Imbalancecited by 123
- 2021MetaSAug: Meta Semantic Augmentation for Long-Tailed Visual Recognitioncited by 99
- 2021Distributional Robustness Loss for Long-tail Learningcited by 84
- 2021FASA: Feature Augmentation and Sampling Adaptation for Long-Tailed Instance Segmentationcited by 76
- 2022A Survey on Long-Tailed Visual Recognitioncited by 75
12 most cited of 106 All 106 (JSON)
- 2026A Strong Balanced-Softmax Classifier-Retraining Baseline for Long-Tailed Recognition10 Jul 2026
- 2026DARC-CLIP: Dynamic Adaptive Refinement with Cross-Attention for Meme Understanding25 Apr 2026
- 2026Self-Reinforcing Controllable Synthesis of Rare Relational Data via Bayesian Calibration18 Apr 2026
- 2026Semi-Supervised Learning with Balanced Deep Representation Distributions22 Mar 2026
- 2026APEX: Probing Neural Networks via Activation Perturbation3 Feb 2026
- 2025ViRN: Variational Inference and Distribution Trilateration for Long-Tailed Continual Representation Learning23 Jul 2025
- 2025Compositional Attribute Imbalance in Vision Datasets17 Jun 2025
- 2025A Comprehensive Survey on Imbalanced Data Learning13 Feb 2025
- 2025Long-tailed Medical Diagnosis with Relation-aware Representation Learning and Iterative Classifier Calibration5 Feb 2025
- 2025Making Reliable and Flexible Decisions in Long-tailed Classification23 Jan 2025
- 2024Learning De-Biased Representations for Remote-Sensing Imagery6 Oct 2024
- 2024Multiplicative Logit Adjustment Approximates Neural-Collapse-Aware Decision Boundary Adjustment26 Sep 2024
12 newest of 106 All 106 (JSON)