Distribution-Balanced Loss for Multi-Label Classification in Long-Tailed Datasets
Not on the map. Why?
Abstract (arXiv)
We present a new loss function called Distribution-Balanced Loss for the multi-label recognition problems that exhibit long-tailed class distributions. Compared to conventional single-label classification problem, multi-label recognition problems are often more challenging due to two significant issues, namely the co-occurrence of labels and the dominance of negative labels (when treated as multiple binary classification problems). The Distribution-Balanced Loss tackles these issues through two key modifications to the standard binary cross-entropy loss: 1) a new way to re-balance the weights that takes into account the impact caused by label co-occurrence, and 2) a negative tolerant regularization to mitigate the over-suppression of negative labels. Experiments on both Pascal VOC and COCO show that the models trained with this new loss function achieve significant performance gains over existing methods. Code and models are available at: https://github.com/wutong16/DistributionBalancedLoss .
Key facts. Cited by 122 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 26; 2023: 31; 2024: 20; 2025: 12; 2026: 6.
122 papers.
Sort:
By area:
- 2021Deep Long-Tailed Learning: A Surveycited by 416
- 2021Query2Label: A Simple Transformer Way to Multi-Label Classificationcited by 126
- 2021MetaSAug: Meta Semantic Augmentation for Long-Tailed Visual Recognitioncited by 99
- 2021ML-Decoder: Scalable and Versatile Classification Headcited by 78
- 2022A Survey on Long-Tailed Visual Recognitioncited by 75
- 2021Adaptive Methods for Real-World Domain Generalizationcited by 66
- 2021Trustworthy Long-Tailed Classificationcited by 51
- 2021Adversarial Robustness under Long-Tailed Distributioncited by 50
- 2022Large Loss Matters in Weakly Supervised Multi-Label Classificationcited by 38
- 2021VideoLT: Large-scale Long-tailed Video Recognitioncited by 35
- 2021Robust Long-Tailed Learning under Label Noisecited by 35
- 2021Balancing Methods for Multi-label Text Classification with Long-Tailed Class Distributioncited by 34
38 more
- 2022Learning Imbalanced Data with Vision Transformerscited by 34
- 2025MAT-Agent: Adaptive Multi-Agent Training Optimizationcited by 34
- 2023FoodLMM: A Versatile Food Assistant using Large Multi-modal Modelcited by 32
- 2021Class-Balanced Distillation for Long-Tailed Visual Recognitioncited by 27
- 2021Relational Subsets Knowledge Distillation for Long-tailed Retinal Diseases Recognitioncited by 27
- 2021MovieCuts: A New Dataset and Benchmark for Cut Type Recognitioncited by 26
- 2021Multi-label Classification with Partial Annotations using Class-aware Selective Losscited by 25
- 2022Delving into Semantic Scale Imbalancecited by 22
- 2022Open Long-Tailed Recognition in a Dynamic Worldcited by 21
- 2022A Survey of Methods for Addressing Class Imbalance in Deep-Learning Based Natural Language Processingcited by 20
- 2023TagCLIP: A Local-to-Global Framework to Enhance Open-Vocabulary Multi-Label Classification of CLIP Without Trainingcited by 19
- 2024SFC: Shared Feature Calibration in Weakly Supervised Semantic Segmentationcited by 19
- 2022Relieving Long-tailed Instance Segmentation via Pairwise Class Balancecited by 18
- 2023Multi-label affordance mapping from egocentric visioncited by 18
- 2021Sewer-ML: A Multi-Label Sewer Defect Classification Dataset and Benchmarkcited by 17
- 2023Learning in Imperfect Environment: Multi-Label Classification with Long-Tailed Distribution and Partial Labelscited by 17
- 2023Fed-GraB: Federated Long-tailed Learning with Self-Adjusting Gradient Balancercited by 17
- 2024End-to-End Neuro-Symbolic Reinforcement Learning with Textual Explanationscited by 17
- 2023LMPT: Prompt Tuning with Class-Specific Embedding Loss for Long-tailed Multi-Label Visual Recognitioncited by 15
- 2024Long-Tailed Anomaly Detection with Learnable Class Namescited by 14
- 2022Optimizing Class Distribution in Memory for Multi-Label Online Continual Learningcited by 12
- 2023CheXFusion: Effective Fusion of Multi-View Features using Transformers for Long-Tailed Chest X-Ray Classificationcited by 12
- 2023Action-slot: Visual Action-centric Representations for Multi-label Atomic Activity Recognition in Traffic Scenescited by 12
- 2024Beyond Pixels: Semi-Supervised Semantic Segmentation with a Multi-scale Patch-based Multi-Label Classifiercited by 12
- 2021GCNBoost: Artwork Classification by Label Propagation through a Knowledge Graphcited by 11
- 2021Predicate correlation learning for scene graph generationcited by 11
- 2021Training Over-parameterized Models with Non-decomposable Objectivescited by 11
- 2022RankSeg: Adaptive Pixel Classification with Image Category Ranking for Segmentationcited by 11
- 2023Toward Robustness in Multi-label Classification: A Data Augmentation Strategy against Imbalance and Noisecited by 11
- 2021PLM: Partial Label Masking for Imbalanced Multi-label Classificationcited by 10
- 2021Hierarchical Knowledge Guided Learning for Real-world Retinal Diseases Recognitioncited by 10
- 2022Facial Action Unit Recognition With Multi-models Ensemblingcited by 10
- 2022ELM: Embedding and Logit Margins for Long-Tail Learningcited by 10
- 2024On the selection and effectiveness of pseudo-absences for species distribution modeling with deep learningcited by 10
- 2025Long-tailed Recognition with Model Rebalancingcited by 10
- 2022Chairs Can be Stood on: Overcoming Object Bias in Human-Object Interaction Detectioncited by 9
- 2022MultiGuard: Provably Robust Multi-label Classification against Adversarial Examplescited by 9
- 2024CLIP-Decoder : ZeroShot Multilabel Classification using Multimodal CLIP Aligned Representationcited by 9
50 most cited of 122 All 122 (JSON)
- 2026Angular Gaussian Supervised Contrastive Learning for Long-Tailed Electrocardiogram Arrhythmia Diagnosis16 Jul 2026
- 2026AdaPCLA: Adaptive Prior-Calibrated Logit Adjustment for Long-Tailed Longitudinal EHR Generation14 Jul 2026
- 2026Rethinking Multi-Label Image Classification With Deep Learning: Taxonomy, Challenge, and Outlook1 Jul 2026
- 2026GOOSE-M2F: Adapting Mask2Former for High-Fidelity, Long-Tailed Fine-Grained Semantic Segmentation in Unstructured Outdoor Terrain14 Jun 2026
- 2026When Does Synthetic Patent Data Help? Volume-Fidelity Trade-offs in Low-Resource Multi-Label Classification22 May 2026
- 2026SearchAD: Large-Scale Rare Image Retrieval Dataset for Autonomous Driving9 Apr 2026
- 2025Unleashing the Power of Vision-Language Models for Long-Tailed Multi-Label Visual Recognition25 Nov 2025
- 2025Curiosity Meets Cooperation: A Game-Theoretic Approach to Long-Tail Multi-Label Learning20 Oct 2025
- 2025MAT-Agent: Adaptive Multi-Agent Training Optimization10 Oct 2025
- 2025Long-tailed Recognition with Model Rebalancing9 Oct 2025
- 2025Dual-View Alignment Learning with Hierarchical-Prompt for Class-Imbalance Multi-Label Classification22 Sep 2025
- 2025BAPE: Learning an Explicit Bayes Classifier for Long-tailed Visual Recognition29 Jun 2025
38 more
- 2025Any-Class Presence Likelihood for Robust Multi-Label Classification with Abundant Negative Data6 Jun 2025
- 2025CheX-DS: Improving Chest X-ray Image Classification with Ensemble Learning Based on DenseNet and Swin Transformer16 May 2025
- 2025RA-RRG: Multimodal Retrieval-Augmented Radiology Report Generation with Key Phrase Extraction10 Apr 2025
- 2025LabelCoRank: Revolutionizing Long Tail Multi-Label Classification with Co-Occurrence Reranking11 Mar 2025
- 2025Class-Independent Increment: An Efficient Approach for Multi-label Class-Incremental Learning1 Mar 2025
- 2025Making Reliable and Flexible Decisions in Long-tailed Classification23 Jan 2025
- 2024EDGE: Unknown-aware Multi-label Learning by Energy Distribution Gap Expansion10 Dec 2024
- 2024Towards Unbiased and Robust Spatio-Temporal Scene Graph Generation and Anticipation20 Nov 2024
- 2024Cross- and Intra-image Prototypical Learning for Multi-label Disease Diagnosis and Interpretation7 Nov 2024
- 2024Conformal-in-the-Loop for Learning with Imbalanced Noisy Data4 Nov 2024
- 2024MONICA: Benchmarking on Long-tailed Medical Image Classification2 Oct 2024
- 2024MAPLE: Enhancing Review Generation with Multi-Aspect Prompt LEarning in Explainable Recommendation19 Aug 2024
- 2024Category-Prompt Refined Feature Learning for Long-Tailed Multi-Label Image Classification15 Aug 2024
- 2024Text-Region Matching for Multi-Label Image Recognition with Missing Labels26 Jul 2024
- 2024Improving GBDT Performance on Imbalanced Datasets: An Empirical Study of Class-Balanced Loss Functions19 Jul 2024
- 2024Top-K Pairwise Ranking: Bridging the Gap Among Ranking-Based Measures for Multi-Label Classification9 Jul 2024
- 2024Beyond Pixels: Semi-Supervised Semantic Segmentation with a Multi-scale Patch-based Multi-Label Classifier4 Jul 2024
- 2024CLIP-Decoder : ZeroShot Multilabel Classification using Multimodal CLIP Aligned Representation21 Jun 2024
- 2024CE-SSL: Computation-Efficient Semi-Supervised Learning for ECG-based Cardiovascular Diseases Detection20 Jun 2024
- 2024Topicwise Separable Sentence Retrieval for Medical Report Generation7 May 2024
- 2024Counterfactual Reasoning for Multi-Label Image Classification via Patching-Based Training9 Apr 2024
- 2024Long-Tailed Anomaly Detection with Learnable Class Names29 Mar 2024
- 2024End-to-End Neuro-Symbolic Reinforcement Learning with Textual Explanations19 Mar 2024
- 2024LEGION: Harnessing Pre-trained Language Models for GitHub Topic Recommendations with Distribution-Balance Loss9 Mar 2024
- 2024SFC: Shared Feature Calibration in Weakly Supervised Semantic Segmentation22 Jan 2024
- 2024On the selection and effectiveness of pseudo-absences for species distribution modeling with deep learning3 Jan 2024
- 2023FoodLMM: A Versatile Food Assistant using Large Multi-modal Model22 Dec 2023
- 2023TagCLIP: A Local-to-Global Framework to Enhance Open-Vocabulary Multi-Label Classification of CLIP Without Training20 Dec 2023
- 2023Toward Robustness in Multi-label Classification: A Data Augmentation Strategy against Imbalance and Noise12 Dec 2023
- 2023Jointly spatial-temporal representation learning for individual trajectories7 Dec 2023
- 2023SEPSIS: I Can Catch Your Lies -- A New Paradigm for Deception Detection1 Dec 2023
- 2023Action-slot: Visual Action-centric Representations for Multi-label Atomic Activity Recognition in Traffic Scenes29 Nov 2023
- 2023Long-tailed multi-label classification with noisy label of thoracic diseases from chest X-ray29 Nov 2023
- 2023Scalable Label Distribution Learning for Multi-Label Classification28 Nov 2023
- 2023Long-Tailed Learning as Multi-Objective Optimization31 Oct 2023
- 2023Data Optimization in Deep Learning: A Survey25 Oct 2023
- 2023Fed-GraB: Federated Long-tailed Learning with Self-Adjusting Gradient Balancer11 Oct 2023
- 2023Heuristic Vision Pre-Training with Self-Supervised and Supervised Multi-Task Learning11 Oct 2023
50 newest of 122 All 122 (JSON)
- 2021Deep Long-Tailed Learning: A Surveycited by 416
- 2021Query2Label: A Simple Transformer Way to Multi-Label Classificationcited by 126
- 2021MetaSAug: Meta Semantic Augmentation for Long-Tailed Visual Recognitioncited by 99
- 2021ML-Decoder: Scalable and Versatile Classification Headcited by 78
- 2022A Survey on Long-Tailed Visual Recognitioncited by 75
- 2021Adaptive Methods for Real-World Domain Generalizationcited by 66
- 2021Trustworthy Long-Tailed Classificationcited by 51
- 2021Adversarial Robustness under Long-Tailed Distributioncited by 50
- 2022Large Loss Matters in Weakly Supervised Multi-Label Classificationcited by 38
- 2021VideoLT: Large-scale Long-tailed Video Recognitioncited by 35
- 2021Robust Long-Tailed Learning under Label Noisecited by 35
- 2021Balancing Methods for Multi-label Text Classification with Long-Tailed Class Distributioncited by 34
12 most cited of 119 All 119 (JSON)
- 2026Angular Gaussian Supervised Contrastive Learning for Long-Tailed Electrocardiogram Arrhythmia Diagnosis16 Jul 2026
- 2026AdaPCLA: Adaptive Prior-Calibrated Logit Adjustment for Long-Tailed Longitudinal EHR Generation14 Jul 2026
- 2026Rethinking Multi-Label Image Classification With Deep Learning: Taxonomy, Challenge, and Outlook1 Jul 2026
- 2026GOOSE-M2F: Adapting Mask2Former for High-Fidelity, Long-Tailed Fine-Grained Semantic Segmentation in Unstructured Outdoor Terrain14 Jun 2026
- 2026When Does Synthetic Patent Data Help? Volume-Fidelity Trade-offs in Low-Resource Multi-Label Classification22 May 2026
- 2026SearchAD: Large-Scale Rare Image Retrieval Dataset for Autonomous Driving9 Apr 2026
- 2025Curiosity Meets Cooperation: A Game-Theoretic Approach to Long-Tail Multi-Label Learning20 Oct 2025
- 2025MAT-Agent: Adaptive Multi-Agent Training Optimization10 Oct 2025
- 2025Long-tailed Recognition with Model Rebalancing9 Oct 2025
- 2025Dual-View Alignment Learning with Hierarchical-Prompt for Class-Imbalance Multi-Label Classification22 Sep 2025
- 2025BAPE: Learning an Explicit Bayes Classifier for Long-tailed Visual Recognition29 Jun 2025
- 2025Any-Class Presence Likelihood for Robust Multi-Label Classification with Abundant Negative Data6 Jun 2025
12 newest of 119 All 119 (JSON)