mlsanityData to 14 Oct 2026

Towards Realistic Long-tailed Semi-supervised Learning in an Open World

arXiv 2405.14516 ↗First posted 23 May 2024cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Open-world long-tailed semi-supervised learning (OLSSL) has increasingly attracted attention. However, existing OLSSL algorithms generally assume that the distributions between known and novel categories are nearly identical. Against this backdrop, we construct a more Realistic Open-world Long-tailed Semi-supervised Learning (ROLSSL) setting where there is no premise on the distribution relationships between known and novel categories. Furthermore, even within the known categories, the number of labeled samples is significantly smaller than that of the unlabeled samples, as acquiring valid annotations is often prohibitively costly in the real world. Under the proposed ROLSSL setting, we propose a simple yet potentially effective solution called dual-stage post-hoc logit adjustments. The proposed approach revisits the logit adjustment strategy by considering the relationships among the frequency of samples, the total number of categories, and the overall size of data. Then, it estimates the distribution of unlabeled data for both known and novel categories to dynamically readjust the corresponding predictive probabilities, effectively mitigating category bias during the learning of known and novel classes with more selective utilization of imbalanced unlabeled data. Extensive experiments on datasets such as CIFAR100 and ImageNet100 have demonstrated performance improvements of up to 50.1%, validating the superiority of our proposed method and establishing a strong baseline for this task. For further researches, the anonymous link to the experimental code is at hrefhttps://github.com/heyuanpengpku/ROLSSLtextcolorbrightpinkhttps://github.com/heyuanpengpku/ROLSSL

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 45 references that are in the map. First posted on arXiv 23 May 2024.

Builds on

29 of 45 references.

References · 29

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  3. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
  4. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
  5. 2020Long-tail learning via logit adjustmentcited by 618
  6. 2019Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learningcited by 510
  7. 2020Balanced Meta-Softmax for Long-Tailed Visual Recognitioncited by 400
  8. 2019Learning to Discover Novel Visual Categories via Deep Transfer Clusteringcited by 225
  9. 2021CReST: A Class-Rebalancing Self-Training Framework for Imbalanced Semi-Supervised Learningcited by 175
  10. 2021Open-World Semi-Supervised Learningcited by 165
  11. 2021A Unified Objective for Novel Class Discoverycited by 162
  12. 2020Automatically Discovering and Learning New Visual Categories with Ranking Statisticscited by 143
17 more
  1. 2017Learning to cluster in order to transfer across domains and taskscited by 128
  2. 2021Neighborhood Contrastive Learning for Novel Class Discoverycited by 121
  3. 2022SimMatch: Semi-supervised Learning with Similarity Matchingcited by 118
  4. 2020Distribution Aligning Refinery of Pseudo-label for Imbalanced Semi-supervised Learningcited by 105
  5. 2020Conditional Gaussian Distribution Learning for Open Set Recognitioncited by 104
  6. 2021Novel Visual Category Discovery with Dual Ranking Statistics and Mutual Knowledge Distillationcited by 104
  7. 2021ABC: Auxiliary Balanced Classifier for Class-imbalanced Semi-supervised Learningcited by 65
  8. 2021DASO: Distribution-Aware Semantics-Oriented Pseudo-label for Imbalanced Semi-Supervised Learningcited by 51
  9. 2022Semi-supervised Vision Transformers at Scalecited by 49
  10. 2021CoSSL: Co-Learning of Representation and Classifier for Imbalanced Semi-Supervised Learningcited by 41
  11. 2022OpenLDN: Learning to Discover Novel Classes for Open-World Semi-Supervised Learningcited by 37
  12. 2022OpenCon: Open-world Contrastive Learningcited by 33
  13. 2023A Unified Perspective for Loss-Oriented Imbalanced Learning via Localizationcited by 24
  14. 2023Novel Class Discovery for Long-tailed Recognitioncited by 19
  15. 2023Three Heads Are Better Than One: Complementary Experts for Long-Tailed Semi-supervised Learningcited by 13
  16. 2023Towards Distribution-Agnostic Generalized Category Discoverycited by 12
  17. 2024Semi-supervised Open-World Object Detectioncited by 10

Built on by

Not cited yet.