ViRN: Variational Inference and Distribution Trilateration for Long-Tailed Continual Representation Learning
Not on the map. Why?
Abstract (arXiv)
Continual learning (CL) with long-tailed data distributions remains a critical challenge for real-world AI systems, where models must sequentially adapt to new classes while retaining knowledge of old ones, despite severe class imbalance. Existing methods struggle to balance stability and plasticity, often collapsing under extreme sample scarcity. To address this, we propose ViRN, a novel CL framework that integrates variational inference (VI) with distributional trilateration for robust long-tailed learning. First, we model class-conditional distributions via a Variational Autoencoder to mitigate bias toward head classes. Second, we reconstruct tail-class distributions via Wasserstein distance-based neighborhood retrieval and geometric fusion, enabling sample-efficient alignment of tail-class representations. Evaluated on six long-tailed classification benchmarks, including speech (e.g., rare acoustic events, accents) and image tasks, ViRN achieves a 10.24% average accuracy gain over state-of-the-art methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 33 references that are in the map. First posted on arXiv 23 Jul 2025.
Builds on
24 of 33 references.
References · 24
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2016Learning without Forgettingcited by 2,496
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
- 2021Learning to Prompt for Continual Learningcited by 944
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
12 more
- 2018Speech Commands: A Dataset for Limited-Vocabulary Speech Recognitioncited by 752
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
- 2017Lifelong Learning with Dynamically Expandable Networkscited by 694
- 2023SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Modelcited by 180
- 2024Continual Learning with Pre-Trained Models: A Surveycited by 154
- 2023A Unified Continual Learning Framework with General Parameter-Efficient Tuningcited by 125
- 2020Deep Representation Learning on Long-tailed Data: A Learnable Embedding Augmentation Perspectivecited by 120
- 2022Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learningcited by 118
- 2018AudioMNIST: Exploring Explainable Artificial Intelligence for Audio Analysis on a Simple Benchmarkcited by 72
- 2023Long-Tail Learning with Foundation Model: Heavy Fine-Tuning Hurtscited by 58
- 2024Gradient Reweighting: Towards Imbalanced Class-Incremental Learningcited by 37
- 2022Modeling Inter-Class and Intra-Class Constraints in Novel Class Discoverycited by 26
Built on by
Not cited yet.