Augmented Contrastive Self-Supervised Learning for Audio Invariant Representations
Not on the map. Why?
Abstract (arXiv)
Improving generalization is a major challenge in audio classification due to labeled data scarcity. Self-supervised learning (SSL) methods tackle this by leveraging unlabeled data to learn useful features for downstream classification tasks. In this work, we propose an augmented contrastive SSL framework to learn invariant representations from unlabeled data. Our method applies various perturbations to the unlabeled input data and utilizes contrastive learning to learn representations robust to such perturbations. Experimental results on the Audioset and DESED datasets show that our framework significantly outperforms state-of-the-art SSL and supervised learning methods on sound/event classification tasks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 17 references that are in the map. First posted on arXiv 21 Dec 2021.
Builds on
14 of 17 references.
References · 14
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
- 2020Contrastive Learning of General-Purpose Audio Representationscited by 168
- 2020Multi-task self-supervised learning for Robust Speech Recognitioncited by 127
- 2021BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representationcited by 106
- 2017Unsupervised Learning of Semantic Audio Representationscited by 44
2 more
- 2021Interspeech 2021 Deep Noise Suppression Challengecited by 43
- 2020Unsupervised Contrastive Learning of Sound Event Representationscited by 32
Built on by
Citing papers per year: 2022: 1.
1 paper.