mlsanityData to 14 Oct 2026

Optimizing Audio Augmentations for Contrastive Learning of Health-Related Acoustic Signals

arXiv 2309.05843 ↗First posted 11 Sep 2023cs.LG cs.SD eess.AScited by 2

Not on the map. Why?

Abstract (arXiv)

Health-related acoustic signals, such as cough and breathing sounds, are relevant for medical diagnosis and continuous health monitoring. Most existing machine learning approaches for health acoustics are trained and evaluated on specific tasks, limiting their generalizability across various healthcare applications. In this paper, we leverage a self-supervised learning framework, SimCLR with a Slowfast NFNet backbone, for contrastive learning of health acoustics. A crucial aspect of optimizing Slowfast NFNet for this application lies in identifying effective audio augmentations. We conduct an in-depth analysis of various audio augmentation strategies and demonstrate that an appropriate augmentation strategy enhances the performance of the Slowfast NFNet audio encoder across a diverse set of health acoustic tasks. Our findings reveal that when augmentations are combined, they can produce synergistic effects that exceed the benefits seen when each is applied individually.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 25 of its 41 references that are in the map. First posted on arXiv 11 Sep 2023.

Builds on

25 of 41 references.

References · 25

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  4. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
  5. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,287
  6. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
  7. 2020Spatiotemporal Contrastive Video Representation Learningcited by 372
  8. 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 342
  9. 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 312
  10. 2021BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representationcited by 106
  11. 2020Towards Learning a Universal Non-Semantic Representation of Speechcited by 84
  12. 2022Robust Self-Supervised Audio-Visual Speech Recognitioncited by 75
13 more
  1. 2020The COUGHVID crowdsourcing dataset: A corpus for the study of large-scale cough analysis algorithmscited by 59
  2. 2021Towards Learning Universal Audio Representationscited by 51
  3. 2017Unsupervised Learning of Semantic Audio Representationscited by 44
  4. 2022SimPer: Simple Self-Supervised Learning of Periodic Targetscited by 44
  5. 2020Speech SIMCLR: Combining Contrastive and Reconstruction Objective for Self-supervised Speech Representation Learningcited by 34
  6. 2020Unsupervised Contrastive Learning of Sound Event Representationscited by 32
  7. 2021Universal Paralinguistic Speech Representations Using Self-Supervised Conformerscited by 32
  8. 2020CLAR: Contrastive Learning of Auditory Representationscited by 31
  9. 2023Coswara: A respiratory sounds and symptoms dataset for remote screening of SARS-CoV-2 infectioncited by 22
  10. 2021Automatic Cough Classification for Tuberculosis Screening in a Real-World Environmentcited by 17
  11. 2020FRILL: A Non-Semantic Speech Embedding for Mobile Devicescited by 13
  12. 2021Self-Supervised Learning from Automatically Separated Sound Scenescited by 6
  13. 2023Predicting Cardiovascular Disease Risk using Photoplethysmography and Deep Learningcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.