A Sequential Self Teaching Approach for Improving Generalization in Sound Event Recognition
Not on the map. Why?
Abstract (arXiv)
An important problem in machine auditory perception is to recognize and detect sound events. In this paper, we propose a sequential self-teaching approach to learning sounds. Our main proposition is that it is harder to learn sounds in adverse situations such as from weakly labeled and/or noisy labeled data, and in these situations a single stage of learning is not sufficient. Our proposal is a sequential stage-wise learning process that improves generalization capabilities of a given modeling system. We justify this method via technical results and on Audioset, the largest sound events dataset, our sequential learning approach can lead to up to 9% improvement in performance. A comprehensive evaluation also shows that the method leads to improved transferability of knowledge from previously trained models, thereby leading to improved generalization capabilities on transfer learning tasks.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 3; 2023: 1.
12 papers.
- 2021AudioCLIP: Extending CLIP to Image, Text and Audiocited by 339
- 2021Conformer-Based Self-Supervised Learning for Non-Speech Audio Taskscited by 22
- 2021Environmental Sound Classification on the Edge: A Pipeline for Deep Acoustic Networks on Extremely Resource-Constrained Devicescited by 5
- 2021Pruning vs XNOR-Net: A Comprehensive Study of Deep Learning for Audio Classification on Edge-devicescited by 3
- 2022Effective Audio Classification Network Based on Paired Inverse Pyramid Structure and Dense MLP Blockcited by 3
- 2021Do sound event representations generalize to other audio tasks? A case study in audio transfer learningcited by 1
- 2021Study of positional encoding approaches for Audio Spectrogram Transformerscited by 1
- 2023CORN: Co-Trained Full- And No-Reference Speech Quality Assessmentcited by 1
- 2021Conditional Teaching Sizecited by 0
- 2021Responding to Challenge Call of Machine Learning Model Development in Diagnosing Respiratory Disease Soundscited by 0
- 2022Maximizing Audio Event Detection Model Performance on Small Datasets Through Knowledge Transfer, Data Augmentation, And Pretraining: An Ablation Studycited by 0
- 2022CCATMos: Convolutional Context-aware Transformer Network for Non-intrusive Speech Quality Assessmentcited by 0
- 2023CORN: Co-Trained Full- And No-Reference Speech Quality Assessment13 Oct 2023
- 2022Effective Audio Classification Network Based on Paired Inverse Pyramid Structure and Dense MLP Block5 Nov 2022
- 2022CCATMos: Convolutional Context-aware Transformer Network for Non-intrusive Speech Quality Assessment4 Nov 2022
- 2022Maximizing Audio Event Detection Model Performance on Small Datasets Through Knowledge Transfer, Data Augmentation, And Pretraining: An Ablation Study7 Feb 2022
- 2021Responding to Challenge Call of Machine Learning Model Development in Diagnosing Respiratory Disease Sounds29 Nov 2021
- 2021Conformer-Based Self-Supervised Learning for Non-Speech Audio Tasks14 Oct 2021
- 2021Study of positional encoding approaches for Audio Spectrogram Transformers13 Oct 2021
- 2021Pruning vs XNOR-Net: A Comprehensive Study of Deep Learning for Audio Classification on Edge-devices13 Aug 2021
- 2021Conditional Teaching Size29 Jun 2021
- 2021AudioCLIP: Extending CLIP to Image, Text and Audio24 Jun 2021
- 2021Do sound event representations generalize to other audio tasks? A case study in audio transfer learning21 Jun 2021
- 2021Environmental Sound Classification on the Edge: A Pipeline for Deep Acoustic Networks on Extremely Resource-Constrained Devices5 Mar 2021