SpliceOut: A Simple and Efficient Audio Augmentation Method
Not on the map. Why?
Abstract (arXiv)
Time masking has become a de facto augmentation technique for speech and audio tasks, including automatic speech recognition (ASR) and audio classification, most notably as a part of SpecAugment. In this work, we propose SpliceOut, a simple modification to time masking which makes it computationally more efficient. SpliceOut performs comparably to (and sometimes outperforms) SpecAugment on a wide variety of speech and audio tasks, including ASR for seven different languages using varying amounts of training data, as well as on speech translation, sound and music classification, thus establishing itself as a broadly applicable audio augmentation method. SpliceOut also provides additional gains when used in conjunction with other augmentation techniques. Apart from the fully-supervised setting, we also demonstrate that SpliceOut can complement unsupervised representation learning with performance gains in the semi-supervised and self-supervised settings.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 50 of its 84 references that are in the map. First posted on arXiv 30 Sep 2021.
Builds on
50 of 84 references.
References · 50
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
38 more
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2020Supervised Contrastive Learningcited by 2,803
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
- 2017Random Erasing Data Augmentationcited by 1,235
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
- 2018Speech Commands: A Dataset for Limited-Vocabulary Speech Recognitioncited by 741
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
- 2017The Effectiveness of Data Augmentation in Image Classification using Deep Learningcited by 368
- 2014Deep Speech: Scaling up end-to-end speech recognitioncited by 354
- 2015MADE: Masked Autoencoder for Distribution Estimationcited by 306
- 2018DropBlock: A regularization method for convolutional networkscited by 261
- 2017Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approachcited by 201
- 2018Contextual Augmentation: Data Augmentation by Words with Paradigmatic Relationscited by 201
- 2015A Theoretically Grounded Application of Dropout in Recurrent Neural Networkscited by 161
- 2020Recent Developments on ESPnet Toolkit Boosted by Conformercited by 132
- 2020Enabling Language Models to Fill in the Blankscited by 121
- 2020ESPnet-ST: All-in-One Speech Translation Toolkitcited by 82
- 2018Sequence-to-Sequence Data Augmentation for Dialogue Language Understandingcited by 67
- 2017Listening while Speaking: Speech Chain by Deep Learningcited by 46
- 2021MixSpeech: Data Augmentation for Low-resource Automatic Speech Recognitioncited by 38
- 2021AutoDropout: Learning Dropout Patterns to Regularize Deep Networkscited by 35
- 2018Augmenting Librispeech with French Translations: A Multimodal Corpus for Direct Speech Translation Evaluationcited by 34
- 2020Unsupervised Contrastive Learning of Sound Event Representationscited by 32
- 2020CLAR: Contrastive Learning of Auditory Representationscited by 31
- 2019Learning Sound Event Classifiers from Web Audio with Noisy Labelscited by 22
- 2019Semantic Mask for Transformer based End-to-End Speech Recognitioncited by 18
- 2021Self-Supervised Learning of Audio Representations from Permutations with Differentiable Rankingcited by 14
- 2021SpecAugment++: A Hidden Space Data Augmentation Method for Acoustic Scene Classificationcited by 12
- 2021DeepSpectrumLite: A Power-Efficient Transfer Learning Framework for Embedded Speech and Audio Processing from Decentralised Datacited by 12
- 2020SapAugment: Learning A Sample Adaptive Policy for Data Augmentationcited by 9
- 2020Learning with Out-of-Distribution Data for Audio Classificationcited by 5
Built on by
Citing papers per year: 2022: 3; 2023: 3; 2024: 0; 2025: 1.
7 papers.
- 2022Towards End-to-End Integration of Dialog History for Improved Spoken Language Understandingcited by 8
- 2023AudRandAug: Random Image Augmentations for Audio Classificationcited by 3
- 2022Automatic Speech Recognition for Speech Assessment of Persian Preschool Childrencited by 2
- 2022Improving Generalization of Deep Neural Network Acoustic Models with Length Perturbation and N-best Based Label Smoothingcited by 2
- 2025Regularizing Learnable Feature Extraction for Automatic Speech Recognitioncited by 1
- 2023Automated speech- and text-based classification of neuropsychiatric conditions in a multidiagnostic settingcited by 0
- 2023A Semi-Supervised Deep Learning Approach to Dataset Collection for Query-By-Humming Taskcited by 0
- 2025Regularizing Learnable Feature Extraction for Automatic Speech Recognition11 Jun 2025
- 2023A Semi-Supervised Deep Learning Approach to Dataset Collection for Query-By-Humming Task2 Dec 2023
- 2023AudRandAug: Random Image Augmentations for Audio Classification9 Sep 2023
- 2023Automated speech- and text-based classification of neuropsychiatric conditions in a multidiagnostic setting13 Jan 2023
- 2022Towards End-to-End Integration of Dialog History for Improved Spoken Language Understanding11 Apr 2022
- 2022Improving Generalization of Deep Neural Network Acoustic Models with Length Perturbation and N-best Based Label Smoothing29 Mar 2022
- 2022Automatic Speech Recognition for Speech Assessment of Persian Preschool Children24 Mar 2022