mlsanityData to 7 Oct 2026

SpliceOut: A Simple and Efficient Audio Augmentation Method

arXiv 2110.00046 ↗First posted 30 Sep 2021cs.SD cs.AI cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

Time masking has become a de facto augmentation technique for speech and audio tasks, including automatic speech recognition (ASR) and audio classification, most notably as a part of SpecAugment. In this work, we propose SpliceOut, a simple modification to time masking which makes it computationally more efficient. SpliceOut performs comparably to (and sometimes outperforms) SpecAugment on a wide variety of speech and audio tasks, including ASR for seven different languages using varying amounts of training data, as well as on speech translation, sound and music classification, thus establishing itself as a broadly applicable audio augmentation method. SpliceOut also provides additional gains when used in conjunction with other augmentation techniques. Apart from the fully-supervised setting, we also demonstrate that SpliceOut can complement unsupervised representation learning with performance gains in the semi-supervised and self-supervised settings.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 50 of its 84 references that are in the map. First posted on arXiv 30 Sep 2021.

Builds on

50 of 84 references.

References · 50

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  7. 2016Densely Connected Convolutional Networkscited by 6,691
  8. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  9. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  10. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  11. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  12. 2020Exploring Simple Siamese Representation Learningcited by 2,853
38 more
  1. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  2. 2020Supervised Contrastive Learningcited by 2,803
  3. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
  4. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  5. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  6. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
  7. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  8. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  9. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
  10. 2017Random Erasing Data Augmentationcited by 1,235
  11. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
  12. 2018Speech Commands: A Dataset for Limited-Vocabulary Speech Recognitioncited by 741
  13. 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
  14. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
  15. 2017The Effectiveness of Data Augmentation in Image Classification using Deep Learningcited by 368
  16. 2014Deep Speech: Scaling up end-to-end speech recognitioncited by 354
  17. 2015MADE: Masked Autoencoder for Distribution Estimationcited by 306
  18. 2018DropBlock: A regularization method for convolutional networkscited by 261
  19. 2017Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approachcited by 201
  20. 2018Contextual Augmentation: Data Augmentation by Words with Paradigmatic Relationscited by 201
  21. 2015A Theoretically Grounded Application of Dropout in Recurrent Neural Networkscited by 161
  22. 2020Recent Developments on ESPnet Toolkit Boosted by Conformercited by 132
  23. 2020Enabling Language Models to Fill in the Blankscited by 121
  24. 2020ESPnet-ST: All-in-One Speech Translation Toolkitcited by 82
  25. 2018Sequence-to-Sequence Data Augmentation for Dialogue Language Understandingcited by 67
  26. 2017Listening while Speaking: Speech Chain by Deep Learningcited by 46
  27. 2021MixSpeech: Data Augmentation for Low-resource Automatic Speech Recognitioncited by 38
  28. 2021AutoDropout: Learning Dropout Patterns to Regularize Deep Networkscited by 35
  29. 2018Augmenting Librispeech with French Translations: A Multimodal Corpus for Direct Speech Translation Evaluationcited by 34
  30. 2020Unsupervised Contrastive Learning of Sound Event Representationscited by 32
  31. 2020CLAR: Contrastive Learning of Auditory Representationscited by 31
  32. 2019Learning Sound Event Classifiers from Web Audio with Noisy Labelscited by 22
  33. 2019Semantic Mask for Transformer based End-to-End Speech Recognitioncited by 18
  34. 2021Self-Supervised Learning of Audio Representations from Permutations with Differentiable Rankingcited by 14
  35. 2021SpecAugment++: A Hidden Space Data Augmentation Method for Acoustic Scene Classificationcited by 12
  36. 2021DeepSpectrumLite: A Power-Efficient Transfer Learning Framework for Embedded Speech and Audio Processing from Decentralised Datacited by 12
  37. 2020SapAugment: Learning A Sample Adaptive Policy for Data Augmentationcited by 9
  38. 2020Learning with Out-of-Distribution Data for Audio Classificationcited by 5

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 3; 2024: 0; 2025: 1.

7 papers.