mlsanityData to 7 Oct 2026

Topic Model Robustness to Automatic Speech Recognition Errors in Podcast Transcripts

arXiv 2109.12306 ↗First posted 25 Sep 2021cs.IR cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

For a multilingual podcast streaming service, it is critical to be able to deliver relevant content to all users independent of language. Podcast content relevance is conventionally determined using various metadata sources. However, with the increasing quality of speech recognition in many languages, utilizing automatic transcriptions to provide better content recommendations becomes possible. In this work, we explore the robustness of a Latent Dirichlet Allocation topic model when applied to transcripts created by an automatic speech recognition engine. Specifically, we explore how increasing transcription noise influences topics obtained from transcriptions in Danish; a low resource language. First, we observe a baseline of cosine similarity scores between topic embeddings from automatic transcriptions and the descriptions of the podcasts written by the podcast creators. We then observe how the cosine similarities decrease as transcription noise increases and conclude that even when automatic speech recognition transcripts are erroneous, it is still possible to obtain high-quality topic embeddings from the transcriptions.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 35 references that are in the map. First posted on arXiv 25 Sep 2021.

Builds on

16 of 35 references.

References · 16

  1. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  2. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  3. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  4. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  5. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
  6. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 462
  7. 2017Synthetic and Natural Noise Both Break Neural Machine Translationcited by 304
  8. 2020Pushing the Limits of Semi-Supervised Learning for Automatic Speech Recognitioncited by 185
  9. 2020Improved Noisy Student Training for Automatic Speech Recognitioncited by 139
  10. 2013Probabilistic Latent Semantic Analysiscited by 63
  11. 2014First-Pass Large Vocabulary Continuous Speech Recognition using Bi-Directional Recurrent DNNscited by 27
  12. 2020The Danish Gigaword Projectcited by 17
4 more
  1. 2014How Many Topics? Stability Analysis for Topic Modelscited by 16
  2. 2021An Approach to Improve Robustness of NLP Systems against ASR Errorscited by 8
  3. 2021Current Challenges and Future Directions in Podcast Information Accesscited by 7
  4. 2015Topic Stability over Noisy Sourcescited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.