mlsanityData to 7 Oct 2026

SPGISpeech: 5,000 hours of transcribed financial audio for fully formatted end-to-end speech recognition

arXiv 2104.02014 ↗First posted 5 Apr 2021cs.CL eess.AScited by 77

Not on the map. Why?

Abstract (arXiv)

In the English speech-to-text (STT) machine learning task, acoustic models are conventionally trained on uncased Latin characters, and any necessary orthography (such as capitalization, punctuation, and denormalization of non-standard words) is imputed by separate post-processing models. This adds complexity and limits performance, as many formatting tasks benefit from semantic information present in the acoustic signal but absent in transcription. Here we propose a new STT task: end-to-end neural transcription with fully formatted text for target labels. We present baseline Conformer-based models trained on a corpus of 5,000 hours of professionally transcribed earnings calls, achieving a CER of 1.7. As a contribution to the STT research community, we release the corpus free for non-commercial use at https://datasets.kensho.com/datasets/scribe.

Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). Builds on 12 of its 34 references that are in the map. First posted on arXiv 5 Apr 2021.

Builds on

12 of 34 references.

References · 12

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  4. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  5. 2019NeMo: a toolkit for building AI applications using Neural Modulescited by 230
  6. 2018TED-LIUM 3: twice as much data and corpus repartition for experiments on speaker adaptationcited by 224
  7. 2019Correction of Automatic Speech Recognition with Transformer Sequence-to-sequence Modelcited by 52
  8. 2016RNN Approaches to Text Normalization: A Challengecited by 30
  9. 2021NoiseQA: Challenge Set Evaluation for User-Centric Question Answeringcited by 25
  10. 2021Neural Inverse Text Normalizationcited by 19
  11. 2019Fast and Accurate Capitalization and Punctuation for Automatic Speech Recognition Using Transformer and Chunk Mergingcited by 14
  12. 2020Cross-Language Transfer Learning, Continuous Learning, and Domain Adaptation for End-to-End Automatic Speech Recognitioncited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 6; 2022: 4; 2023: 9; 2024: 12; 2025: 22; 2026: 24.

77 papers.

Sort:

By area:

  1. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
  2. 2023Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labellingcited by 87
  3. 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformercited by 74
  4. 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 62
  5. 2023Prompting Large Language Models for Zero-Shot Domain Adaptation in Speech Recognitioncited by 48
  6. 2022Earnings-22: A Practical Benchmark for Accents in the Wildcited by 46
  7. 2023Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Datacited by 42
  8. 2023Exploring Speech Recognition, Translation, and Understanding with Discrete Speech Units: A Comparative Studycited by 42
  9. 2025Voxtralcited by 41
  10. 2024OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identificationcited by 34
  11. 2025OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaningcited by 27
  12. 2025InteractiveOmni: A Unified Omni-modal Model for Audio-Visual Multi-turn Dialoguecited by 27
38 more
  1. 2025Streaming Sequence-to-Sequence Learning with Delayed Streams Modelingcited by 24
  2. 2025Open ASR Leaderboard: Towards Reproducible and Transparent Multilingual and Long-Form Speech Recognition Evaluationcited by 21
  3. 2025M2-omni: Advancing Omni-MLLM for Comprehensive Modality Support with Competitive Performancecited by 19
  4. 2022ESB: A Benchmark For Multi-Domain End-to-End Speech Recognitioncited by 18
  5. 2022A Study on the Integration of Pre-trained SSL, ASR, LM and SLU Models for Spoken Language Understandingcited by 18
  6. 2021Scaling ASR Improves Zero and Few Shot Learningcited by 15
  7. 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representationcited by 15
  8. 2026Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Musiccited by 15
  9. 2025ContextASR-Bench: A Massive Contextual Speech Recognition Benchmarkcited by 14
  10. 2024MOSEL: 950,000 Hours of Speech Data for Open-Source Speech Foundation Model Training on EU Languagescited by 13
  11. 2025Nexus: An Omni-Perceptive And -Interactive Model for Language, Audio, And Visioncited by 12
  12. 2024Improving Neural Biasing for Contextual Speech Recognition by Early Context Injection and Text Perturbationcited by 11
  13. 2024On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Modelscited by 10
  14. 2024Failing Forward: Improving Generative Error Correction for ASR with Synthetic Data and Retrieval Augmentationcited by 9
  15. 2025From TOWER to SPIRE: Adding the Speech Modality to a Translation-Specialist LLMcited by 7
  16. 2025NGPU-LM: GPU-Accelerated N-Gram Language Model for Context-Biasing in Greedy ASR Decodingcited by 7
  17. 2024VoiceTextBlender: Augmenting Large Language Models with Speech Capabilities via Single-Stage Joint Speech-Text Supervised Fine-Tuningcited by 6
  18. 2025DrVoice: Parallel Speech-Text Voice Conversation Model via Dual-Resolution Speech Representationscited by 6
  19. 2021A Toolbox for Construction and Analysis of Speech Datasetscited by 5
  20. 2021Joint prediction of truecasing and punctuation for conversational speech in low-resource scenarioscited by 5
  21. 2023Text-only Domain Adaptation using Unified Speech-Text Representation in Transducercited by 5
  22. 2024Exploring the limits of decoder-only models trained on public speech recognition corporacited by 5
  23. 2024Discrete Multimodal Transformers with a Pretrained Large Language Model for Mixed-Supervision Speech Processingcited by 5
  24. 2025BERSting at the Screams: A Benchmark for Distanced, Emotional and Shouted Speech Recognitioncited by 5
  25. 2025Edge-ASR: Towards Low-Bit Quantization of Automatic Speech Recognition Modelscited by 5
  26. 2025SPGISpeech 2.0: Transcribed multi-speaker financial audio for speaker-tagged transcriptioncited by 5
  27. 2026Voxtral Realtimecited by 5
  28. 2023SpellMapper: A non-autoregressive neural spellchecker for ASR customization with candidate retrieval based on n-gram mappingscited by 4
  29. 2024Longer is (Not Necessarily) Stronger: Punctuated Long-Sequence Training for Enhanced Speech Recognition and Translationcited by 4
  30. 2025Pushing the Limits of Beam Search Decoding for Transducer-based ASR modelscited by 4
  31. 2021IMS' Systems for the IWSLT 2021 Low-Resource Speech Translation Taskcited by 3
  32. 2024Resolving Transcription Ambiguity in Spanish: A Hybrid Acoustic-Lexical System for Punctuation Restorationcited by 2
  33. 2025FinAudio: A Benchmark for Audio Large Language Models in Financial Applicationscited by 2
  34. 2026Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perceptioncited by 2
  35. 2026MedMosaic: A Challenging Large Scale Benchmark of Diverse Medical Audiocited by 2
  36. 2026Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videoscited by 2
  37. 2021Scalable Data Annotation Pipeline for High-Quality Large Speech Datasets Developmentcited by 1
  38. 2022ASR in German: A Detailed Error Analysiscited by 1

50 most cited of 77 All 77 (JSON)