mlsanityData to 7 Oct 2026

CPPF: A contextual and post-processing-free model for automatic speech recognition

arXiv 2309.07413 ↗First posted 14 Sep 2023cs.CL cs.SD eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

ASR systems have become increasingly widespread in recent years. However, their textual outputs often require post-processing tasks before they can be practically utilized. To address this issue, we draw inspiration from the multifaceted capabilities of LLMs and Whisper, and focus on integrating multiple ASR text processing tasks related to speech recognition into the ASR model. This integration not only shortens the multi-stage pipeline, but also prevents the propagation of cascading errors, resulting in direct generation of post-processed text. In this study, we focus on ASR-related processing tasks, including Contextual ASR and multiple ASR post processing tasks. To achieve this objective, we introduce the CPPF model, which offers a versatile and highly effective alternative to ASR processing. CPPF seamlessly integrates these tasks without any significant loss in recognition performance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 27 references that are in the map. First posted on arXiv 14 Sep 2023.

Builds on

23 of 27 references.

References · 23

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  7. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  8. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  9. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  10. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  11. 2018Deep context: end-to-end contextual speech recognitioncited by 136
  12. 2018AISHELL-2: Transforming Mandarin ASR Research Into Industrial Scalecited by 125
11 more
  1. 2021WeNet: Production oriented Streaming and Non-streaming End-to-End Speech Recognition Toolkitcited by 123
  2. 2020Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameterscited by 110
  3. 2019UER: An Open-Source Toolkit for Pre-training Modelscited by 61
  4. 2020End-to-end Named Entity Recognition from English Speechcited by 36
  5. 2021The Stem Cell Hypothesis: Dilemma behind Multi-Task Learning with Transformer Encoderscited by 31
  6. 2023SpeechPrompt v2: Prompt Tuning for Speech Classification Taskscited by 31
  7. 2022WAVPROMPT: Towards Few-Shot Spoken Language Understanding with Frozen Language Modelscited by 25
  8. 2022AISHELL-NER: Named Entity Recognition from Chinese Speechcited by 19
  9. 2022SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Taskscited by 19
  10. 2019PKUSEG: A Toolkit for Multi-Domain Chinese Word Segmentationcited by 17
  11. 2023Improved Training for End-to-End Streaming Automatic Speech Recognition Model with Punctuationcited by 3

Built on by

Not cited yet.