Wav2Letter: an End-to-End ConvNet-based Speech Recognition System
Not on the map. Why?
Abstract (arXiv)
This paper presents a simple end-to-end model for speech recognition, combining a convolutional network based acoustic model and a graph decoding. It is trained to output letters, with transcribed speech, without the need for force alignment of phonemes. We introduce an automatic segmentation criterion for training from sequence annotation without alignment that is on par with CTC while being simpler. We show competitive results in word error rate on the Librispeech corpus with MFCC features, and promising results from raw waveform.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 12; 2023: 9; 2024: 2.
43 papers.
Sort:
By area:
- 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
- 2023Scaling Speech Technology to 1,000+ Languagescited by 401
- 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 138
- 2021CrypTen: Secure Multi-Party Computation Meets Machine Learningcited by 131
- 2023End-to-End Speech Recognition: A Surveycited by 127
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2021Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognitioncited by 68
- 2024YODAS: Youtube-Oriented Dataset for Audio and Speechcited by 56
- 2021Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognitioncited by 42
- 2021Why does CTC result in peaky behavior?cited by 32
- 2022Wav2Seq: Pre-training Speech-to-Text Encoder-Decoder Models Using Pseudo Languagescited by 26
- 2022ASR2K: Speech Recognition for Around 2000 Languages without Audiocited by 26
31 more
- 2022Flashlight: Enabling Innovation in Tools for Machine Learningcited by 25
- 2023Audio-Visual Efficient Conformer for Robust Speech Recognitioncited by 22
- 2021Kaizen: Continuously improving teacher using Exponential Moving Average for semi-supervised speech recognitioncited by 21
- 2021An Improved Model for Voicing Silent Speechcited by 15
- 2021Inductive biases, pretraining and fine-tuning jointly account for brain responses to speechcited by 14
- 2021High Fidelity Speech Regeneration with Application to Speech Enhancementcited by 10
- 2022Star Temporal Classification: Sequence Classification with Partially Labeled Datacited by 10
- 2022Global Normalization for Streaming Speech Recognition in a Modular Frameworkcited by 10
- 2021ATCSpeechNet: A multilingual end-to-end speech recognition framework for air traffic control systemscited by 6
- 2023Improving Medical Speech-to-Text Accuracy with Vision-Language Pre-training Modelcited by 6
- 2021A Toolbox for Construction and Analysis of Speech Datasetscited by 5
- 2021Unsupervised Automatic Speech Recognition: A Reviewcited by 5
- 2021SoK: A Modularized Approach to Study the Security of Automatic Speech Recognition Systemscited by 4
- 2021Sequence Transduction with Graph-based Supervisioncited by 4
- 2022And what if two musical versions don't share melody, harmony, rhythm, or lyrics ?cited by 3
- 2021BCN2BRNO: ASR System Fusion for Albayzin 2020 Speech to Text Challengecited by 2
- 2021Improving Character Error Rate Is Not Equal to Having Clean Speech: Speech Enhancement for ASR Systems with Black-box Acoustic Modelscited by 2
- 2023Align With Purpose: Optimize Desired Properties in CTC Models with a General Plug-and-Play Frameworkcited by 2
- 2023A Quantitative Approach to Understand Self-Supervised Models as Cross-lingual Feature Extractorscited by 2
- 2021Effects of Number of Filters of Convolutional Layers on Speech Recognition Model Accuracycited by 1
- 2021Intelligent Video Editing: Incorporating Modern Talking Face Generation Algorithms in a Video Editorcited by 1
- 2021Romanian Speech Recognition Experiments from the ROBIN Projectcited by 1
- 2022DDKtor: Automatic Diadochokinetic Speech Analysiscited by 1
- 2023Neural network analysis of neutron and X-ray reflectivity data: Incorporating prior knowledge for tackling the phase problemcited by 1
- 2023Revisiting the Entropy Semiring for Neural Speech Recognitioncited by 1
- 2022Improving Self-Supervised Learning-based MOS Prediction Networkscited by 0
- 2022A Deep Learning Approach for Automatic Detection of Qualitative Features of Lecturingcited by 0
- 2022Low-Level Physiological Implications of End-to-End Learning of Speech Recognitioncited by 0
- 2022Testing predictions of representation cost theory with CNNscited by 0
- 2022Guided contrastive self-supervised pre-training for automatic speech recognitioncited by 0
- 2024Characterizing Soft-Error Resiliency in Arm's Ethos-U55 Embedded Machine Learning Acceleratorcited by 0
- 2024YODAS: Youtube-Oriented Dataset for Audio and Speech2 Jun 2024
- 2024Characterizing Soft-Error Resiliency in Arm's Ethos-U55 Embedded Machine Learning Accelerator14 Apr 2024
- 2023Revisiting the Entropy Semiring for Neural Speech Recognition13 Dec 2023
- 2023A Quantitative Approach to Understand Self-Supervised Models as Cross-lingual Feature Extractors27 Nov 2023
- 2023Align With Purpose: Optimize Desired Properties in CTC Models with a General Plug-and-Play Framework4 Jul 2023
- 2023Neural network analysis of neutron and X-ray reflectivity data: Incorporating prior knowledge for tackling the phase problem28 Jun 2023
- 2023Scaling Speech Technology to 1,000+ Languages22 May 2023
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?21 Mar 2023
- 2023End-to-End Speech Recognition: A Survey3 Mar 2023
- 2023Improving Medical Speech-to-Text Accuracy with Vision-Language Pre-training Model27 Feb 2023
- 2023Audio-Visual Efficient Conformer for Robust Speech Recognition4 Jan 2023
- 2022Guided contrastive self-supervised pre-training for automatic speech recognition22 Oct 2022
31 more
- 2022Testing predictions of representation cost theory with CNNs3 Oct 2022
- 2022And what if two musical versions don't share melody, harmony, rhythm, or lyrics ?3 Oct 2022
- 2022ASR2K: Speech Recognition for Around 2000 Languages without Audio6 Sep 2022
- 2022Low-Level Physiological Implications of End-to-End Learning of Speech Recognition22 Aug 2022
- 2022DDKtor: Automatic Diadochokinetic Speech Analysis29 Jun 2022
- 2022A Deep Learning Approach for Automatic Detection of Qualitative Features of Lecturing30 May 2022
- 2022Global Normalization for Streaming Speech Recognition in a Modular Framework26 May 2022
- 2022Wav2Seq: Pre-training Speech-to-Text Encoder-Decoder Models Using Pseudo Languages2 May 2022
- 2022Improving Self-Supervised Learning-based MOS Prediction Networks23 Apr 2022
- 2022Flashlight: Enabling Innovation in Tools for Machine Learning29 Jan 2022
- 2022Star Temporal Classification: Sequence Classification with Partially Labeled Data28 Jan 2022
- 2021Romanian Speech Recognition Experiments from the ROBIN Project23 Nov 2021
- 2021Recent Advances in End-to-End Automatic Speech Recognition2 Nov 2021
- 2021Sequence Transduction with Graph-based Supervision1 Nov 2021
- 2021Intelligent Video Editing: Incorporating Modern Talking Face Generation Algorithms in a Video Editor16 Oct 2021
- 2021Improving Character Error Rate Is Not Equal to Having Clean Speech: Speech Enhancement for ASR Systems with Black-box Acoustic Models12 Oct 2021
- 2021Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognition14 Sep 2021
- 2021CrypTen: Secure Multi-Party Computation Meets Machine Learning2 Sep 2021
- 2021Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognition31 Aug 2021
- 2021Kaizen: Continuously improving teacher using Exponential Moving Average for semi-supervised speech recognition14 Jun 2021
- 2021Unsupervised Automatic Speech Recognition: A Review9 Jun 2021
- 2021An Improved Model for Voicing Silent Speech3 Jun 2021
- 2021Why does CTC result in peaky behavior?31 May 2021
- 2021A Toolbox for Construction and Analysis of Speech Datasets11 Apr 2021
- 2021SoK: A Modularized Approach to Study the Security of Automatic Speech Recognition Systems19 Mar 2021
- 2021Inductive biases, pretraining and fine-tuning jointly account for brain responses to speech25 Feb 2021
- 2021ATCSpeechNet: A multilingual end-to-end speech recognition framework for air traffic control systems17 Feb 2021
- 2021Effects of Number of Filters of Convolutional Layers on Speech Recognition Model Accuracy3 Feb 2021
- 2021High Fidelity Speech Regeneration with Application to Speech Enhancement31 Jan 2021
- 2021BCN2BRNO: ASR System Fusion for Albayzin 2020 Speech to Text Challenge29 Jan 2021
- 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretation2 Jan 2021
- 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
- 2023Scaling Speech Technology to 1,000+ Languagescited by 401
- 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 138
- 2021CrypTen: Secure Multi-Party Computation Meets Machine Learningcited by 131
- 2023End-to-End Speech Recognition: A Surveycited by 127
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2021Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognitioncited by 68
- 2024YODAS: Youtube-Oriented Dataset for Audio and Speechcited by 56
- 2021Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognitioncited by 42
- 2021Why does CTC result in peaky behavior?cited by 32
- 2022Wav2Seq: Pre-training Speech-to-Text Encoder-Decoder Models Using Pseudo Languagescited by 26
- 2022ASR2K: Speech Recognition for Around 2000 Languages without Audiocited by 26
12 most cited of 42 All 42 (JSON)
- 2024YODAS: Youtube-Oriented Dataset for Audio and Speech2 Jun 2024
- 2024Characterizing Soft-Error Resiliency in Arm's Ethos-U55 Embedded Machine Learning Accelerator14 Apr 2024
- 2023Revisiting the Entropy Semiring for Neural Speech Recognition13 Dec 2023
- 2023A Quantitative Approach to Understand Self-Supervised Models as Cross-lingual Feature Extractors27 Nov 2023
- 2023Align With Purpose: Optimize Desired Properties in CTC Models with a General Plug-and-Play Framework4 Jul 2023
- 2023Neural network analysis of neutron and X-ray reflectivity data: Incorporating prior knowledge for tackling the phase problem28 Jun 2023
- 2023Scaling Speech Technology to 1,000+ Languages22 May 2023
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?21 Mar 2023
- 2023End-to-End Speech Recognition: A Survey3 Mar 2023
- 2023Audio-Visual Efficient Conformer for Robust Speech Recognition4 Jan 2023
- 2022Guided contrastive self-supervised pre-training for automatic speech recognition22 Oct 2022
- 2022Testing predictions of representation cost theory with CNNs3 Oct 2022
12 newest of 42 All 42 (JSON)