A New Benchmark of Aphasia Speech Recognition and Detection Based on E-Branchformer and Multi-task Learning
Not on the map. Why?
Abstract (arXiv)
Aphasia is a language disorder that affects the speaking ability of millions of patients. This paper presents a new benchmark for Aphasia speech recognition and detection tasks using state-of-the-art speech recognition techniques with the AphsiaBank dataset. Specifically, we introduce two multi-task learning methods based on the CTC/Attention architecture to perform both tasks simultaneously. Our system achieves state-of-the-art speaker-level detection accuracy (97.3%), and a relative WER reduction of 11% for moderate Aphasia patients. In addition, we demonstrate the generalizability of our approach by applying it to another disordered speech database, the DementiaBank Pitt corpus. We will make our all-in-one recipes and pre-trained model publicly available to facilitate reproducibility. Our standardized data preprocessing pipeline and open-source recipes enable researchers to compare results directly, promoting progress in disordered speech processing.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 22 of its 44 references that are in the map. First posted on arXiv 19 May 2023.
Builds on
22 of 44 references.
References · 22
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
- 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
- 2020Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challengecited by 104
- 2021Intermediate Loss Regularization for CTC-based Speech Recognitioncited by 95
- 2022Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understandingcited by 90
- 2022E-Branchformer: Branchformer with Enhanced merging for speech recognitioncited by 90
- 2017Multilingual Speech Recognition With A Single End-To-End Modelcited by 87
10 more
- 2021Relaxing the Conditional Independence Assumption of CTC-based ASR by Conditioning on Intermediate Predictionscited by 61
- 2023Improving Massively Multilingual ASR With Auxiliary CTC Objectivescited by 31
- 2018Multilingual End-to-End Speech Recognition with A Single Transformer on Low-Resource Languagescited by 26
- 2022Conformer Based Elderly Speech Recognition System for Alzheimer's Disease Detectioncited by 12
- 2022Exploiting Cross-domain And Cross-Lingual Ultrasound Tongue Imaging Features For Elderly And Dysarthric Speech Recognitioncited by 7
- 2022End-to-End Integration of Speech Recognition, Dereverberation, Beamforming, and Self-Supervised Learning Representationcited by 6
- 2019Cross-Language Aphasia Detection using Optimal Transport Domain Adaptationcited by 5
- 2020Aphasic Speech Recognition using a Mixture of Speech Intelligibility Expertscited by 4
- 2022Zero-Shot Cross-lingual Aphasia Detection using Automatic Speech Recognitioncited by 3
- 2019An End-to-End Approach to Automatic Speech Assessment for Cantonese-speaking People with Aphasiacited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 1.
4 papers.
- 2023Seq2seq for Automatic Paraphasia Detection in Aphasic Speechcited by 4
- 2024Low-resource speech recognition and dialect identification of Irish in a multi-task frameworkcited by 3
- 2024Automatic Speech Recognition Advancements for Indigenous Languages of the Americascited by 1
- 2025AS-ASR: A Lightweight Framework for Aphasia-Specific Automatic Speech Recognitioncited by 0
- 2025AS-ASR: A Lightweight Framework for Aphasia-Specific Automatic Speech Recognition6 Jun 2025
- 2024Low-resource speech recognition and dialect identification of Irish in a multi-task framework2 May 2024
- 2024Automatic Speech Recognition Advancements for Indigenous Languages of the Americas12 Apr 2024
- 2023Seq2seq for Automatic Paraphasia Detection in Aphasic Speech16 Dec 2023