CommonAccent: Exploring Large Acoustic Pretrained Models for Accent Classification Based on Common Voice
Not on the map. Why?
Abstract (arXiv)
Despite the recent advancements in Automatic Speech Recognition (ASR), the recognition of accented speech still remains a dominant problem. In order to create more inclusive ASR systems, research has shown that the integration of accent information, as part of a larger ASR framework, can lead to the mitigation of accented speech errors. We address multilingual accent classification through the ECAPA-TDNN and Wav2Vec 2.0/XLSR architectures which have been proven to perform well on a variety of speech-related downstream tasks. We introduce a simple-to-follow recipe aligned to the SpeechBrain toolkit for accent classification based on Common Voice 7.0 (English) and Common Voice 11.0 (Italian, German, and Spanish). Furthermore, we establish new state-of-the-art for English accent classification with as high as 95% accuracy. We also study the internal categorization of the Wav2Vev 2.0 embeddings through t-SNE, noting that there is a level of clustering based on phonological similarity. (Our recipe is open-source in the SpeechBrain toolkit, see: https://github.com/speechbrain/speechbrain/tree/develop/recipes)
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 29 May 2023.
Builds on
19 of 33 references.
References · 19
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
- 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
- 2021Datasets: A Community Library for Natural Language Processingcited by 526
- 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2018Attentive Statistics Pooling for Deep Speaker Embeddingcited by 108
- 2019Utterance-level Aggregation For Speaker Recognition In The Wildcited by 49
- 2021The Accented English Speech Recognition Challenge 2020: Open Datasets, Tracks, Baselines, Results and Methodscited by 24
7 more
- 2021Accented Speech Recognition: A Surveycited by 11
- 2019Leveraging native language information for improved accented speech recognitioncited by 7
- 2019Domain Expansion in DNN-based Acoustic Models for Robust Speech Recognitioncited by 6
- 2020Exploiting Spectral Augmentation for Code-Switched Spoken Language Identificationcited by 5
- 2021AISPEECH-SJTU accent identification system for the Accented English Speech Recognition Challengecited by 4
- 2021English Accent Accuracy Analysis in a State-of-the-Art Automatic Speech Recognition Systemcited by 2
- 2020Deep Discriminative Feature Learning for Accent Recognitioncited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 3; 2025: 9; 2026: 6.
19 papers.
Sort:
- 2024Speech-Copilot: Leveraging Large Language Models for Speech Processing via Task Decomposition, Modularization, and Program Generationcited by 27
- 2024Convert and Speak: Zero-shot Accent Conversion with Minimum Supervisioncited by 11
- 2025CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speechcited by 11
- 2024AccentBox: Towards High-Fidelity Zero-Shot Accent Generationcited by 9
- 2025MECAT: A Multi-Experts Constructed Benchmark for Fine-Grained Audio Understanding Taskscited by 6
- 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMscited by 6
- 2025Voxlect: A Speech Foundation Model Benchmark for Modeling Dialects and Regional Languages Around the Globecited by 5
- 2025Pairwise Evaluation of Accent Similarity in Speech Synthesiscited by 4
- 2023Big model only for hard audios: Sample dependent Whisper model selection for efficient inferencescited by 2
- 2025Accent-Invariant Automatic Speech Recognition via Saliency-Driven Spectrogram Maskingcited by 2
- 2026Rethinking Discrete Speech Representation Tokens for Accent Generationcited by 2
- 2025MaskVCT: Masked Voice Codec Transformer for Zero-Shot Voice Conversion With Increased Controllability via Multiple Guidancescited by 1
7 more
- 2025Probing for Phonology in Self-Supervised Speech Representations: A Case Study on Accent Perceptioncited by 0
- 2025The Prosody of Emojiscited by 0
- 2026StyleStream: Real-Time Zero-Shot Voice Style Conversioncited by 0
- 2026Voice "Cloning" is Style Transfercited by 0
- 2026TokAN: Accent Normalization Using Self-Supervised Speech Tokenscited by 0
- 2026Flexible and Interpretable Accent Distance Measurementscited by 0
- 2026FuseAlign: Forced Alignment in the Wildcited by 0
- 2026FuseAlign: Forced Alignment in the Wild27 Sep 2026
- 2026Flexible and Interpretable Accent Distance Measurements10 Sep 2026
- 2026TokAN: Accent Normalization Using Self-Supervised Speech Tokens4 Jul 2026
- 2026Voice "Cloning" is Style Transfer15 May 2026
- 2026StyleStream: Real-Time Zero-Shot Voice Style Conversion23 Feb 2026
- 2026Rethinking Discrete Speech Representation Tokens for Accent Generation27 Jan 2026
- 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMs18 Dec 2025
- 2025Accent-Invariant Automatic Speech Recognition via Saliency-Driven Spectrogram Masking10 Oct 2025
- 2025MaskVCT: Masked Voice Codec Transformer for Zero-Shot Voice Conversion With Increased Controllability via Multiple Guidances21 Sep 2025
- 2025Voxlect: A Speech Foundation Model Benchmark for Modeling Dialects and Regional Languages Around the Globe3 Aug 2025
- 2025The Prosody of Emojis1 Aug 2025
- 2025MECAT: A Multi-Experts Constructed Benchmark for Fine-Grained Audio Understanding Tasks31 Jul 2025
7 more
- 2025Probing for Phonology in Self-Supervised Speech Representations: A Case Study on Accent Perception21 Jun 2025
- 2025CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speech3 Jun 2025
- 2025Pairwise Evaluation of Accent Similarity in Speech Synthesis20 May 2025
- 2024AccentBox: Towards High-Fidelity Zero-Shot Accent Generation13 Sep 2024
- 2024Convert and Speak: Zero-shot Accent Conversion with Minimum Supervision19 Aug 2024
- 2024Speech-Copilot: Leveraging Large Language Models for Speech Processing via Task Decomposition, Modularization, and Program Generation13 Jul 2024
- 2023Big model only for hard audios: Sample dependent Whisper model selection for efficient inferences22 Sep 2023
- 2024Speech-Copilot: Leveraging Large Language Models for Speech Processing via Task Decomposition, Modularization, and Program Generationcited by 27
- 2024Convert and Speak: Zero-shot Accent Conversion with Minimum Supervisioncited by 11
- 2025CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speechcited by 11
- 2024AccentBox: Towards High-Fidelity Zero-Shot Accent Generationcited by 9
- 2025MECAT: A Multi-Experts Constructed Benchmark for Fine-Grained Audio Understanding Taskscited by 6
- 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMscited by 6
- 2025Voxlect: A Speech Foundation Model Benchmark for Modeling Dialects and Regional Languages Around the Globecited by 5
- 2025Pairwise Evaluation of Accent Similarity in Speech Synthesiscited by 4
- 2023Big model only for hard audios: Sample dependent Whisper model selection for efficient inferencescited by 2
- 2025Accent-Invariant Automatic Speech Recognition via Saliency-Driven Spectrogram Maskingcited by 2
- 2026Rethinking Discrete Speech Representation Tokens for Accent Generationcited by 2
- 2025MaskVCT: Masked Voice Codec Transformer for Zero-Shot Voice Conversion With Increased Controllability via Multiple Guidancescited by 1
12 most cited of 19 All 19 (JSON)
- 2026FuseAlign: Forced Alignment in the Wild27 Sep 2026
- 2026Flexible and Interpretable Accent Distance Measurements10 Sep 2026
- 2026TokAN: Accent Normalization Using Self-Supervised Speech Tokens4 Jul 2026
- 2026Voice "Cloning" is Style Transfer15 May 2026
- 2026StyleStream: Real-Time Zero-Shot Voice Style Conversion23 Feb 2026
- 2026Rethinking Discrete Speech Representation Tokens for Accent Generation27 Jan 2026
- 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMs18 Dec 2025
- 2025Accent-Invariant Automatic Speech Recognition via Saliency-Driven Spectrogram Masking10 Oct 2025
- 2025MaskVCT: Masked Voice Codec Transformer for Zero-Shot Voice Conversion With Increased Controllability via Multiple Guidances21 Sep 2025
- 2025Voxlect: A Speech Foundation Model Benchmark for Modeling Dialects and Regional Languages Around the Globe3 Aug 2025
- 2025The Prosody of Emojis1 Aug 2025
- 2025MECAT: A Multi-Experts Constructed Benchmark for Fine-Grained Audio Understanding Tasks31 Jul 2025
12 newest of 19 All 19 (JSON)