PhoWhisper: Automatic Speech Recognition for Vietnamese
Not on the map. Why?
Abstract (arXiv)
We introduce PhoWhisper in five versions for Vietnamese automatic speech recognition. PhoWhisper's robustness is achieved through fine-tuning the Whisper model on an 844-hour dataset that encompasses diverse Vietnamese accents. Our experimental study demonstrates state-of-the-art performances of PhoWhisper on benchmark Vietnamese ASR datasets. We have open-sourced PhoWhisper at: https://github.com/VinAIResearch/PhoWhisper
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 6 of its 9 references that are in the map. First posted on arXiv 27 Mar 2024.
Builds on
6 of 9 references.
References · 6
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
- 2023Scaling Speech Technology to 1,000+ Languagescited by 401
- 2023SeamlessM4T: Massively Multilingual & Multimodal Machine Translationcited by 124
Built on by
Citing papers per year: 2024: 2; 2025: 7; 2026: 4.
13 papers.
Sort:
- 2024Do Prompts Really Prompt? Exploring the Prompt Understanding Capability of Whispercited by 12
- 2024Multi-Dialect Vietnamese: Task, Dataset, Baseline Models and Challengescited by 6
- 2025Zero-Shot Text-to-Speech for Vietnamesecited by 3
- 2026ViMedCSS: A Vietnamese Medical Code-Switching Speech Dataset & Benchmarkcited by 3
- 2025ViCocktail: Automated Multi-Modal Data Collection for Vietnamese Audio-Visual Speech Recognitioncited by 1
- 2025Whisper based Cross-Lingual Phoneme Recognition between Vietnamese and Englishcited by 1
- 2025Flavors of Moonshine: Tiny Specialized ASR Models for Edge Devicescited by 1
- 2026Phonetic Modeling of Dialectal Variation in Vietnamese Speechcited by 1
- 2025ViToSA: Audio-Based Toxic Spans Detection on Vietnamese Speech Utterancescited by 0
- 2025TSPC: A Two-Stage Phoneme-Centric Architecture for code-switching Vietnamese-English Speech Recognitioncited by 0
- 2025VietLyrics: A Large-Scale Dataset and Models for Vietnamese Automatic Lyrics Transcriptioncited by 0
- 2026Vietnamese Automatic Speech Recognition: A Revisitcited by 0
- 2026PiDA: Phonetically-Informed Data Augmentation for Robust Vietnamese Speech Translation11 Jun 2026
- 2026Phonetic Modeling of Dialectal Variation in Vietnamese Speech23 May 2026
- 2026Vietnamese Automatic Speech Recognition: A Revisit16 Mar 2026
- 2026ViMedCSS: A Vietnamese Medical Code-Switching Speech Dataset & Benchmark13 Feb 2026
- 2025VietLyrics: A Large-Scale Dataset and Models for Vietnamese Automatic Lyrics Transcription25 Oct 2025
- 2025TSPC: A Two-Stage Phoneme-Centric Architecture for code-switching Vietnamese-English Speech Recognition7 Sep 2025
- 2025Flavors of Moonshine: Tiny Specialized ASR Models for Edge Devices2 Sep 2025
- 2025Whisper based Cross-Lingual Phoneme Recognition between Vietnamese and English22 Aug 2025
- 2025ViCocktail: Automated Multi-Modal Data Collection for Vietnamese Audio-Visual Speech Recognition5 Jun 2025
- 2025Zero-Shot Text-to-Speech for Vietnamese2 Jun 2025
- 2025ViToSA: Audio-Based Toxic Spans Detection on Vietnamese Speech Utterances31 May 2025
- 2024Multi-Dialect Vietnamese: Task, Dataset, Baseline Models and Challenges4 Oct 2024
- 2024Do Prompts Really Prompt? Exploring the Prompt Understanding Capability of Whispercited by 12
- 2024Multi-Dialect Vietnamese: Task, Dataset, Baseline Models and Challengescited by 6
- 2025Zero-Shot Text-to-Speech for Vietnamesecited by 3
- 2026ViMedCSS: A Vietnamese Medical Code-Switching Speech Dataset & Benchmarkcited by 3
- 2025ViCocktail: Automated Multi-Modal Data Collection for Vietnamese Audio-Visual Speech Recognitioncited by 1
- 2025Whisper based Cross-Lingual Phoneme Recognition between Vietnamese and Englishcited by 1
- 2025Flavors of Moonshine: Tiny Specialized ASR Models for Edge Devicescited by 1
- 2026Phonetic Modeling of Dialectal Variation in Vietnamese Speechcited by 1
- 2025ViToSA: Audio-Based Toxic Spans Detection on Vietnamese Speech Utterancescited by 0
- 2025TSPC: A Two-Stage Phoneme-Centric Architecture for code-switching Vietnamese-English Speech Recognitioncited by 0
- 2025VietLyrics: A Large-Scale Dataset and Models for Vietnamese Automatic Lyrics Transcriptioncited by 0
- 2026Vietnamese Automatic Speech Recognition: A Revisitcited by 0
12 most cited of 13 All 13 (JSON)
- 2026PiDA: Phonetically-Informed Data Augmentation for Robust Vietnamese Speech Translation11 Jun 2026
- 2026Phonetic Modeling of Dialectal Variation in Vietnamese Speech23 May 2026
- 2026Vietnamese Automatic Speech Recognition: A Revisit16 Mar 2026
- 2026ViMedCSS: A Vietnamese Medical Code-Switching Speech Dataset & Benchmark13 Feb 2026
- 2025VietLyrics: A Large-Scale Dataset and Models for Vietnamese Automatic Lyrics Transcription25 Oct 2025
- 2025TSPC: A Two-Stage Phoneme-Centric Architecture for code-switching Vietnamese-English Speech Recognition7 Sep 2025
- 2025Flavors of Moonshine: Tiny Specialized ASR Models for Edge Devices2 Sep 2025
- 2025Whisper based Cross-Lingual Phoneme Recognition between Vietnamese and English22 Aug 2025
- 2025ViCocktail: Automated Multi-Modal Data Collection for Vietnamese Audio-Visual Speech Recognition5 Jun 2025
- 2025Zero-Shot Text-to-Speech for Vietnamese2 Jun 2025
- 2025ViToSA: Audio-Based Toxic Spans Detection on Vietnamese Speech Utterances31 May 2025
- 2024Multi-Dialect Vietnamese: Task, Dataset, Baseline Models and Challenges4 Oct 2024
12 newest of 13 All 13 (JSON)