mlsanityData to 14 Oct 2026

AraS2P: Arabic Speech-to-Phonemes System

arXiv 2509.23504 ↗First posted 27 Sep 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper describes AraS2P, our speech-to-phonemes system submitted to the Iqra'Eval 2025 Shared Task. We adapted Wav2Vec2-BERT via Two-Stage training strategy. In the first stage, task-adaptive continue pretraining was performed on large-scale Arabic speech-phonemes datasets, which were generated by converting the Arabic text using the MSA Phonetiser. In the second stage, the model was fine-tuned on the official shared task data, with additional augmentation from XTTS-v2-synthesized recitations featuring varied Ayat segments, speaker embeddings, and textual perturbations to simulate possible human errors. The system ranked first on the official leaderboard, demonstrating that phoneme-aware pretraining combined with targeted augmentation yields strong performance in phoneme-level mispronunciation detection.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 29 references that are in the map. First posted on arXiv 27 Sep 2025.

Builds on

16 of 29 references.

References · 16

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  5. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  6. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  7. 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 347
  8. 2019vq-wav2vec: Self-Supervised Learning of Discrete Speech Representationscited by 340
  9. 2024Tower: An Open Multilingual Large Language Model for Translation-Related Taskscited by 206
  10. 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 192
  11. 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
  12. 2024Continual Learning with Pre-Trained Models: A Surveycited by 154
4 more
  1. 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
  2. 2024Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language Capabilitiescited by 111
  3. 2023Quran Recitation Recognition using End-to-End Deep Learningcited by 3
  4. 2023An ensemble-based framework for mispronunciation detection of Arabic phonemescited by 2

Built on by

Not cited yet.