mlsanityData to 13 Oct 2026

ArTST: Arabic Text and Speech Transformer

arXiv 2310.16621 ↗First posted 25 Oct 2023cs.CL cs.AI cs.SDcited by 14

Not on the map. Why?

Abstract (arXiv)

We present ArTST, a pre-trained Arabic text and speech transformer for supporting open-source speech technologies for the Arabic language. The model architecture follows the unified-modal framework, SpeechT5, that was recently released for English, and is focused on Modern Standard Arabic (MSA), with plans to extend the model for dialectal and code-switched Arabic in future editions. We pre-trained the model from scratch on MSA speech and text data, and fine-tuned it for the following tasks: Automatic Speech Recognition (ASR), Text-To-Speech synthesis (TTS), and spoken dialect identification. In our experiments comparing ArTST with SpeechT5, as well as with previously reported results in these tasks, ArTST performs on a par with or exceeding the current state-of-the-art in all three tasks. Moreover, we find that our pre-training is conducive for generalization, which is particularly evident in the low-resource TTS task. The pre-trained model as well as the fine-tuned ASR and TTS models are released for research use.

Key facts. Cited by 14 papers in the map (data through 13 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 25 Oct 2023.

Builds on

20 of 34 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,106
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
  3. 2020Language Models are Few-Shot Learnerscited by 32,320
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,549
  5. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,004
  6. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,870
  7. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,313
  8. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 594
  9. 2017Deep Learning Scaling is Predictable, Empiricallycited by 569
  10. 2023Scaling Speech Technology to 1,000+ Languagescited by 402
  11. 2022Revisiting Neural Scaling Laws in Language and Visioncited by 130
  12. 2019Large-Scale Multilingual Speech Recognition with a Streaming End-to-End Modelcited by 92
8 more
  1. 2017Multilingual Speech Recognition With A Single End-To-End Modelcited by 87
  2. 2021AraT5: Text-to-Text Transformers for Arabic Language Generationcited by 63
  3. 2021QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpuscited by 38
  4. 2023ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpuscited by 14
  5. 2022Heterogeneous Target Speech Separationcited by 13
  6. 2023On the Robustness of Arabic Speech Dialect Identificationcited by 13
  7. 2017Multilingual Training and Cross-lingual Adaptation on CTC-based Acoustic Modelcited by 6
  8. 2023Supervised Acoustic Embeddings And Their Transferability Across Languagescited by 1

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2024: 4; 2025: 6; 2026: 4.

14 papers.

Sort:

By area:

  1. 2024Mixat: A Data Set of Bilingual Emirati-English Speechcited by 12
  2. 2024Performance Analysis of Speech Encoders for Low-Resource SLU and ASR in Tunisian Dialectcited by 7
  3. 2025LLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLMcited by 7
  4. 2025NADI 2025: The First Multidialectal Arabic Speech Processing Shared Taskcited by 7
  5. 2024To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillationcited by 4
  6. 2025Voice of a Continent: Mapping Africa's Speech Technology Frontiercited by 4
  7. 2025ArVoice: A Multi-Speaker Dataset for Arabic Speech Synthesiscited by 4
  8. 2024Towards Zero-Shot Text-To-Speech for Arabic Dialectscited by 3
  9. 2026Habibi: Laying the Open-Source Foundation of Unified-Dialectal Arabic Speech Synthesiscited by 3
  10. 2025Open Automatic Speech Recognition Models for Classical and Modern Standard Arabiccited by 1
  11. 2026Ara-Best-RQ: Multi Dialectal Arabic SSLcited by 1
  12. 2025ArFake: A Robust Framework for Multi-Dialect Arabic Speech Spoofing Detection Benchmarkcited by 0
2 more
  1. 2026NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Taskcited by 0
  2. 2026CARDAMOM: A Micro-Dialectal Arabic Speech Dataset for ASRcited by 0