mlsanityData to 14 Oct 2026

BranchShine: Compact Raw-Audio-to-IPA Transcription with a RoPE E-Branchformer Encoder

arXiv 2606.22824 ↗First posted 22 Jun 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Speech-to-IPA transcription is useful when the desired output is pronunciation rather than orthographic text, but competitive multilingual systems are often large and evaluation is sensitive to normalization choices. This paper presents BranchShine, a 33M-parameter raw-audio CTC recognizer with a lightweight convolutional front end and a 19-block RoPE E-Branchformer encoder. We find that BranchShine provides a compact and competitive operating point for IPA transcription under matched normalization and scoring. On a 16,660-utterance multilingual test set covering 41 language labels, BranchShine obtains 9.19% whitespace-insensitive IPA character error rate, compared with 9.78% for the 575.00M-parameter PhoneticXEUS baseline. A secondary child speech reading analysis shows a complementary operating profile: BranchShine is more conservative on incorrect readings, while Whisper-Medium is stronger on exact acceptance of correct readings. Overall, the results indicate that a compact raw-audio-to-IPA model can approach much larger baselines on character-level IPA transcription.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 25 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

18 of 25 references.

References · 18

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  5. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  6. 2022E-Branchformer: Branchformer with Enhanced merging for speech recognitioncited by 92
  7. 2022Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understandingcited by 91
  8. 2020Universal Phone Recognition with a Multilingual Allophone Systemcited by 81
  9. 2021Simple and Effective Zero-shot Cross-lingual Phoneme Recognitioncited by 79
  10. 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 50
  11. 2024Moonshine: Speech Recognition for Live Transcription and Voice Commandscited by 19
  12. 2025ZIPA: A family of efficient models for multilingual phone recognitioncited by 19
6 more
  1. 2024Whistle: Data-Efficient Multilingual and Crosslingual Speech Recognition via Weakly Phonetic Supervisioncited by 17
  2. 2023Universal Automatic Phonetic Transcription into the International Phonetic Alphabetcited by 16
  3. 2025POWSM: A Phonetic Open Whisper-Style Speech Foundation Modelcited by 14
  4. 2023Allophant: Cross-lingual Phoneme Recognition with Articulatory Attributescited by 13
  5. 2020AlloVera: A Multilingual Allophone Databasecited by 10
  6. 2026An Empirical Recipe for Universal Phone Recognitioncited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.