mlsanityData to 14 Oct 2026

BranchShine-CR: Compact Multilingual IPA Transcription with Self-Conditioned CTC and Consistency Regularization

arXiv 2609.29069 ↗First posted 24 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce BranchShine-CR, a 25M-parameter model for multilingual transcription into the International Phonetic Alphabet (IPA). It combines log-mel features, a rotary-position E-Branchformer encoder, intermediate self-conditioned connectionist temporal classification (CTC), and consistency regularization across augmented views. On 16,646 shared IPApack++ test utterances, it achieves 4.47% IPA character error rate, a 22.3% relative reduction from ZIPA-CTC-NS, with approximately one-twelfth as many parameters while being trained from scratch. BranchShine-CR also outperforms a similarly sized NeMo Conformer baseline across all 41 dataset language labels. Ablation studies indicate the individual components synergetically acting in model performance contribution. These findings support compact IPA recognition capabilities under limited compute budget, for applications in low-resource on-device pronunciation assessment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 24 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

19 of 24 references.

References · 19

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  2. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  3. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
  4. 2021R-Drop: Regularized Dropout for Neural Networkscited by 202
  5. 2022E-Branchformer: Branchformer with Enhanced merging for speech recognitioncited by 92
  6. 2022Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understandingcited by 91
  7. 2020Universal Phone Recognition with a Multilingual Allophone Systemcited by 81
  8. 2021Simple and Effective Zero-shot Cross-lingual Phoneme Recognitioncited by 79
  9. 2021Relaxing the Conditional Independence Assumption of CTC-based ASR by Conditioning on Intermediate Predictionscited by 61
  10. 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 50
  11. 2024Moonshine: Speech Recognition for Live Transcription and Voice Commandscited by 19
  12. 2025ZIPA: A family of efficient models for multilingual phone recognitioncited by 19
7 more
  1. 2024CR-CTC: Consistency regularization on CTC for improved speech recognitioncited by 17
  2. 2023Universal Automatic Phonetic Transcription into the International Phonetic Alphabetcited by 16
  3. 2025POWSM: A Phonetic Open Whisper-Style Speech Foundation Modelcited by 14
  4. 2023Allophant: Cross-lingual Phoneme Recognition with Articulatory Attributescited by 13
  5. 2020AlloVera: A Multilingual Allophone Databasecited by 10
  6. 2026An Empirical Recipe for Universal Phone Recognitioncited by 5
  7. 2026BranchShine: Compact Raw-Audio-to-IPA Transcription with a RoPE E-Branchformer Encodercited by 1

Built on by

Not cited yet.