Sarashina2.2-TTS: Tackling Kanji Polyphony in Japanese Speech Generation via Data Scaling and Targeted Data Synthesis
On the map: Synthetic data and self-improvement for LLMs → LLM synthetic data generation
Abstract (arXiv)
While large language model (LLM)-based text-to-speech (TTS) systems have achieved high-quality speech synthesis, most existing systems focus on English and Chinese. Japanese, however, remains under-explored, and its unique linguistic challenges, such as widespread context-dependent kanji polyphony, have yet to be adequately tackled. Here we introduce Sarashina2.2-TTS (https://github.com/sbintuitions/sarashina2.2-tts), a Japanese-centric LLM-TTS system that tackles these challenges through a dual approach: data strategy and evaluation methodology. First, we scale training to approximately 361k hours of speech, incorporating a balanced mix of Japanese and English data. Furthermore, we design a targeted data augmentation pipeline covering all 2,136 Joyo (regular-use) kanji designated by Japan's Agency for Cultural Affairs to efficiently address kanji polyphony disambiguation. Second, we introduce the Joyo Kanji Yomi Benchmark (https://github.com/sbintuitions/JoyoKanji-Yomi-Benchmark), covering all 2,136 Joyo kanji and their 4,378 readings. Alongside this benchmark, we propose Kana-CER, a metric that compares synthesized speech against reference readings in the kana space, eliminating orthographic variations to directly measure pronunciation correctness. Experiments demonstrate that our targeted data augmentation significantly improves reading accuracy. Overall, Sarashina2.2-TTS achieves state-of-the-art kanji-level reading accuracy and matches top baselines on general sentence-level pronunciation, while delivering the highest speaker similarity in zero-shot Japanese speech synthesis. Furthermore, cross-lingual evaluation reveals that Sarashina2.2-TTS is the only system that maintains stable Japanese pronunciation regardless of the prompt language, confirming that our balanced training approach improves cross-lingual robustness.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 15 of its 21 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
15 of 21 references.
References · 15
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
- 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 381
- 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 293
- 2020DNSMOS: A Non-Intrusive Perceptual Objective Speech Quality metric to evaluate Noise Suppressorscited by 235
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
- 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 95
- 2024The T05 System for The VoiceMOS Challenge 2024: Transfer Learning from Deep Image Classifier to Naturalness MOS Prediction of High-Quality Synthetic Speechcited by 78
- 2017JSUT corpus: free large-scale Japanese speech corpus for end-to-end speech synthesiscited by 57
- 2024OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identificationcited by 34
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Dictionary-Constrained Grapheme-to-Phoneme for Unsegmented Languages from LLM-Annotated Datacited by 0
- 2026Ruby-ASR: Evidence-Preserving Supervision for Joint Orthographic and Lexical-Reading Recognitioncited by 0
- 2026Training-Free Pronunciation Transcription via Text-Constrained Acoustic Rescoringcited by 0
- 2026Training-Free Pronunciation Transcription via Text-Constrained Acoustic Rescoring25 Sep 2026
- 2026Ruby-ASR: Evidence-Preserving Supervision for Joint Orthographic and Lexical-Reading Recognition23 Sep 2026
- 2026Dictionary-Constrained Grapheme-to-Phoneme for Unsegmented Languages from LLM-Annotated Data17 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025BreezyVoice: Adapting TTS for Taiwanese Mandarin with Enhanced Polyphone Disambiguation -- Challenges and Insights
- 2025Data-efficient Targeted Token-level Preference Optimization for LLM-based Text-to-Speech
- 2025ManchuTTS: Towards High-Quality Manchu Speech Synthesis via Flow Matching and Hierarchical Text Representation
- 2025Llasa: Scaling Train-Time and Inference-Time Compute for Llama-based Speech Synthesis
- 2026Speech-Worthy Alignment for Japanese SpeechLLMs via Direct Preference Optimization
- 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects
- 2024Constructing Multimodal Datasets from Scratch for Rapid Development of a Japanese Visual Language Model
- 2025Synthetic Data Generation for Phrase Break Prediction with Large Language Model