JSUT corpus: free large-scale Japanese speech corpus for end-to-end speech synthesis
Not on the map. Why?
Abstract (arXiv)
Thanks to improvements in machine learning techniques including deep learning, a free large-scale speech corpus that can be shared between academic institutions and commercial companies has an important role. However, such a corpus for Japanese speech synthesis does not exist. In this paper, we designed a novel Japanese speech corpus, named the "JSUT corpus," that is aimed at achieving end-to-end speech synthesis. The corpus consists of 10 hours of reading-style speech data and its transcription and covers all of the main pronunciations of daily-use Japanese characters. In this paper, we describe how we designed and analyzed the corpus. The corpus is freely available online.
Key facts. Cited by 58 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 8; 2023: 9; 2024: 13; 2025: 14; 2026: 8.
58 papers.
Sort:
By area:
- 2021A Survey on Neural Speech Synthesiscited by 184
- 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
- 2021ESPnet2-TTS: Extending the Edge of TTS Researchcited by 22
- 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
- 2024DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Datasetcited by 20
- 2022Talking Face Generation with Multilingual TTScited by 18
- 2023Adapting Multilingual Speech Representation Model for a New, Underresourced Language through Multilingual Fine-tuning and Continued Pretrainingcited by 18
- 2023A Comparative Study on E-Branchformer vs Conformer in Speech Recognition, Translation, and Understanding Taskscited by 14
- 2023Integrating Pre-Trained Speech and Language Models for End-to-End Speech Recognitioncited by 10
- 2025Towards Interactive Intelligence for Digital Humanscited by 10
- 2022Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detectioncited by 9
- 2022SpecRNet: Towards Faster and More Accessible Audio DeepFake Detectioncited by 9
38 more
- 2023Multi-Dataset Co-Training with Sharpness-Aware Optimization for Audio Anti-spoofingcited by 9
- 2025LiteASR: Efficient Automatic Speech Recognition with Low-Rank Approximationcited by 7
- 2024The DeepSpeak Datasetcited by 6
- 2021RefineGAN: Universally Generating Waveform Better than Ground Truth with Highly Accurate Pitch and Intensity Responsescited by 5
- 2024InterBiasing: Boost Unseen Word Recognition through Biasing Intermediate Predictionscited by 5
- 2024SaMoye: Zero-shot Singing Voice Conversion Model Based on Feature Disentanglement and Enhancementcited by 5
- 2024VoiceWukong: Benchmarking Deepfake Voice Detectioncited by 5
- 2025MOLE: Metadata Extraction and Validation in Scientific Papers Using LLMscited by 5
- 2021Decoupling Speaker-Independent Emotions for Voice Conversion Via Source-Filter Networkscited by 4
- 2023Unsupervised Data Selection for TTS: Using Arabic Broadcast News as a Case Studycited by 4
- 2023Wave-U-Net Discriminator: Fast and Lightweight Discriminator for Generative Adversarial Network-Based Speech Synthesiscited by 4
- 2023Exploration of Language Dependency for Japanese Self-Supervised Speech Representation Modelscited by 4
- 2025Voice Cloning: Comprehensive Surveycited by 4
- 2025LLM-based Generative Error Correction for Rare Words with Synthetic Data and Phonetic Contextcited by 4
- 2021Towards Natural and Controllable Cross-Lingual Voice Conversion Based on Neural TTS Model and Phonetic Posteriorgramcited by 3
- 2024Lightweight Model Attribution and Detection of Synthetic Speech via Audio Residual Fingerprintscited by 3
- 2025WCTC-Biasing: Retraining-free Contextual Biasing ASR with Wildcard CTC-based Keyword Spotting and Inter-layer Biasingcited by 3
- 2026Sarashina2.2-TTS: Tackling Kanji Polyphony in Japanese Speech Generation via Data Scaling and Targeted Data Synthesiscited by 3
- 2022Investigation of Japanese PnG BERT language model in text-to-speech synthesis for pitch accent languagecited by 2
- 2023A Comparative Study of Voice Conversion Models with Large-Scale Speech and Singing Data: The T13 Systems for the Singing Voice Conversion Challenge 2023cited by 2
- 2024A Pilot Study of GSLM-based Simulation of Foreign Accentuation Only Using Native Speech Corporacited by 2
- 2025SupertonicTTS: Towards Highly Efficient and Streamlined Text-to-Speech Systemcited by 2
- 2025Re-evaluating Minimum Bayes Risk Decoding for Automatic Speech Recognitioncited by 2
- 2022Few-Shot Cross-Lingual TTS Using Transferable Phoneme Embeddingcited by 1
- 2024NAIST Simultaneous Speech Translation System for IWSLT 2024cited by 1
- 2024Analytic Study of Text-Free Speech Synthesis for Raw Audio using a Self-Supervised Learning Modelcited by 1
- 2024Efficient Adaptation of Multilingual Models for Japanese ASRcited by 1
- 2025XMAD-Bench: Cross-Domain Multilingual Audio Deepfake Benchmarkcited by 1
- 2025Transcript-Prompted Whisper with Dictionary-Enhanced Decoding for Japanese Speech Annotationcited by 1
- 2025UtterTune: LoRA-Based Target-Language Pronunciation Edit and Control in Multilingual Text-to-Speechcited by 1
- 2025Building Tailored Speech Recognizers for Japanese Speaking Assessmentcited by 1
- 2025Multi-Accent Mandarin Dry-Vocal Singing Dataset: Benchmark for Singing Accent Recognitioncited by 1
- 2026Alethia: A Foundational Encoder for Voice Deepfakescited by 1
- 2022Dict-TTS: Learning to Pronounce with Prior Dictionary Knowledge for Text-to-Speechcited by 0
- 2022Empirical Study Incorporating Linguistic Knowledge on Filled Pauses for Personalized Spontaneous Speech Synthesiscited by 0
- 2023Automatic Tuning of Loss Trade-offs without Hyper-parameter Search in End-to-End Zero-Shot Speech Synthesiscited by 0
- 2024Maximizing Data Efficiency for Cross-Lingual TTS Adaptation by Self-Supervised Representation Mixing and Embedding Initializationcited by 0
- 2024A quest through interconnected datasets: lessons from highly-cited ICASSP paperscited by 0
50 most cited of 58 All 58 (JSON)
- 2026Boundary-Free Contextual Biasing: Depth-Adaptive Gating and Reading-Space Matching for Unsegmented Languages7 Oct 2026
- 2026Training-Free Pronunciation Transcription via Text-Constrained Acoustic Rescoring25 Sep 2026
- 2026Ruby-ASR: Evidence-Preserving Supervision for Joint Orthographic and Lexical-Reading Recognition23 Sep 2026
- 2026Does Translation-Enhanced Speech Encoder Pre-training Affect Speech LLMs?24 Jun 2026
- 2026Sarashina2.2-TTS: Tackling Kanji Polyphony in Japanese Speech Generation via Data Scaling and Targeted Data Synthesis24 Jun 2026
- 2026APEX: Audio Prototype EXplanations for Classification Tasks11 May 2026
- 2026Alethia: A Foundational Encoder for Voice Deepfakes30 Apr 2026
- 2026A General Model for Deepfake Speech Detection: Diverse Bonafide Resources or Diverse AI-Based Generators29 Mar 2026
- 2025Towards Interactive Intelligence for Digital Humans15 Dec 2025
- 2025Multi-Accent Mandarin Dry-Vocal Singing Dataset: Benchmark for Singing Accent Recognition7 Dec 2025
- 2025Re-evaluating Minimum Bayes Risk Decoding for Automatic Speech Recognition22 Oct 2025
- 2025Building Tailored Speech Recognizers for Japanese Speaking Assessment25 Sep 2025
38 more
- 2025MixedG2P-T5: G2P-free Speech Synthesis for Mixed-script texts using Speech Self-Supervised Learning and Language Model1 Sep 2025
- 2025UtterTune: LoRA-Based Target-Language Pronunciation Edit and Control in Multilingual Text-to-Speech13 Aug 2025
- 2025Transcript-Prompted Whisper with Dictionary-Enhanced Decoding for Japanese Speech Annotation9 Jun 2025
- 2025WCTC-Biasing: Retraining-free Contextual Biasing ASR with Wildcard CTC-based Keyword Spotting and Inter-layer Biasing2 Jun 2025
- 2025XMAD-Bench: Cross-Domain Multilingual Audio Deepfake Benchmark31 May 2025
- 2025MOLE: Metadata Extraction and Validation in Scientific Papers Using LLMs26 May 2025
- 2025LLM-based Generative Error Correction for Rare Words with Synthetic Data and Phonetic Context23 May 2025
- 2025Voice Cloning: Comprehensive Survey1 May 2025
- 2025SupertonicTTS: Towards Highly Efficient and Streamlined Text-to-Speech System29 Mar 2025
- 2025LiteASR: Efficient Automatic Speech Recognition with Low-Rank Approximation27 Feb 2025
- 2024CrossSpeech++: Cross-lingual Speech Synthesis with Decoupled Language and Speaker Generation28 Dec 2024
- 2024Efficient Adaptation of Multilingual Models for Japanese ASR14 Dec 2024
- 2024Analytic Study of Text-Free Speech Synthesis for Raw Audio using a Self-Supervised Learning Model4 Dec 2024
- 2024Lightweight Model Attribution and Detection of Synthetic Speech via Audio Residual Fingerprints21 Nov 2024
- 2024A quest through interconnected datasets: lessons from highly-cited ICASSP papers19 Sep 2024
- 2024DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Dataset13 Sep 2024
- 2024VoiceWukong: Benchmarking Deepfake Voice Detection10 Sep 2024
- 2024The DeepSpeak Dataset9 Aug 2024
- 2024A Pilot Study of GSLM-based Simulation of Foreign Accentuation Only Using Native Speech Corpora16 Jul 2024
- 2024SaMoye: Zero-shot Singing Voice Conversion Model Based on Feature Disentanglement and Enhancement10 Jul 2024
- 2024NAIST Simultaneous Speech Translation System for IWSLT 202430 Jun 2024
- 2024InterBiasing: Boost Unseen Word Recognition through Biasing Intermediate Predictions21 Jun 2024
- 2024Maximizing Data Efficiency for Cross-Lingual TTS Adaptation by Self-Supervised Representation Mixing and Embedding Initialization23 Jan 2024
- 2023Integrating Pre-Trained Speech and Language Models for End-to-End Speech Recognition6 Dec 2023
- 2023A Comparative Study of Voice Conversion Models with Large-Scale Speech and Singing Data: The T13 Systems for the Singing Voice Conversion Challenge 20238 Oct 2023
- 2023Multi-Dataset Co-Training with Sharpness-Aware Optimization for Audio Anti-spoofing31 May 2023
- 2023Automatic Tuning of Loss Trade-offs without Hyper-parameter Search in End-to-End Zero-Shot Speech Synthesis26 May 2023
- 2023A Comparative Study on E-Branchformer vs Conformer in Speech Recognition, Translation, and Understanding Tasks18 May 2023
- 2023Exploration of Language Dependency for Japanese Self-Supervised Speech Representation Models9 May 2023
- 2023Wave-U-Net Discriminator: Fast and Lightweight Discriminator for Generative Adversarial Network-Based Speech Synthesis24 Mar 2023
- 2023Unsupervised Data Selection for TTS: Using Arabic Broadcast News as a Case Study22 Jan 2023
- 2023Adapting Multilingual Speech Representation Model for a New, Underresourced Language through Multilingual Fine-tuning and Continued Pretraining18 Jan 2023
- 2022Investigation of Japanese PnG BERT language model in text-to-speech synthesis for pitch accent language16 Dec 2022
- 2022Empirical Study Incorporating Linguistic Knowledge on Filled Pauses for Personalized Spontaneous Speech Synthesis14 Oct 2022
- 2022SpecRNet: Towards Faster and More Accessible Audio DeepFake Detection12 Oct 2022
- 2022Controllable Data Generation by Deep Learning: A Review19 Jul 2022
- 2022Few-Shot Cross-Lingual TTS Using Transferable Phoneme Embedding27 Jun 2022
- 2022Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detection27 Jun 2022
50 newest of 58 All 58 (JSON)
- 2021A Survey on Neural Speech Synthesiscited by 184
- 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
- 2021ESPnet2-TTS: Extending the Edge of TTS Researchcited by 22
- 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
- 2022Talking Face Generation with Multilingual TTScited by 18
- 2023Adapting Multilingual Speech Representation Model for a New, Underresourced Language through Multilingual Fine-tuning and Continued Pretrainingcited by 18
- 2023A Comparative Study on E-Branchformer vs Conformer in Speech Recognition, Translation, and Understanding Taskscited by 14
- 2023Integrating Pre-Trained Speech and Language Models for End-to-End Speech Recognitioncited by 10
- 2025Towards Interactive Intelligence for Digital Humanscited by 10
- 2022Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detectioncited by 9
- 2022SpecRNet: Towards Faster and More Accessible Audio DeepFake Detectioncited by 9
- 2023Multi-Dataset Co-Training with Sharpness-Aware Optimization for Audio Anti-spoofingcited by 9
12 most cited of 55 All 55 (JSON)
- 2026Boundary-Free Contextual Biasing: Depth-Adaptive Gating and Reading-Space Matching for Unsegmented Languages7 Oct 2026
- 2026Training-Free Pronunciation Transcription via Text-Constrained Acoustic Rescoring25 Sep 2026
- 2026Ruby-ASR: Evidence-Preserving Supervision for Joint Orthographic and Lexical-Reading Recognition23 Sep 2026
- 2026Does Translation-Enhanced Speech Encoder Pre-training Affect Speech LLMs?24 Jun 2026
- 2026APEX: Audio Prototype EXplanations for Classification Tasks11 May 2026
- 2026Alethia: A Foundational Encoder for Voice Deepfakes30 Apr 2026
- 2026A General Model for Deepfake Speech Detection: Diverse Bonafide Resources or Diverse AI-Based Generators29 Mar 2026
- 2025Towards Interactive Intelligence for Digital Humans15 Dec 2025
- 2025Multi-Accent Mandarin Dry-Vocal Singing Dataset: Benchmark for Singing Accent Recognition7 Dec 2025
- 2025Re-evaluating Minimum Bayes Risk Decoding for Automatic Speech Recognition22 Oct 2025
- 2025Building Tailored Speech Recognizers for Japanese Speaking Assessment25 Sep 2025
- 2025MixedG2P-T5: G2P-free Speech Synthesis for Mixed-script texts using Speech Self-Supervised Learning and Language Model1 Sep 2025
12 newest of 55 All 55 (JSON)