GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks
Not on the map. Why?
Abstract (arXiv)
The scarcity of high-quality and multi-task singing datasets significantly hinders the development of diverse controllable and personalized singing tasks, as existing singing datasets suffer from low quality, limited diversity of languages and singers, absence of multi-technique information and realistic music scores, and poor task suitability. To tackle these problems, we present GTSinger, a large global, multi-technique, free-to-use, high-quality singing corpus with realistic music scores, designed for all singing tasks, along with its benchmarks. Particularly, (1) we collect 80.59 hours of high-quality singing voices, forming the largest recorded singing dataset; (2) 20 professional singers across nine widely spoken languages offer diverse timbres and styles; (3) we provide controlled comparison and phoneme-level annotations of six commonly used singing techniques, helping technique modeling and control; (4) GTSinger offers realistic music scores, assisting real-world musical composition; (5) singing voices are accompanied by manual phoneme-to-audio alignments, global style labels, and 16.16 hours of paired speech for various singing tasks. Moreover, to facilitate the use of GTSinger, we conduct four benchmark experiments: technique-controllable singing voice synthesis, technique recognition, style transfer, and speech-to-singing conversion. The demos can be found at http://aaronz345.github.io/GTSingerDemo/. We provide the dataset and the code for processing data and conducting benchmarks at https://huggingface.co/datasets/AaronZ345/GTSinger and https://github.com/AaronZ345/GTSinger.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 18 of its 35 references that are in the map. First posted on arXiv 20 Sep 2024.
Builds on
18 of 35 references.
References · 18
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
- 2021Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpuscited by 60
- 2023SingSong: Generating musical accompaniments from singingcited by 54
- 2022Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesiscited by 53
- 2021VISinger: Variational Inference with Adversarial Learning for End-to-End Singing Voice Synthesiscited by 38
- 2023RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Musiccited by 27
- 2023StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesiscited by 21
- 2020NHSS: A Speech and Singing Parallel Databasecited by 16
- 2020JVS-MuSiC: Japanese multispeaker singing-voice corpuscited by 14
- 2023RMSSinger: Realistic-Music-Score based Singing Voice Synthesiscited by 12
6 more
- 2022Learning the Beauty in Songs: Neural Singing Voice Beautifiercited by 10
- 2023Self-Supervised Representations for Singing Voice Conversioncited by 8
- 2022WeSinger: Data-augmented Singing Voice Synthesis with Auxiliary Lossescited by 7
- 2022MuSE-SVS: Multi-Singer Emotional Singing Voice Synthesizer that Controls Emotional Intensitycited by 6
- 2022Robust One-Shot Singing Voice Conversioncited by 5
- 2023AlignSTS: Speech-to-Singing Conversion via Cross-Modal Alignmentcited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 14; 2026: 13.
29 papers.
Sort:
By area:
- 2024AV-Odyssey Bench: Can Your Multimodal LLMs Really Understand Audio-Visual Information?cited by 46
- 2024TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Controlcited by 20
- 2025GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chainscited by 14
- 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessmentcited by 7
- 2025TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesiscited by 5
- 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generationcited by 5
- 2025SongPrep: A Preprocessing Framework and End-to-end Model for Full-song Structure Parsing and Lyrics Transcriptioncited by 5
- 2025YingMusic-Singer: Zero-shot Singing Voice Synthesis and Editing with Annotation-free Melody Guidancecited by 5
- 2025Versatile Framework for Song Generation with Prompt-based Controlcited by 4
- 2025Conan: A Chunkwise Online Network for Zero-Shot Adaptive Voice Conversioncited by 4
- 2025DiTSinger: Scaling Singing Voice Synthesis with Diffusion Transformer and Implicit Alignmentcited by 3
- 2026SoulX-Singer: Towards High-Quality Zero-Shot Singing Voice Synthesiscited by 3
17 more
- 2026WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Trainingcited by 3
- 2025YingMusic-SVC: Real-World Robust Zero-Shot Singing Voice Conversion with Flow-GRPO and Singing-Specific Inductive Biasescited by 2
- 2026Sylber 2.0: A Universal Syllable Embeddingcited by 2
- 2025Controllable Singing Voice Synthesis using Phoneme-Level Energy Sequencecited by 1
- 2025R2-SVC: Towards Real-World Robust and Expressive Zero-shot Singing Voice Conversioncited by 1
- 2026Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Modelscited by 1
- 2025Leveraging Pretrained Diffusion Models for Zero-Shot Part Assemblycited by 0
- 2025SLEEPING-DISCO 9M: A large-scale pre-training dataset for generative music modelingcited by 0
- 2026SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialnesscited by 0
- 2026Controllable Singing Style Conversion with Boundary-Aware Information Bottleneckcited by 0
- 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Modelscited by 0
- 2026Towards Streaming Synchronized Spatial Audio Generation via Autoregressive Diffusion Transformercited by 0
- 2026Vibrato Expression Control for Singing Voice Conversion with Improving Independent Controlcited by 0
- 2026MPEcho: A Melody and Phoneme-Aware Generative Framework for Controllable Cover Song Generationcited by 0
- 2026VocalRender: Score-Native Singing Voice Synthesis for Real-World Compositioncited by 0
- 2026CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generationcited by 0
- 2026Vocal Music under Phoneme-Conditional Analysiscited by 0
- 2026Vocal Music under Phoneme-Conditional Analysis31 Aug 2026
- 2026CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generation12 Aug 2026
- 2026VocalRender: Score-Native Singing Voice Synthesis for Real-World Composition30 Jul 2026
- 2026MPEcho: A Melody and Phoneme-Aware Generative Framework for Controllable Cover Song Generation29 Jul 2026
- 2026Vibrato Expression Control for Singing Voice Conversion with Improving Independent Control15 Jun 2026
- 2026Towards Streaming Synchronized Spatial Audio Generation via Autoregressive Diffusion Transformer29 May 2026
- 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Models6 May 2026
- 2026WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Training16 Apr 2026
- 2026Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Models16 Apr 2026
- 2026Controllable Singing Style Conversion with Boundary-Aware Information Bottleneck7 Apr 2026
- 2026SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness16 Mar 2026
- 2026SoulX-Singer: Towards High-Quality Zero-Shot Singing Voice Synthesis8 Feb 2026
17 more
- 2026Sylber 2.0: A Universal Syllable Embedding29 Jan 2026
- 2025YingMusic-SVC: Real-World Robust Zero-Shot Singing Voice Conversion with Flow-GRPO and Singing-Specific Inductive Biases4 Dec 2025
- 2025YingMusic-Singer: Zero-shot Singing Voice Synthesis and Editing with Annotation-free Melody Guidance4 Dec 2025
- 2025R2-SVC: Towards Real-World Robust and Expressive Zero-shot Singing Voice Conversion23 Oct 2025
- 2025DiTSinger: Scaling Singing Voice Synthesis with Diffusion Transformer and Implicit Alignment10 Oct 2025
- 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessment2 Oct 2025
- 2025SongPrep: A Preprocessing Framework and End-to-end Model for Full-song Structure Parsing and Lyrics Transcription22 Sep 2025
- 2025Controllable Singing Voice Synthesis using Phoneme-Level Energy Sequence8 Sep 2025
- 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generation22 Aug 2025
- 2025Conan: A Chunkwise Online Network for Zero-Shot Adaptive Voice Conversion19 Jul 2025
- 2025SLEEPING-DISCO 9M: A large-scale pre-training dataset for generative music modeling17 Jun 2025
- 2025GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chains24 May 2025
- 2025TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis20 May 2025
- 2025Leveraging Pretrained Diffusion Models for Zero-Shot Part Assembly1 May 2025
- 2025Versatile Framework for Song Generation with Prompt-based Control27 Apr 2025
- 2024AV-Odyssey Bench: Can Your Multimodal LLMs Really Understand Audio-Visual Information?3 Dec 2024
- 2024TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control24 Sep 2024
- 2024TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Controlcited by 20
- 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessmentcited by 7
- 2025TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesiscited by 5
- 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generationcited by 5
- 2025SongPrep: A Preprocessing Framework and End-to-end Model for Full-song Structure Parsing and Lyrics Transcriptioncited by 5
- 2025YingMusic-Singer: Zero-shot Singing Voice Synthesis and Editing with Annotation-free Melody Guidancecited by 5
- 2025Versatile Framework for Song Generation with Prompt-based Controlcited by 4
- 2025Conan: A Chunkwise Online Network for Zero-Shot Adaptive Voice Conversioncited by 4
- 2026SoulX-Singer: Towards High-Quality Zero-Shot Singing Voice Synthesiscited by 3
- 2026WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Trainingcited by 3
- 2025YingMusic-SVC: Real-World Robust Zero-Shot Singing Voice Conversion with Flow-GRPO and Singing-Specific Inductive Biasescited by 2
- 2026Sylber 2.0: A Universal Syllable Embeddingcited by 2
12 most cited of 22 All 22 (JSON)
- 2026Vocal Music under Phoneme-Conditional Analysis31 Aug 2026
- 2026CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generation12 Aug 2026
- 2026VocalRender: Score-Native Singing Voice Synthesis for Real-World Composition30 Jul 2026
- 2026MPEcho: A Melody and Phoneme-Aware Generative Framework for Controllable Cover Song Generation29 Jul 2026
- 2026Vibrato Expression Control for Singing Voice Conversion with Improving Independent Control15 Jun 2026
- 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Models6 May 2026
- 2026WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Training16 Apr 2026
- 2026Controllable Singing Style Conversion with Boundary-Aware Information Bottleneck7 Apr 2026
- 2026SoulX-Singer: Towards High-Quality Zero-Shot Singing Voice Synthesis8 Feb 2026
- 2026Sylber 2.0: A Universal Syllable Embedding29 Jan 2026
- 2025YingMusic-SVC: Real-World Robust Zero-Shot Singing Voice Conversion with Flow-GRPO and Singing-Specific Inductive Biases4 Dec 2025
- 2025YingMusic-Singer: Zero-shot Singing Voice Synthesis and Editing with Annotation-free Melody Guidance4 Dec 2025
12 newest of 22 All 22 (JSON)