mlsanityData to 7 Oct 2026

GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks

arXiv 2409.13832 ↗First posted 20 Sep 2024eess.AS cs.CL cs.SDcited by 29

Not on the map. Why?

Abstract (arXiv)

The scarcity of high-quality and multi-task singing datasets significantly hinders the development of diverse controllable and personalized singing tasks, as existing singing datasets suffer from low quality, limited diversity of languages and singers, absence of multi-technique information and realistic music scores, and poor task suitability. To tackle these problems, we present GTSinger, a large global, multi-technique, free-to-use, high-quality singing corpus with realistic music scores, designed for all singing tasks, along with its benchmarks. Particularly, (1) we collect 80.59 hours of high-quality singing voices, forming the largest recorded singing dataset; (2) 20 professional singers across nine widely spoken languages offer diverse timbres and styles; (3) we provide controlled comparison and phoneme-level annotations of six commonly used singing techniques, helping technique modeling and control; (4) GTSinger offers realistic music scores, assisting real-world musical composition; (5) singing voices are accompanied by manual phoneme-to-audio alignments, global style labels, and 16.16 hours of paired speech for various singing tasks. Moreover, to facilitate the use of GTSinger, we conduct four benchmark experiments: technique-controllable singing voice synthesis, technique recognition, style transfer, and speech-to-singing conversion. The demos can be found at http://aaronz345.github.io/GTSingerDemo/. We provide the dataset and the code for processing data and conducting benchmarks at https://huggingface.co/datasets/AaronZ345/GTSinger and https://github.com/AaronZ345/GTSinger.

Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 18 of its 35 references that are in the map. First posted on arXiv 20 Sep 2024.

Builds on

18 of 35 references.

References · 18

  1. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  2. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  3. 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
  4. 2021Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpuscited by 60
  5. 2023SingSong: Generating musical accompaniments from singingcited by 54
  6. 2022Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesiscited by 53
  7. 2021VISinger: Variational Inference with Adversarial Learning for End-to-End Singing Voice Synthesiscited by 38
  8. 2023RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Musiccited by 27
  9. 2023StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesiscited by 21
  10. 2020NHSS: A Speech and Singing Parallel Databasecited by 16
  11. 2020JVS-MuSiC: Japanese multispeaker singing-voice corpuscited by 14
  12. 2023RMSSinger: Realistic-Music-Score based Singing Voice Synthesiscited by 12
6 more
  1. 2022Learning the Beauty in Songs: Neural Singing Voice Beautifiercited by 10
  2. 2023Self-Supervised Representations for Singing Voice Conversioncited by 8
  3. 2022WeSinger: Data-augmented Singing Voice Synthesis with Auxiliary Lossescited by 7
  4. 2022MuSE-SVS: Multi-Singer Emotional Singing Voice Synthesizer that Controls Emotional Intensitycited by 6
  5. 2022Robust One-Shot Singing Voice Conversioncited by 5
  6. 2023AlignSTS: Speech-to-Singing Conversion via Cross-Modal Alignmentcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 14; 2026: 13.

29 papers.

Sort:

By area:

  1. 2024AV-Odyssey Bench: Can Your Multimodal LLMs Really Understand Audio-Visual Information?cited by 46
  2. 2024TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Controlcited by 20
  3. 2025GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chainscited by 14
  4. 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessmentcited by 7
  5. 2025TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesiscited by 5
  6. 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generationcited by 5
  7. 2025SongPrep: A Preprocessing Framework and End-to-end Model for Full-song Structure Parsing and Lyrics Transcriptioncited by 5
  8. 2025YingMusic-Singer: Zero-shot Singing Voice Synthesis and Editing with Annotation-free Melody Guidancecited by 5
  9. 2025Versatile Framework for Song Generation with Prompt-based Controlcited by 4
  10. 2025Conan: A Chunkwise Online Network for Zero-Shot Adaptive Voice Conversioncited by 4
  11. 2025DiTSinger: Scaling Singing Voice Synthesis with Diffusion Transformer and Implicit Alignmentcited by 3
  12. 2026SoulX-Singer: Towards High-Quality Zero-Shot Singing Voice Synthesiscited by 3
17 more
  1. 2026WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Trainingcited by 3
  2. 2025YingMusic-SVC: Real-World Robust Zero-Shot Singing Voice Conversion with Flow-GRPO and Singing-Specific Inductive Biasescited by 2
  3. 2026Sylber 2.0: A Universal Syllable Embeddingcited by 2
  4. 2025Controllable Singing Voice Synthesis using Phoneme-Level Energy Sequencecited by 1
  5. 2025R2-SVC: Towards Real-World Robust and Expressive Zero-shot Singing Voice Conversioncited by 1
  6. 2026Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Modelscited by 1
  7. 2025Leveraging Pretrained Diffusion Models for Zero-Shot Part Assemblycited by 0
  8. 2025SLEEPING-DISCO 9M: A large-scale pre-training dataset for generative music modelingcited by 0
  9. 2026SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialnesscited by 0
  10. 2026Controllable Singing Style Conversion with Boundary-Aware Information Bottleneckcited by 0
  11. 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Modelscited by 0
  12. 2026Towards Streaming Synchronized Spatial Audio Generation via Autoregressive Diffusion Transformercited by 0
  13. 2026Vibrato Expression Control for Singing Voice Conversion with Improving Independent Controlcited by 0
  14. 2026MPEcho: A Melody and Phoneme-Aware Generative Framework for Controllable Cover Song Generationcited by 0
  15. 2026VocalRender: Score-Native Singing Voice Synthesis for Real-World Compositioncited by 0
  16. 2026CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generationcited by 0
  17. 2026Vocal Music under Phoneme-Conditional Analysiscited by 0