mlsanityData to 7 Oct 2026

DiTSinger: Scaling Singing Voice Synthesis with Diffusion Transformer and Implicit Alignment

arXiv 2510.09016 ↗First posted 10 Oct 2025cs.SD cs.AI eess.AScited by 3

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Recent progress in diffusion-based Singing Voice Synthesis (SVS) demonstrates strong expressiveness but remains limited by data scarcity and model scalability. We introduce a two-stage pipeline: a compact seed set of human-sung recordings is constructed by pairing fixed melodies with diverse LLM-generated lyrics, and melody-specific models are trained to synthesize over 500 hours of high-quality Chinese singing data. Building on this corpus, we propose DiTSinger, a Diffusion Transformer with RoPE and qk-norm, systematically scaled in depth, width, and resolution for enhanced fidelity. Furthermore, we design an implicit alignment mechanism that obviates phoneme-level duration labels by constraining phoneme-to-acoustic attention within character-level spans, thereby improving robustness under noisy or uncertain alignments. Extensive experiments validate that our approach enables scalable, alignment-free, and high-fidelity SVS.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 16 of its 21 references that are in the map. First posted on arXiv 10 Oct 2025.

Builds on

16 of 21 references.

References · 16

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2022Scalable Diffusion Models with Transformerscited by 5,931
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  5. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  6. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  7. 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
  8. 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
  9. 2020XiaoiceSing: A High-Quality and Integrated Singing Voice Synthesis Systemcited by 33
  10. 2020DeepSinger: Singing Voice Synthesis with Data Mined From the Webcited by 32
  11. 2024GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Taskscited by 29
  12. 2023StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesiscited by 21
4 more
  1. 2024TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Controlcited by 20
  2. 2023A Review of Differentiable Digital Signal Processing for Music & Speech Synthesiscited by 19
  3. 2025TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matchingcited by 19
  4. 2023RMSSinger: Realistic-Music-Score based Singing Voice Synthesiscited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025YingMusic-Singer: Zero-shot Singing Voice Synthesis and Editing with Annotation-free Melody Guidance
  2. 2025SmoothSinger: A Conditional Diffusion Model for Singing Voice Synthesis with Multi-Resolution Architecture
  3. 2026Adapting Diffusion-Based Music Synthesis to Speech and Singing Voice Conversion
  4. 2024RDSinger: Reference-based Diffusion Network for Singing Voice Synthesis
  5. 2023HiddenSinger: High-Quality Singing Voice Synthesis via Neural Audio Codec and Latent Diffusion Models
  6. 2024ConSinger: Efficient High-Fidelity Singing Voice Generation with Minimal Steps
  7. 2026Mitigating Latent Mismatch in cVAE-Based Singing Voice Synthesis via Flow Matching
  8. 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers