VocalRender: Score-Native Singing Voice Synthesis for Real-World Composition
Not on the map. Why?
Abstract (arXiv)
Existing singing voice synthesis systems often require predefined durations, explicit duration prediction, or time-aligned acoustic guidance, which limits their compatibility with practical composition workflows. We propose VocalRender, a score-native system that directly synthesizes singing from lyrics, pitches, symbolic note values, and tempo. It uses an interleaved lyric--note representation and an autoregressive diffusion model to generate continuous acoustic latents while predicting the output length, eliminating the need for explicit duration prediction. Trained on a 2,300-hour singing dataset, VocalRender achieves strong intelligibility, strong melody control, and high speaker similarity across both in-domain and out-of-domain benchmarks. Notably, it outperforms the strongest baseline by 0.42 points in naturalness CMOS, demonstrating the effectiveness of our proposed score-native architecture.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 39 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
32 of 39 references.
References · 32
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
- 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 200
- 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Trainingcited by 175
- 2026Qwen3-ASR Technical Reportcited by 105
- 2025YuE: Scaling Open Foundation Models for Long-Form Music Generationcited by 68
- 2021Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpuscited by 60
- 2025DiTAR: Diffusion Transformer Autoregressive Modeling for Speech Generationcited by 56
- 2022Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesiscited by 53
- 2020XiaoiceSing: A High-Quality and Integrated Singing Voice Synthesis Systemcited by 33
20 more
- 2020DeepSinger: Singing Voice Synthesis with Data Mined From the Webcited by 32
- 2024GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Taskscited by 29
- 2023RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Musiccited by 27
- 2024TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Controlcited by 20
- 2025TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matchingcited by 19
- 2023Mel-Band RoFormer for Music Source Separationcited by 17
- 2024MuChin: A Chinese Colloquial Description Benchmark for Evaluating Language Models in the Field of Musiccited by 15
- 2022VISinger 2: High-Fidelity End-to-End Singing Voice Synthesis Enhanced by Digital Signal Processing Synthesizercited by 14
- 2025SongFormer: Scaling Music Structure Analysis with Heterogeneous Supervisioncited by 13
- 2024Robust Singing Voice Transcription Serves Synthesiscited by 10
- 2024SingMOS: An extensive Open-Source Singing Voice Dataset for MOS Predictioncited by 9
- 2022g2pW: A Conditional Weighted Softmax BERT for Polyphone Disambiguation in Mandarincited by 7
- 2026Muse: Towards Reproducible Long-Form Song Generation with Fine-Grained Style Controlcited by 7
- 2024TokSing: Singing Voice Synthesis based on Discrete Tokenscited by 6
- 2025YingMusic-Singer: Zero-shot Singing Voice Synthesis and Editing with Annotation-free Melody Guidancecited by 5
- 2024Singing Voice Data Scaling-up: An Introduction to ACE-Opencpop and ACE-KiSingcited by 4
- 2025SingNet: Towards a Large-Scale, Diverse, and In-the-Wild Singing Voice Datasetcited by 3
- 2025DiTSinger: Scaling Singing Voice Synthesis with Diffusion Transformer and Implicit Alignmentcited by 3
- 2026SoulX-Singer: Towards High-Quality Zero-Shot Singing Voice Synthesiscited by 3
- 2025Multi-Accent Mandarin Dry-Vocal Singing Dataset: Benchmark for Singing Accent Recognitioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SmoothSinger: A Conditional Diffusion Model for Singing Voice Synthesis with Multi-Resolution Architecture
- 2026Mitigating Latent Mismatch in cVAE-Based Singing Voice Synthesis via Flow Matching
- 2024ConSinger: Efficient High-Fidelity Singing Voice Generation with Minimal Steps
- 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Models
- 2023HiddenSinger: High-Quality Singing Voice Synthesis via Neural Audio Codec and Latent Diffusion Models
- 2026MeloDISinger: Melody-Aware & Duration-Preserving Singing Voice Editing with Audio Infilling ↗
- 2025Generative Multi-modal Feedback for Singing Voice Synthesis Evaluation
- 2026UniVoice: A Unified Model for Speech and Singing Voice Generation