YingMusic-SVC: Real-World Robust Zero-Shot Singing Voice Conversion with Flow-GRPO and Singing-Specific Inductive Biases
Not on the map. Why?
Abstract (arXiv)
Singing voice conversion (SVC) aims to render the target singer's timbre while preserving melody and lyrics. However, existing zero-shot SVC systems remain fragile in real songs due to harmony interference, F0 errors, and the lack of inductive biases for singing. We propose YingMusic-SVC, a robust zero-shot framework that unifies continuous pre-training, robust supervised fine-tuning, and Flow-GRPO reinforcement learning. Our model introduces a singing-trained RVC timbre shifter for timbre-content disentanglement, an F0-aware timbre adaptor for dynamic vocal expression, and an energy-balanced rectified flow matching loss to enhance high-frequency fidelity. Experiments on a graded multi-track benchmark show that YingMusic-SVC achieves consistent improvements over strong open-source baselines in timbre similarity, intelligibility, and perceptual naturalness, especially under accompanied and harmony-contaminated conditions, demonstrating its effectiveness for real-world SVC deployment.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 36 of its 49 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
36 of 49 references.
References · 36
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
- 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 200
- 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
- 2025Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Soundcited by 129
24 more
- 2019GANSynth: Adversarial Neural Audio Synthesiscited by 114
- 2018CREPE: A Convolutional Representation for Pitch Estimationcited by 109
- 2025LongCat-Video Technical Reportcited by 73
- 2021Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpuscited by 60
- 2022Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesiscited by 53
- 2025FireRedASR: Open-Source Industrial-Grade Mandarin Speech Recognition Models from Encoder-Decoder to LLM Integrationcited by 44
- 2024Zero-shot Voice Conversion with Diffusion Transformerscited by 39
- 2024GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Taskscited by 29
- 2023RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Musiccited by 27
- 2025F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimizationcited by 24
- 2025Advancing Zero-shot Text-to-Speech Intelligibility across Diverse Domains via Preference Alignmentcited by 18
- 2017A Neural Parametric Singing Synthesizercited by 14
- 2022Learning the Beauty in Songs: Neural Singing Voice Beautifiercited by 10
- 2024RFWave: Multi-band Rectified Flow for Audio Waveform Reconstructioncited by 9
- 2019Singing voice conversion with non-parallel datacited by 8
- 2024Mel-RoFormer for Vocal Separation and Vocal Melody Transcriptioncited by 8
- 2024LDM-SVC: Latent Diffusion Model Based Zero-Shot Any-to-Any Singing Voice Conversion with Singer Guidancecited by 6
- 2025FreeSVC: Towards Zero-shot Multilingual Singing Voice Conversioncited by 4
- 2024SPA-SVC: Self-supervised Pitch Augmentation for Singing Voice Conversioncited by 3
- 2024RobustSVC: HuBERT-based Melody Extractor and Adversarial Learning for Robust Singing Voice Conversioncited by 3
- 2025An Extensive Analysis of the Singing Voice Conversion Challenge 2025 Evaluation Resultscited by 2
- 2025HQ-SVC: Towards High-Quality Zero-Shot Singing Voice Conversion in Low-Resource Scenarioscited by 2
- 2025Singing Voice Conversion with Accompaniment Using Self-Supervised Representation-Based Melody Featurescited by 1
- 2025R2-SVC: Towards Real-World Robust and Expressive Zero-shot Singing Voice Conversioncited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
- 2026SoulX-Singer: Towards High-Quality Zero-Shot Singing Voice Synthesis8 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025YingMusic-Singer: Zero-shot Singing Voice Synthesis and Editing with Annotation-free Melody Guidance
- 2025REF-VC: Robust, Expressive and Fast Zero-Shot Voice Conversion with Diffusion Transformers
- 2025DAFMSVC: One-Shot Singing Voice Conversion with Dual Attention Mechanism and Flow Matching
- 2025TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis
- 2026S2Voice: Style-Aware Autoregressive Modeling with Enhanced Conditioning for Singing Style Conversion
- 2026Poly-SVC: Polyphony-Aware Singing Voice Conversion with Harmonic Modeling ↗
- 2025Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow Matching
- 2022Robust One-Shot Singing Voice Conversion