mlsanityData to 14 Oct 2026

R2-SVC: Towards Real-World Robust and Expressive Zero-shot Singing Voice Conversion

arXiv 2510.20677 ↗First posted 23 Oct 2025cs.SD cs.AI eess.AScited by 1

Not on the map. Why?

Abstract (arXiv)

In real-world singing voice conversion (SVC) applications, environmental noise and the demand for expressive output pose significant challenges. Conventional methods, however, are typically designed without accounting for real deployment scenarios, as both training and inference usually rely on clean data. This mismatch hinders practical use, given the inevitable presence of diverse noise sources and artifacts from music separation. To tackle these issues, we propose R2-SVC, a robust and expressive SVC framework. First, we introduce simulation-based robustness enhancement through random fundamental frequency (F0) perturbations and music separation artifact simulations (e.g., reverberation, echo), substantially improving performance under noisy conditions. Second, we enrich speaker representation using domain-specific singing data: alongside clean vocals, we incorporate DNSMOS-filtered separated vocals and public singing corpora, enabling the model to preserve speaker timbre while capturing singing style nuances. Third, we integrate the Neural Source-Filter (NSF) model to explicitly represent harmonic and noise components, enhancing the naturalness and controllability of converted singing. R2-SVC achieves state-of-the-art results on multiple SVC benchmarks under both clean and noisy conditions.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 21 references that are in the map. First posted on arXiv 23 Oct 2025.

Builds on

16 of 21 references.

References · 16

  1. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
  2. 2021DNSMOS P.835: A Non-Intrusive Perceptual Objective Speech Quality Metric to Evaluate Noise Suppressorscited by 172
  3. 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
  4. 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 102
  5. 2021Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpuscited by 60
  6. 2022Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesiscited by 53
  7. 2024Zero-shot Voice Conversion with Diffusion Transformerscited by 43
  8. 2024GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Taskscited by 30
  9. 2023Mel-Band RoFormer for Music Source Separationcited by 17
  10. 2020Accent and Speaker Disentanglement in Many-to-many Voice Conversioncited by 15
  11. 2022Learning the Beauty in Songs: Neural Singing Voice Beautifiercited by 10
  12. 2022Noise-robust voice conversion with domain adversarial trainingcited by 5
4 more
  1. 2024SaMoye: Zero-shot Singing Voice Conversion Model Based on Feature Disentanglement and Enhancementcited by 5
  2. 2025FreeSVC: Towards Zero-shot Multilingual Singing Voice Conversioncited by 4
  3. 2021Toward Degradation-Robust Voice Conversioncited by 3
  4. 2025REF-VC: Robust, Expressive and Fast Zero-Shot Voice Conversion with Diffusion Transformerscited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.