mlsanityData to 14 Oct 2026

Controllable Singing Style Conversion with Boundary-Aware Information Bottleneck

arXiv 2604.05526 ↗First posted 7 Apr 2026cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents the submission of the S4 team to the Singing Voice Conversion Challenge 2025 (SVCC2025)-a novel singing style conversion system that advances fine-grained style conversion and control within in-domain settings. To address the critical challenges of style leakage, dynamic rendering, and high-fidelity generation with limited data, we introduce three key innovations: a boundary-aware Whisper bottleneck that pools phoneme-span representations to suppress residual source style while preserving linguistic content; an explicit frame-level technique matrix, enhanced by targeted F0 processing during inference, for stable and distinct dynamic style rendering; and a perceptually motivated high-frequency band completion strategy that leverages an auxiliary standard 48kHz SVC model to augment the high-frequency spectrum, thereby overcoming data scarcity without overfitting. In the official SVCC2025 subjective evaluation, our system achieves the best naturalness performance among all submissions while maintaining competitive results in speaker similarity and technique control, despite using significantly less extra singing data than other top-performing systems. Audio samples are available online.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 44 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

40 of 44 references.

References · 40

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  4. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
  5. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
  6. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
  7. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 300
  8. 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 288
  9. 2024NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Modelscited by 226
  10. 2024MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformercited by 161
  11. 2023Matcha-TTS: A fast TTS architecture with conditional flow matchingcited by 145
  12. 2023Audiobox: Unified Audio Generation with Natural Language Promptscited by 120
28 more
  1. 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 102
  2. 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakerscited by 74
  3. 2022WeNet 2.0: More Productive End-to-End Speech Recognition Toolkitcited by 47
  4. 2021DiffSVC: A Diffusion Probabilistic Model for Singing Voice Conversioncited by 39
  5. 2025Vevo: Controllable Zero-Shot Voice Imitation with Self-Supervised Disentanglementcited by 35
  6. 2023RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Musiccited by 30
  7. 2024GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Taskscited by 30
  8. 2021SingGAN: Generative Adversarial Network For High-Fidelity Singing Voice Generationcited by 27
  9. 2023The Singing Voice Conversion Challenge 2023cited by 25
  10. 2024Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Surveycited by 23
  11. 2023StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesiscited by 21
  12. 2026Chain-of-Thought Compression Should Not Be Blind: V-Skip for Efficient Multimodal Reasoning via Dual-Path Anchoringcited by 21
  13. 2024TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Controlcited by 20
  14. 2026PointCoT: A Multi-modal Benchmark for Explicit 3D Geometric Reasoningcited by 19
  15. 2023LM-VC: Zero-shot Voice Conversion via Speech Generation based on Language Modelscited by 18
  16. 2022VISinger 2: High-Fidelity End-to-End Singing Voice Synthesis Enhanced by Digital Signal Processing Synthesizercited by 14
  17. 2026Not All Queries Need Deep Thought: CoFiCot for Adaptive Coarse-to-fine Stateful Refinementcited by 13
  18. 2026CMHANet: A Cross-Modal Hybrid Attention Network for Point Cloud Registrationcited by 9
  19. 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessmentcited by 7
  20. 2021Zero-shot Voice Conversion via Self-supervised Prosody Representation Learningcited by 6
  21. 2022DSPGAN: a GAN-based universal vocoder for high-fidelity TTS by time-frequency domain supervision from DSPcited by 6
  22. 2023VITS-based Singing Voice Conversion System with DSPGAN post-processing for SVCC2023cited by 5
  23. 2026IGASA: Integrated Geometry-Aware and Skip-Attention Modules for Enhanced Point Cloud Registrationcited by 5
  24. 2022Singing Voice Synthesis with Vibrato Modeling and Latent Energy Representationcited by 4
  25. 2025SYKI-SVC: Advancing Singing Voice Conversion with Post-Processing Innovations and an Open-Source Professional Testsetcited by 2
  26. 2025Serenade: A Singing Style Conversion Framework Based On Audio Infillingcited by 2
  27. 2025An Extensive Analysis of the Singing Voice Conversion Challenge 2025 Evaluation Resultscited by 2
  28. 2026S2Voice: Style-Aware Autoregressive Modeling with Enhanced Conditioning for Singing Style Conversioncited by 1

Built on by

Not cited yet.