mlsanityData to 14 Oct 2026

LCM-SVC: Latent Diffusion Model Based Singing Voice Conversion with Inference Acceleration via Latent Consistency Distillation

arXiv 2408.12354 ↗First posted 22 Aug 2024eess.AS cs.SDcited by 2

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Any-to-any singing voice conversion (SVC) aims to transfer a target singer's timbre to other songs using a short voice sample. However many diffusion model based any-to-any SVC methods, which have achieved impressive results, usually suffered from low efficiency caused by a mass of inference steps. In this paper, we propose LCM-SVC, a latent consistency distillation (LCD) based latent diffusion model (LDM) to accelerate inference speed. We achieved one-step or few-step inference while maintaining the high performance by distilling a pre-trained LDM based SVC model, which had the advantages of timbre decoupling and sound quality. Experimental results show that our proposed method can significantly reduce the inference time and largely preserve the sound quality and timbre similarity comparing with other state-of-the-art SVC models. Audio samples are available at https://sounddemos.github.io/lcm-svc.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 24 of its 26 references that are in the map. First posted on arXiv 22 Aug 2024.

Builds on

24 of 26 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024LDM-SVC: Latent Diffusion Model Based Zero-Shot Any-to-Any Singing Voice Conversion with Singer Guidance8 Jun
  2. 2024CoMoSVC: Consistency Model-based Singing Voice Conversion3 Jan
  3. 2021DiffSVC: A Diffusion Probabilistic Model for Singing Voice Conversion28 May

Other references · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2022Classifier-Free Diffusion Guidancecited by 5,847
  5. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  6. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  7. 2023Consistency Modelscited by 1,822
  8. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  9. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
  10. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  11. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  12. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
9 more
  1. 2018CREPE: A Convolutional Representation for Pitch Estimationcited by 110
  2. 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 102
  3. 2021Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpuscited by 60
  4. 2019Neural source-filter waveform models for statistical parametric speech synthesiscited by 46
  5. 2020Unsupervised Cross-Domain Singing Voice Conversioncited by 23
  6. 2020ByteSing: A Chinese Singing Voice Synthesis System Using Duration Allocated Encoder-Decoder Acoustic Models and WaveRNN Vocoderscited by 21
  7. 2020FastSVC: Fast Cross-Domain Singing Voice Conversion with Feature-wise Linear Modulationcited by 21
  8. 2019Singing Voice Conversion with Disentangled Representations of Singer and Vocal Technique Using Variational Autoencoderscited by 18
  9. 2021Cross-speaker Emotion Transfer Based on Speaker Condition Layer Normalization and Semi-Supervised Training in Text-To-Speechcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 1.

2 papers.

  1. 2024LHQ-SVC: Lightweight and High Quality Singing Voice Conversion Modelingcited by 2
  2. 2026Vibrato Expression Control for Singing Voice Conversion with Improving Independent Controlcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Mitigating Latent Mismatch in cVAE-Based Singing Voice Synthesis via Flow Matching
  2. 2026Poly-SVC: Polyphony-Aware Singing Voice Conversion with Harmonic Modeling ↗
  3. 2024RDSinger: Reference-based Diffusion Network for Singing Voice Synthesis
  4. 2026Adapting Diffusion-Based Music Synthesis to Speech and Singing Voice Conversion
  5. 2025Efficient and Fast Generative-Based Singing Voice Separation using a Latent Diffusion Model
  6. 2023HiddenSinger: High-Quality Singing Voice Synthesis via Neural Audio Codec and Latent Diffusion Models
  7. 2025Adapting Speech Language Model to Singing Voice Synthesis ↗
  8. 2025DiTSinger: Scaling Singing Voice Synthesis with Diffusion Transformer and Implicit Alignment