mlsanityData to 7 Oct 2026

Assem-VC: Realistic Voice Conversion by Assembling Modern Speech Synthesis Techniques

arXiv 2104.00931 ↗First posted 2 Apr 2021eess.AS cs.LG cs.SDcited by 11

Not on the map. Why?

Abstract (arXiv)

Recent works on voice conversion (VC) focus on preserving the rhythm and the intonation as well as the linguistic content. To preserve these features from the source, we decompose current non-parallel VC systems into two encoders and one decoder. We analyze each module with several experiments and reassemble the best components to propose Assem-VC, a new state-of-the-art any-to-many non-parallel VC system. We also examine that PPG and Cotatron features are speaker-dependent, and attempt to remove speaker identity with adversarial training. Code and audio samples are available at https://github.com/mindslab-ai/assem-vc.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 2 Apr 2021.

Builds on

27 of 36 references.

References · 27

  1. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  2. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  3. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  4. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  5. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  6. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
  7. 2016A Learned Representation For Artistic Stylecited by 340
  8. 2018Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesiscited by 280
  9. 2018Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesiscited by 257
  10. 2019AUTOVC: Zero-Shot Voice Style Transfer with Only Autoencoder Losscited by 189
  11. 2020Unsupervised Speech Decomposition via Triple Information Bottleneckcited by 87
  12. 2019Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloningcited by 66
15 more
  1. 2019Mellotron: Multispeaker expressive voice synthesis by conditioning on rhythm, pitch and global style tokenscited by 44
  2. 2018wav2letter++: The Fastest Open-source Speech Recognition Systemcited by 42
  3. 2020F0-consistent many-to-many non-parallel voice conversion via conditional autoencodercited by 35
  4. 2019Blow: a single-scale hyperconditioned flow for non-parallel raw-audio voice conversioncited by 29
  5. 2019Voice Transformer Network: Sequence-to-Sequence Voice Conversion Using Transformer with Text-to-Speech Pretrainingcited by 29
  6. 2019Joint training framework for text-to-speech and voice conversion using multi-source Tacotron and WaveNetcited by 15
  7. 2019TTS Skins: Speaker Conversion via ASRcited by 14
  8. 2020Cotatron: Transcription-Guided Speech Encoder for Any-to-Many Voice Conversion without Parallel Datacited by 14
  9. 2018Improving Sequence-to-Sequence Acoustic Modeling by Adding Text-Supervisioncited by 10
  10. 2020Voice Conversion by Cascading Automatic Speech Recognition and Text-to-Speech Synthesis with Prosody Transfercited by 10
  11. 2019Towards Fine-Grained Prosody Control for Voice Conversioncited by 7
  12. 2020Transferring Source Style in Non-Parallel Voice Conversioncited by 7
  13. 2018Rhythm-Flexible Voice Conversion without Parallel Data Using Cycle-GAN over Phoneme Posteriorgram Sequencescited by 4
  14. 2020Phonetic Posteriorgrams based Many-to-Many Singing Voice Conversion via Adversarial Trainingcited by 4
  15. 2019Bootstrapping non-parallel voice conversion from speaker-adaptive text-to-speechcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 5; 2023: 3; 2024: 0; 2025: 0; 2026: 2.

11 papers.

  1. 2021Diffusion-Based Voice Conversion with Fast Maximum Likelihood Sampling Schemecited by 99
  2. 2022Speaking Style Conversion in the Waveform Domain Using Discrete Self-Supervised Unitscited by 15
  3. 2022JukeDrummer: Conditional Beat-aware Audio-domain Drum Accompaniment Generation via Transformer VQ-VAEcited by 11
  4. 2023Deepfake CAPTCHA: A Method for Preventing Fake Callscited by 7
  5. 2023PITS: Variational Pitch Inference without Fundamental Frequency for End-to-End Pitch-controllable TTScited by 4
  6. 2022HiFi-VC: High Quality ASR-Based Voice Conversioncited by 3
  7. 2023Reimagining Speech: A Scoping Review of Deep Learning-Powered Voice Conversioncited by 3
  8. 2022DisC-VC: Disentangled and F0-Controllable Neural Voice Conversioncited by 0
  9. 2022Artificial ASMR: A Cyber-Psychological Approachcited by 0
  10. 2026Linguistically Augmented Audio Speech Data (LinguAS)cited by 0
  11. 2026Deep-Fake CAPTCHA: Mitigating Next-Generation Social Engineering Attackscited by 0