StarGAN-VC: Non-parallel many-to-many voice conversion with star generative adversarial networks
Not on the map. Why?
Abstract (arXiv)
This paper proposes a method that allows non-parallel many-to-many voice conversion (VC) by using a variant of a generative adversarial network (GAN) called StarGAN. Our method, which we call StarGAN-VC, is noteworthy in that it (1) requires no parallel utterances, transcriptions, or time alignment procedures for speech generator training, (2) simultaneously learns many-to-many mappings across different attribute domains using a single generator network, (3) is able to generate converted speech signals quickly enough to allow real-time implementations and (4) requires only several minutes of training examples to generate reasonably realistic-sounding speech. Subjective evaluation experiments on a non-parallel many-to-many speaker identity conversion task revealed that the proposed method obtained higher sound quality and speaker similarity than a state-of-the-art method based on variational autoencoding GANs.
Key facts. Cited by 78 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 16; 2023: 11; 2024: 7; 2025: 12; 2026: 6.
78 papers.
Sort:
By area:
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
- 2021Emotional Voice Conversion: Theory, Databases and ESDcited by 113
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakerscited by 73
- 2021VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice Conversioncited by 63
- 2022An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Eracited by 32
- 2022Noise-robust Speech Recognition with 10 Minutes Unparalleled In-domain Datacited by 30
- 2022Robust Disentangled Variational Speech Representation Learning for Zero-shot Voice Conversioncited by 28
- 2021Towards Relatable Explainable AI with the Perceptual Processcited by 27
- 2021MaskCycleGAN-VC: Learning Non-parallel Voice Conversion with Filling in Framescited by 18
- 2022Personalized Adversarial Data Augmentation for Dysarthric and Elderly Speech Recognitioncited by 16
- 2022Speaking Style Conversion in the Waveform Domain Using Discrete Self-Supervised Unitscited by 15
38 more
- 2021"Hello, It's Me": Deep Learning-based Speech Synthesis Attacks in the Real Worldcited by 12
- 2021Style Equalization: Unsupervised Learning of Controllable Generative Sequence Modelscited by 11
- 2022Towards Improved Zero-shot Voice Conversion with Conditional DSVAEcited by 10
- 2021NVC-Net: End-to-End Adversarial Voice Conversioncited by 9
- 2022Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detectioncited by 9
- 2022SpecRNet: Towards Faster and More Accessible Audio DeepFake Detectioncited by 9
- 2024Latent Diffusion Bridges for Unsupervised Musical Audio Timbre Transfercited by 9
- 2021VocBench: A Neural Vocoder Benchmark for Speech Synthesiscited by 8
- 2023Face-Driven Zero-Shot Voice Conversion with Memory-based Face-Voice Alignmentcited by 8
- 2024DurFlex-EVC: Duration-Flexible Emotional Voice Conversion Leveraging Discrete Representations without Text Alignmentcited by 8
- 2021An Improved StarGAN for Emotional Voice Conversion: Enhancing Voice Quality and Data Augmentationcited by 7
- 2021Training Robust Zero-Shot Voice Conversion Models with Self-supervised Featurescited by 7
- 2022Trusted Media Challenge Dataset and User Studycited by 7
- 2024Enhancing the Stability of LLM-based Speech Generation Systems through Self-Supervised Representationscited by 7
- 2024FastVoiceGrad: One-step Diffusion-Based Voice Conversion with Adversarial Conditional Diffusion Distillationcited by 7
- 2021Review of end-to-end speech synthesis technology based on deep learningcited by 6
- 2021Global Rhythm Style Transfer Without Text Transcriptionscited by 6
- 2021Zero-shot Voice Conversion via Self-supervised Prosody Representation Learningcited by 6
- 2021How Deep Are the Fakes? Focusing on Audio Deepfake: A Surveycited by 6
- 2022Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graphcited by 6
- 2023Towards General-Purpose Text-Instruction-Guided Voice Conversioncited by 6
- 2023CSLP-AE: A Contrastive Split-Latent Permutation Autoencoder Framework for Zero-Shot Electroencephalography Signal Conversioncited by 6
- 2021StarGAN-based Emotional Voice Conversion for Japanese Phrasescited by 4
- 2021NoiseVC: Towards High Quality Zero-Shot Voice Conversioncited by 4
- 2021StarGAN-ZSVC: Towards Zero-Shot Voice Conversion in Low-Resource Contextscited by 4
- 2021Voicy: Zero-Shot Non-Parallel Voice Conversion in Noisy Reverberant Environmentscited by 4
- 2021Decoupling Speaker-Independent Emotions for Voice Conversion Via Source-Filter Networkscited by 4
- 2022TGAVC: Improving Autoencoder Voice Conversion with Text-Guided and Adversarial Trainingcited by 4
- 2023Catch You and I Can: Revealing Source Voiceprint Against Voice Conversioncited by 4
- 2025ReFlow-VC: Zero-shot Voice Conversion Based on Rectified Flow and Speaker Feature Optimizationcited by 4
- 2025RT-VC: Real-Time Zero-Shot Voice Conversion with Speech Articulatory Codingcited by 4
- 2021An Adaptive Learning based Generative Adversarial Network for One-To-One Voice Conversioncited by 3
- 2021Toward Degradation-Robust Voice Conversioncited by 3
- 2022Speak Like a Dog: Human to Non-human creature Voice Conversioncited by 3
- 2021Conditional Deep Hierarchical Variational Autoencoder for Voice Conversioncited by 2
- 2022GlowVC: Mel-spectrogram space disentangling model for language-independent text-free voice conversioncited by 2
- 2023AlignSTS: Speech-to-Singing Conversion via Cross-Modal Alignmentcited by 2
- 2024Unsupervised Disentanglement of Content and Style via Variance-Invariance Constraintscited by 2
50 most cited of 78 All 78 (JSON)
- 2026MeanVoiceFlow2: Joint Optimization of Mean Flow and Content Encoder for Fast One-Step Zero-Shot Voice Conversion30 Sep 2026
- 2026Adapting Diffusion-Based Music Synthesis to Speech and Singing Voice Conversion14 Jul 2026
- 2026NouveauVoice: Generating Novel Pseudo Speakers for Voice Anonymization4 Jul 2026
- 2026Phoneme-Level Deepfake Detection Across Emotional Conditions Using Self-Supervised Embeddings4 May 2026
- 2026StyleStream: Real-Time Zero-Shot Voice Style Conversion23 Feb 2026
- 2026MeanVoiceFlow: One-step Nonparallel Voice Conversion with Mean Flows20 Feb 2026
- 2025Degrading Voice: A Comprehensive Overview of Robust Voice Conversion Through Input Manipulation6 Dec 2025
- 2025NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset for Voice Conversion31 Oct 2025
- 2025LatentVoiceGrad: Nonparallel Voice Conversion with Latent Diffusion/Flow-Matching Models10 Sep 2025
- 2025Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems9 Sep 2025
- 2025Vocoder-Projected Feature Discriminator25 Aug 2025
- 2025FasterVoiceGrad: Faster One-step Diffusion-Based Voice Conversion with Adversarial Diffusion Conversion Distillation25 Aug 2025
38 more
- 2025A Survey of Threats Against Voice Authentication and Anti-Spoofing Systems22 Aug 2025
- 2025Fast-VGAN: Lightweight Voice Conversion with Explicit Control of F0 and Duration Parameters7 Jul 2025
- 2025IndieFake Dataset: A Benchmark Dataset for Audio Deepfake Detection23 Jun 2025
- 2025RT-VC: Real-Time Zero-Shot Voice Conversion with Speech Articulatory Coding12 Jun 2025
- 2025ReFlow-VC: Zero-shot Voice Conversion Based on Rectified Flow and Speaker Feature Optimization1 Jun 2025
- 2025Generative Adversarial Network based Voice Conversion: Techniques, Challenges, and Recent Advancements27 Apr 2025
- 2024Latent Diffusion Bridges for Unsupervised Musical Audio Timbre Transfer9 Sep 2024
- 2024FastVoiceGrad: One-step Diffusion-Based Voice Conversion with Adversarial Conditional Diffusion Distillation3 Sep 2024
- 2024Pureformer-VC: Non-parallel One-Shot Voice Conversion with Pure Transformer Blocks and Triplet Discriminative Training3 Sep 2024
- 2024Supervised and Unsupervised Alignments for Spoofing Behavioral Biometrics14 Aug 2024
- 2024Unsupervised Disentanglement of Content and Style via Variance-Invariance Constraints4 Jul 2024
- 2024Enhancing the Stability of LLM-based Speech Generation Systems through Self-Supervised Representations5 Feb 2024
- 2024DurFlex-EVC: Duration-Flexible Emotional Voice Conversion Leveraging Discrete Representations without Text Alignment16 Jan 2024
- 2023CSLP-AE: A Contrastive Split-Latent Permutation Autoencoder Framework for Zero-Shot Electroencephalography Signal Conversion13 Nov 2023
- 2023Outlier Detection Using Generative Models with Theoretical Performance Guarantees16 Oct 2023
- 2023Towards General-Purpose Text-Instruction-Guided Voice Conversion25 Sep 2023
- 2023Face-Driven Zero-Shot Voice Conversion with Memory-based Face-Voice Alignment18 Sep 2023
- 2023Voice Conversion with Denoising Diffusion Probabilistic GAN Models28 Aug 2023
- 2023Effects of Convolutional Autoencoder Bottleneck Width on StarGAN-based Singing Technique Conversion19 Aug 2023
- 2023AffectEcho: Speaker Independent and Language-Agnostic Emotion and Affect Transfer for Speech Synthesis16 Aug 2023
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale23 Jun 2023
- 2023Automatic Speech Disentanglement for Voice Conversion using Rank Module and Speech Augmentation21 Jun 2023
- 2023AlignSTS: Speech-to-Singing Conversion via Cross-Modal Alignment8 May 2023
- 2023Catch You and I Can: Revealing Source Voiceprint Against Voice Conversion24 Feb 2023
- 2022Speaking Style Conversion in the Waveform Domain Using Discrete Self-Supervised Units19 Dec 2022
- 2022SpecRNet: Towards Faster and More Accessible Audio DeepFake Detection12 Oct 2022
- 2022An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Era6 Oct 2022
- 2022Boosting Star-GANs for Voice Conversion with Contrastive Discriminator21 Sep 2022
- 2022TGAVC: Improving Autoencoder Voice Conversion with Text-Guided and Adversarial Training8 Aug 2022
- 2022GlowVC: Mel-spectrogram space disentangling model for language-independent text-free voice conversion4 Jul 2022
- 2022Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detection27 Jun 2022
- 2022Speak Like a Dog: Human to Non-human creature Voice Conversion9 Jun 2022
- 2022Personalized Adversarial Data Augmentation for Dysarthric and Elderly Speech Recognition13 May 2022
- 2022Towards Improved Zero-shot Voice Conversion with Conditional DSVAE11 May 2022
- 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakers20 Apr 2022
- 2022Robust Disentangled Variational Speech Representation Learning for Zero-shot Voice Conversion30 Mar 2022
- 2022Enhancing Zero-Shot Many to Many Voice Conversion with Self-Attention VAE30 Mar 2022
- 2022Noise-robust Speech Recognition with 10 Minutes Unparalleled In-domain Data29 Mar 2022
50 newest of 78 All 78 (JSON)
- 2024Latent Diffusion Bridges for Unsupervised Musical Audio Timbre Transfercited by 9
- 2024FastVoiceGrad: One-step Diffusion-Based Voice Conversion with Adversarial Conditional Diffusion Distillationcited by 7
- 2025ReFlow-VC: Zero-shot Voice Conversion Based on Rectified Flow and Speaker Feature Optimizationcited by 4
- 2025FasterVoiceGrad: Faster One-step Diffusion-Based Voice Conversion with Adversarial Diffusion Conversion Distillationcited by 2
- 2025LatentVoiceGrad: Nonparallel Voice Conversion with Latent Diffusion/Flow-Matching Modelscited by 2
- 2026MeanVoiceFlow: One-step Nonparallel Voice Conversion with Mean Flowscited by 1
- 2023Voice Conversion with Denoising Diffusion Probabilistic GAN Modelscited by 0
- 2026Adapting Diffusion-Based Music Synthesis to Speech and Singing Voice Conversioncited by 0
- 2026MeanVoiceFlow2: Joint Optimization of Mean Flow and Content Encoder for Fast One-Step Zero-Shot Voice Conversioncited by 0
- 2026MeanVoiceFlow2: Joint Optimization of Mean Flow and Content Encoder for Fast One-Step Zero-Shot Voice Conversion30 Sep 2026
- 2026Adapting Diffusion-Based Music Synthesis to Speech and Singing Voice Conversion14 Jul 2026
- 2026MeanVoiceFlow: One-step Nonparallel Voice Conversion with Mean Flows20 Feb 2026
- 2025LatentVoiceGrad: Nonparallel Voice Conversion with Latent Diffusion/Flow-Matching Models10 Sep 2025
- 2025FasterVoiceGrad: Faster One-step Diffusion-Based Voice Conversion with Adversarial Diffusion Conversion Distillation25 Aug 2025
- 2025ReFlow-VC: Zero-shot Voice Conversion Based on Rectified Flow and Speaker Feature Optimization1 Jun 2025
- 2024Latent Diffusion Bridges for Unsupervised Musical Audio Timbre Transfer9 Sep 2024
- 2024FastVoiceGrad: One-step Diffusion-Based Voice Conversion with Adversarial Conditional Diffusion Distillation3 Sep 2024
- 2023Voice Conversion with Denoising Diffusion Probabilistic GAN Models28 Aug 2023
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
- 2021Emotional Voice Conversion: Theory, Databases and ESDcited by 113
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakerscited by 73
- 2021VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice Conversioncited by 63
- 2022An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Eracited by 32
- 2022Noise-robust Speech Recognition with 10 Minutes Unparalleled In-domain Datacited by 30
- 2022Robust Disentangled Variational Speech Representation Learning for Zero-shot Voice Conversioncited by 28
- 2021Towards Relatable Explainable AI with the Perceptual Processcited by 27
- 2021MaskCycleGAN-VC: Learning Non-parallel Voice Conversion with Filling in Framescited by 18
- 2022Personalized Adversarial Data Augmentation for Dysarthric and Elderly Speech Recognitioncited by 16
- 2022Speaking Style Conversion in the Waveform Domain Using Discrete Self-Supervised Unitscited by 15
12 most cited of 69 All 69 (JSON)
- 2026NouveauVoice: Generating Novel Pseudo Speakers for Voice Anonymization4 Jul 2026
- 2026Phoneme-Level Deepfake Detection Across Emotional Conditions Using Self-Supervised Embeddings4 May 2026
- 2026StyleStream: Real-Time Zero-Shot Voice Style Conversion23 Feb 2026
- 2025Degrading Voice: A Comprehensive Overview of Robust Voice Conversion Through Input Manipulation6 Dec 2025
- 2025NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset for Voice Conversion31 Oct 2025
- 2025Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems9 Sep 2025
- 2025Vocoder-Projected Feature Discriminator25 Aug 2025
- 2025A Survey of Threats Against Voice Authentication and Anti-Spoofing Systems22 Aug 2025
- 2025Fast-VGAN: Lightweight Voice Conversion with Explicit Control of F0 and Duration Parameters7 Jul 2025
- 2025IndieFake Dataset: A Benchmark Dataset for Audio Deepfake Detection23 Jun 2025
- 2025RT-VC: Real-Time Zero-Shot Voice Conversion with Speech Articulatory Coding12 Jun 2025
- 2025Generative Adversarial Network based Voice Conversion: Techniques, Challenges, and Recent Advancements27 Apr 2025
12 newest of 69 All 69 (JSON)