TTS Skins: Speaker Conversion via ASR
Not on the map. Why?
Abstract (arXiv)
We present a fully convolutional wav-to-wav network for converting between speakers' voices, without relying on text. Our network is based on an encoder-decoder architecture, where the encoder is pre-trained for the task of Automatic Speech Recognition, and a multi-speaker waveform decoder is trained to reconstruct the original signal in an autoregressive manner. We train the network on narrated audiobooks, and demonstrate multi-voice TTS in those voices, by converting the voice of a TTS robot.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 3; 2023: 0; 2024: 3; 2025: 1; 2026: 1.
14 papers.
Sort:
By area:
- 2021Generative Spoken Language Modeling from Raw Audiocited by 340
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 50
- 2021Textless Speech Emotion Conversion using Discrete and Decomposed Representationscited by 29
- 2022Zero-Shot Voice Conditioning for Denoising Diffusion TTS Modelscited by 20
- 2024PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Datasetcited by 16
- 2021Assem-VC: Realistic Voice Conversion by Assembling Modern Speech Synthesis Techniquescited by 11
- 2021High Fidelity Speech Regeneration with Application to Speech Enhancementcited by 10
- 2021Discovery of Single Independent Latent Variablecited by 3
- 2022HiFi-VC: High Quality ASR-Based Voice Conversioncited by 3
- 2025Towards Generalizable Deepfake Detection via Forgery-aware Audio-Visual Adaptation: A Variational Bayesian Approachcited by 1
- 2026UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perception29 May 2026
- 2025Towards Generalizable Deepfake Detection via Forgery-aware Audio-Visual Adaptation: A Variational Bayesian Approach24 Nov 2025
- 2024Deep Learning Technology for Face Forgery Detection: A Survey22 Sep 2024
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection5 Jun 2024
- 2024PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Dataset14 May 2024
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspective20 Nov 2022
- 2022Zero-Shot Voice Conditioning for Denoising Diffusion TTS Models5 Jun 2022
- 2022HiFi-VC: High Quality ASR-Based Voice Conversion31 Mar 2022
- 2021Textless Speech Emotion Conversion using Discrete and Decomposed Representations14 Nov 2021
- 2021Discovery of Single Independent Latent Variable12 Oct 2021
- 2021Assem-VC: Realistic Voice Conversion by Assembling Modern Speech Synthesis Techniques2 Apr 2021
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representations1 Apr 2021
2 more
- 2021Generative Spoken Language Modeling from Raw Audiocited by 340
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 50
- 2021Textless Speech Emotion Conversion using Discrete and Decomposed Representationscited by 29
- 2024PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Datasetcited by 16
- 2021Assem-VC: Realistic Voice Conversion by Assembling Modern Speech Synthesis Techniquescited by 11
- 2021High Fidelity Speech Regeneration with Application to Speech Enhancementcited by 10
- 2021Discovery of Single Independent Latent Variablecited by 3
- 2022HiFi-VC: High Quality ASR-Based Voice Conversioncited by 3
- 2025Towards Generalizable Deepfake Detection via Forgery-aware Audio-Visual Adaptation: A Variational Bayesian Approachcited by 1
- 2024Deep Learning Technology for Face Forgery Detection: A Surveycited by 0
12 most cited of 13 All 13 (JSON)
- 2026UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perception29 May 2026
- 2025Towards Generalizable Deepfake Detection via Forgery-aware Audio-Visual Adaptation: A Variational Bayesian Approach24 Nov 2025
- 2024Deep Learning Technology for Face Forgery Detection: A Survey22 Sep 2024
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection5 Jun 2024
- 2024PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Dataset14 May 2024
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspective20 Nov 2022
- 2022HiFi-VC: High Quality ASR-Based Voice Conversion31 Mar 2022
- 2021Textless Speech Emotion Conversion using Discrete and Decomposed Representations14 Nov 2021
- 2021Discovery of Single Independent Latent Variable12 Oct 2021
- 2021Assem-VC: Realistic Voice Conversion by Assembling Modern Speech Synthesis Techniques2 Apr 2021
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representations1 Apr 2021
- 2021Generative Spoken Language Modeling from Raw Audio1 Feb 2021
12 newest of 13 All 13 (JSON)