VoxMorph: Scalable Zero-shot Voice Identity Morphing via Disentangled Embeddings
Not on the map. Why?
Abstract (arXiv)
Morphing techniques generate artificial biometric samples that combine features from multiple individuals, allowing each contributor to be verified against a single enrolled template. While extensively studied in face recognition, this vulnerability remains largely unexplored in voice biometrics. Prior work on voice morphing is computationally expensive, non-scalable, and limited to acoustically similar identity pairs, constraining practical deployment. Moreover, existing sound-morphing methods target audio textures, music, or environmental sounds and are not transferable to voice identity manipulation. We propose VoxMorph, a zero-shot framework that produces high-fidelity voice morphs from as little as five seconds of audio per subject without model retraining. Our method disentangles vocal traits into prosody and timbre embeddings, enabling fine-grained interpolation of speaking style and identity. These embeddings are fused via Spherical Linear Interpolation (Slerp) and synthesized using an autoregressive language model coupled with a Conditional Flow Matching network. VoxMorph achieves state-of-the-art performance, delivering a 2.6x gain in audio quality, a 73% reduction in intelligibility errors, and a 67.8% morphing attack success rate on automated speaker verification systems under strict security thresholds. This work establishes a practical and scalable paradigm for voice morphing with significant implications for biometric security. The code and dataset are available on our project page: https://vcbsl.github.io/VoxMorph/
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 27 Jan 2026.
Builds on
23 of 32 references.
References · 23
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
- 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 323
- 2017Generalized End-to-End Loss for Speaker Verificationcited by 290
- 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 282
- 2018Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesiscited by 280
- 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 277
- 2018Fr'echet Audio Distance: A Metric for Evaluating Music Enhancement Algorithmscited by 221
- 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 118
11 more
- 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 95
- 2020Face Morphing Attack Generation & Detection: A Comprehensive Surveycited by 63
- 2025Vevo: Controllable Zero-Shot Voice Imitation with Self-Supervised Disentanglementcited by 34
- 2022Morphing Attack Potentialcited by 15
- 2023Towards Controllable Audio Texture Morphingcited by 4
- 2024MorphFader: Enabling Fine-grained Controllable Morphing with Text-to-Audio Modelscited by 4
- 2024SoundMorpher: Perceptually-Uniform Sound Morphing with Diffusion Modelcited by 3
- 2025WaveVerify: A Novel Audio Watermarking Framework for Media Authentication and Combatting Deepfakescited by 3
- 2023Voice Morphing: Two Identities in One Voicecited by 2
- 2025AdaptVC: High Quality Voice Conversion with Adaptive Learningcited by 1
- 2025DOOMGAN:High-Fidelity Dynamic Identity Obfuscation Ocular Generative Morphingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Imaginary Voice: Face-styled Diffusion Model for Text-to-Speech
- 2026ID-LoRA: Identity-Driven Audio-Video Personalization with In-Context LoRA
- 2024CoDiff-VC: A Codec-Assisted Diffusion Model for Zero-shot Voice Conversion
- 2026A Comprehensive Study of Content Representations for Speech Synthesis
- 2025Discl-VC: Disentangled Discrete Tokens and In-Context Learning for Controllable Zero-Shot Voice Conversion
- 2024Zero-shot Voice Conversion with Diffusion Transformers
- 2025Emotional Face-to-Speech
- 2026Speaker Identity in Non-Verbal Vocalizations: Conditional Distillation and Mixture of Experts Approach