mlsanityData to 7 Oct 2026

VoxMorph: Scalable Zero-shot Voice Identity Morphing via Disentangled Embeddings

arXiv 2601.20883 ↗First posted 27 Jan 2026cs.SD cs.CR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Morphing techniques generate artificial biometric samples that combine features from multiple individuals, allowing each contributor to be verified against a single enrolled template. While extensively studied in face recognition, this vulnerability remains largely unexplored in voice biometrics. Prior work on voice morphing is computationally expensive, non-scalable, and limited to acoustically similar identity pairs, constraining practical deployment. Moreover, existing sound-morphing methods target audio textures, music, or environmental sounds and are not transferable to voice identity manipulation. We propose VoxMorph, a zero-shot framework that produces high-fidelity voice morphs from as little as five seconds of audio per subject without model retraining. Our method disentangles vocal traits into prosody and timbre embeddings, enabling fine-grained interpolation of speaking style and identity. These embeddings are fused via Spherical Linear Interpolation (Slerp) and synthesized using an autoregressive language model coupled with a Conditional Flow Matching network. VoxMorph achieves state-of-the-art performance, delivering a 2.6x gain in audio quality, a 73% reduction in intelligibility errors, and a 67.8% morphing attack success rate on automated speaker verification systems under strict security thresholds. This work establishes a practical and scalable paradigm for voice morphing with significant implications for biometric security. The code and dataset are available on our project page: https://vcbsl.github.io/VoxMorph/

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 27 Jan 2026.

Builds on

23 of 32 references.

References · 23

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2022Classifier-Free Diffusion Guidancecited by 5,717
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  4. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  5. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
  6. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 323
  7. 2017Generalized End-to-End Loss for Speaker Verificationcited by 290
  8. 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 282
  9. 2018Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesiscited by 280
  10. 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 277
  11. 2018Fr'echet Audio Distance: A Metric for Evaluating Music Enhancement Algorithmscited by 221
  12. 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 118
11 more
  1. 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 95
  2. 2020Face Morphing Attack Generation & Detection: A Comprehensive Surveycited by 63
  3. 2025Vevo: Controllable Zero-Shot Voice Imitation with Self-Supervised Disentanglementcited by 34
  4. 2022Morphing Attack Potentialcited by 15
  5. 2023Towards Controllable Audio Texture Morphingcited by 4
  6. 2024MorphFader: Enabling Fine-grained Controllable Morphing with Text-to-Audio Modelscited by 4
  7. 2024SoundMorpher: Perceptually-Uniform Sound Morphing with Diffusion Modelcited by 3
  8. 2025WaveVerify: A Novel Audio Watermarking Framework for Media Authentication and Combatting Deepfakescited by 3
  9. 2023Voice Morphing: Two Identities in One Voicecited by 2
  10. 2025AdaptVC: High Quality Voice Conversion with Adaptive Learningcited by 1
  11. 2025DOOMGAN:High-Fidelity Dynamic Identity Obfuscation Ocular Generative Morphingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Imaginary Voice: Face-styled Diffusion Model for Text-to-Speech
  2. 2026ID-LoRA: Identity-Driven Audio-Video Personalization with In-Context LoRA
  3. 2024CoDiff-VC: A Codec-Assisted Diffusion Model for Zero-shot Voice Conversion
  4. 2026A Comprehensive Study of Content Representations for Speech Synthesis
  5. 2025Discl-VC: Disentangled Discrete Tokens and In-Context Learning for Controllable Zero-Shot Voice Conversion
  6. 2024Zero-shot Voice Conversion with Diffusion Transformers
  7. 2025Emotional Face-to-Speech
  8. 2026Speaker Identity in Non-Verbal Vocalizations: Conditional Distillation and Mixture of Experts Approach