mlsanityData to 7 Oct 2026

Audio-Driven Adversarial Defense for 3D Talking Face Generation with totally Visual Fidelity Preservation

arXiv 2608.30951 ↗First posted 31 Aug 2026cs.CV cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

The rapid development of generative portrait models has raised growing concerns about privacy leakage and identity misuse. In particular, audio-driven 3D talking face generation can reconstruct a reusable 3D portrait of a target person from a monocular video and animate it with arbitrary speech, making realistic identity impersonation alarmingly practical. Existing proactive defenses mainly operate in the visual domain by injecting subtle perturbations into acial regions to disrupt identity acquisition. However, such perturbations often compromise visual quality due to the strong structural priors and social sensitivity of human faces, and are easily weakened by common real-world transformations such as resizing. To overcome these limitations, we propose an imperceptible audio defense for audio-driven 3D talking face generation by shifting protection from the visual modality to the audio modality. Specifically,we exploit psychoacoustic masking to hide protective perturbations within perceptually masked frequency regions of the speech signal, thereby reducing perceptual distortion while suppressing reliable facial animation. Extensive experiments demonstrate that the proposed method effectively degrades 3D talking face generation while preserving favorable perceptual quality. These findings highlight psychoacoustically guided audio perturbations as a practical and promising direction for privacy-preserving portrait protection.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 34 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

28 of 34 references.

References · 28

  1. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  2. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
  3. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  4. 2018Audio Adversarial Examples: Targeted Attacks on Speech-to-Textcited by 268
  5. 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
  6. 2020Media Forensics and DeepFakes: an overviewcited by 208
  7. 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examplescited by 163
  8. 2023Raising the Cost of Malicious AI-Powered Image Editingcited by 160
  9. 2018Lip Movements Generation at a Glancecited by 154
  10. 2023GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesiscited by 131
  11. 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
  12. 2019Imperceptible, Robust, and Targeted Adversarial Examples for Automatic Speech Recognitioncited by 123
16 more
  1. 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
  2. 2023Mist: Towards Improved Adversarial Examples for Diffusion Modelscited by 91
  3. 2023SyncTalk: The Devil is in the Synchronization for Talking Head Synthesiscited by 86
  4. 2018Adversarial Attacks Against Automatic Speech Recognition Systems via Psychoacoustic Hidingcited by 83
  5. 2022Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decompositioncited by 81
  6. 2023Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesiscited by 72
  7. 2023Toward effective protection against diffusion based mimicry through score distillationcited by 64
  8. 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
  9. 2018Robust Audio Adversarial Example for a Physical Attackcited by 42
  10. 2021CDPAM: Contrastive learning for perceptual audio similaritycited by 42
  11. 2019Universal Adversarial Perturbations for Speech Recognition Systemscited by 41
  12. 2024Ditto: Motion-Space Diffusion for Controllable Realtime Talking Head Synthesiscited by 41
  13. 2024Edit Away and My Face Will not Stay: Personal Biometric Defense against Malicious Generative Editingcited by 19
  14. 2025InsTaG: Learning Personalized 3D Talking Head from Few-Second Videocited by 18
  15. 2025Silence is Golden: Leveraging Adversarial Examples to Nullify Audio Control in LDM-based Talking-Head Generationcited by 7
  16. 2024NeRF-AD: Neural Radiance Field with Attention-based Disentanglement for Talking Face Synthesiscited by 2

Built on by

Not cited yet.