Efficient and Robust Video Defense Framework against 3D-field Personalized Talking Face
Not on the map. Why?
Abstract (arXiv)
State-of-the-art 3D-field video-referenced Talking Face Generation (TFG) methods synthesize high-fidelity personalized talking-face videos in real time by modeling 3D geometry and appearance from reference portrait video. This capability raises significant privacy concerns regarding malicious misuse of personal portraits. However, no efficient defense framework exists to protect such videos against 3D-field TFG methods. While image-based defenses could apply per-frame 2D perturbations, they incur prohibitive computational costs, severe video quality degradation, failing to disrupt 3D information for video protection. To address this, we propose a novel and efficient video defense framework against 3D-field TFG methods, which protects portrait video by perturbing the 3D information acquisition process while maintain high-fidelity video quality. Specifically, our method introduces: (1) a similarity-guided parameter sharing mechanism for computational efficiency, and (2) a multi-scale dual-domain attention module to jointly optimize spatial-frequency perturbations. Extensive experiments demonstrate that our proposed framework exhibits strong defense capability and achieves a 47x acceleration over the fastest baseline while maintaining high fidelity. Moreover, it remains robust against scaling operations and state-of-the-art purification attacks, and the effectiveness of our design choices is further validated through ablation studies. Our project is available at https://github.com/Richen7418/VDF.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 39 of its 45 references that are in the map. First posted on arXiv 24 Dec 2025.
Builds on
39 of 45 references.
References · 39
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
- 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
- 2022Diffusion Models for Adversarial Purificationcited by 469
- 2019Your Classifier is Secretly an Energy Based Model and You Should Treat it Like Onecited by 402
- 2017Mitigating Adversarial Effects Through Randomizationcited by 382
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
- 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examplescited by 163
- 2023Raising the Cost of Malicious AI-Powered Image Editingcited by 160
27 more
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
- 2018Lip Movements Generation at a Glancecited by 154
- 2021Adversarial purification with Score-based generative modelscited by 132
- 2023GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesiscited by 131
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 120
- 2022Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesiscited by 97
- 2023Mist: Towards Improved Adversarial Examples for Diffusion Modelscited by 91
- 2023SyncTalk: The Devil is in the Synchronization for Talking Head Synthesiscited by 86
- 2022Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decompositioncited by 81
- 2018Low Frequency Adversarial Perturbationcited by 80
- 2022DFA-NeRF: Personalized Talking Head Generation via Disentangled Face Attributes Neural Renderingcited by 80
- 2023Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesiscited by 72
- 2023Toward effective protection against diffusion based mimicry through score distillationcited by 64
- 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 64
- 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
- 2020Stochastic Security: Adversarial Defense Using Long-Run Dynamics of Energy-Based Modelscited by 58
- 2022Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbationscited by 39
- 2023Can Protective Perturbation Safeguard Personal Data from Being Exploited by Stable Diffusion?cited by 37
- 2025InsTaG: Learning Personalized 3D Talking Head from Few-Second Videocited by 18
- 2023JPEG Compressed Images Can Bypass Protections Against AI Editingcited by 14
- 2025SyncTalk++: High-Fidelity and Efficient Synchronized Talking Heads Synthesis Using Gaussian Splattingcited by 9
- 2024FaceShield: Defending Facial Image against Deepfake Threatscited by 8
- 2025Diffusion-based Adversarial Purification from the Perspective of the Frequency Domaincited by 7
- 2025Silence is Golden: Leveraging Adversarial Examples to Nullify Audio Control in LDM-based Talking-Head Generationcited by 7
- 2022Low-Mid Adversarial Perturbation against Unauthorized Face Recognition Systemcited by 4
- 2025ISExplore:Informative Segment Selection for Efficient Personalized 3D Talking Face Generationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.