Dormant: Defending against Pose-driven Human Image Animation
Not on the map. Why?
Abstract (arXiv)
Pose-driven human image animation has achieved tremendous progress, enabling the generation of vivid and realistic human videos from just one single photo. However, it conversely exacerbates the risk of image misuse, as attackers may use one available image to create videos involving politics, violence, and other illegal content. To counter this threat, we propose Dormant, a novel protection approach tailored to defend against pose-driven human image animation techniques. Dormant applies protective perturbation to one human image, preserving the visual similarity to the original but resulting in poor-quality video generation. The protective perturbation is optimized to induce misextraction of appearance features from the image and create incoherence among the generated video frames. Our extensive evaluation across 8 animation methods and 4 datasets demonstrates the superiority of Dormant over 6 baseline protection methods, leading to misaligned identities, visual distortions, noticeable artifacts, and inconsistent frames in the generated videos. Moreover, Dormant shows effectiveness on 6 real-world commercial services, even with fully black-box access.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 68 of its 99 references that are in the map. First posted on arXiv 22 Sep 2024.
Builds on
68 of 99 references.
References · 68
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
38 more
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
- 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 530
- 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 484
- 2022Diffusion Models for Adversarial Purificationcited by 469
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 343
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2021Motion Representations for Articulated Animationcited by 253
- 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 230
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
- 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examplescited by 163
- 2023Raising the Cost of Malicious AI-Powered Image Editingcited by 160
- 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 158
- 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 147
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
- 2022(Certified!!) Adversarial Robustness for Free!cited by 130
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
- 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 114
- 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesiscited by 114
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2025: 6; 2026: 3.
9 papers.
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safetycited by 63
- 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 60
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2025DreamActor-H1: High-Fidelity Human-Product Demonstration Video Generation via Motion-designed Diffusion Transformerscited by 19
- 2026Anti-I2V: Safeguarding your photos from malicious image-to-video generationcited by 5
- 2025Taming Consistency Distillation for Accelerated Human Image Animationcited by 2
- 2025SAP-DIFF: Semantic Adversarial Patch Generation for Black-Box Face Recognition Models via Diffusion Modelscited by 0
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecyclecited by 0
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalitiescited by 0
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities28 Aug 2026
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecycle5 Aug 2026
- 2026Anti-I2V: Safeguarding your photos from malicious image-to-video generation25 Mar 2026
- 2025DreamActor-H1: High-Fidelity Human-Product Demonstration Video Generation via Motion-designed Diffusion Transformers12 Jun 2025
- 2025Taming Consistency Distillation for Accelerated Human Image Animation15 Apr 2025
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidance2 Apr 2025
- 2025SAP-DIFF: Semantic Adversarial Patch Generation for Black-Box Face Recognition Models via Diffusion Models27 Feb 2025
- 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordance10 Feb 2025
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safety2 Feb 2025