mlsanityData to 7 Oct 2026

Dormant: Defending against Pose-driven Human Image Animation

arXiv 2409.14424 ↗First posted 22 Sep 2024cs.CR cs.AI cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Pose-driven human image animation has achieved tremendous progress, enabling the generation of vivid and realistic human videos from just one single photo. However, it conversely exacerbates the risk of image misuse, as attackers may use one available image to create videos involving politics, violence, and other illegal content. To counter this threat, we propose Dormant, a novel protection approach tailored to defend against pose-driven human image animation techniques. Dormant applies protective perturbation to one human image, preserving the visual similarity to the original but resulting in poor-quality video generation. The protective perturbation is optimized to induce misextraction of appearance features from the image and create incoherence among the generated video frames. Our extensive evaluation across 8 animation methods and 4 datasets demonstrates the superiority of Dormant over 6 baseline protection methods, leading to misaligned identities, visual distortions, noticeable artifacts, and inconsistent frames in the generated videos. Moreover, Dormant shows effectiveness on 6 real-world commercial services, even with fully black-box access.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 68 of its 99 references that are in the map. First posted on arXiv 22 Sep 2024.

Builds on

68 of 99 references.

References · 68

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  10. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  11. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  12. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
38 more
  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  2. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  4. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  5. 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
  6. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  8. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  9. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  10. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  11. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  12. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  13. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
  14. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  15. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  16. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
  17. 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 530
  18. 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 484
  19. 2022Diffusion Models for Adversarial Purificationcited by 469
  20. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 343
  21. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  22. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
  23. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  24. 2021Motion Representations for Articulated Animationcited by 253
  25. 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 230
  26. 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
  27. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
  28. 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
  29. 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examplescited by 163
  30. 2023Raising the Cost of Malicious AI-Powered Image Editingcited by 160
  31. 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 158
  32. 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 147
  33. 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
  34. 2022(Certified!!) Adversarial Robustness for Free!cited by 130
  35. 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
  36. 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 114
  37. 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesiscited by 114
  38. 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 3.

9 papers.