mlsanityData to 14 Oct 2026

High Quality Human Image Animation using Regional Supervision and Motion Blur Condition

arXiv 2409.19580 ↗First posted 29 Sep 2024cs.CVcited by 7

On the map: Diffusion models → Video generation

Abstract (arXiv)

Recent advances in video diffusion models have enabled realistic and controllable human image animation with temporal coherence. Although generating reasonable results, existing methods often overlook the need for regional supervision in crucial areas such as the face and hands, and neglect the explicit modeling for motion blur, leading to unrealistic low-quality synthesis. To address these limitations, we first leverage regional supervision for detailed regions to enhance face and hand faithfulness. Second, we model the motion blur explicitly to further improve the appearance quality. Third, we explore novel training strategies for high-resolution human animation to improve the overall fidelity. Experimental results demonstrate that our proposed method outperforms state-of-the-art approaches, achieving significant improvements upon the strongest baseline by more than 21.0% and 57.4% in terms of reconstruction precision (L1) and perceptual quality (FVD) on HumanDance dataset. Code and model will be made available.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 41 of its 54 references that are in the map. First posted on arXiv 29 Sep 2024.

Builds on

41 of 54 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar
  2. 2023DreaMoving: A Human Video Generation Framework based on Diffusion Models8 Dec
  3. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation28 Nov
  4. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model27 Nov
  5. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul

Other references · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  5. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  6. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  7. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  8. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
  9. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  10. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  11. 2020First Order Motion Model for Image Animationcited by 704
  12. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
24 more
  1. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
  2. 2018Everybody Dance Nowcited by 315
  3. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
  4. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
  5. 2022EDGE: Editable Dance Generation From Musiccited by 287
  6. 2021Motion Representations for Articulated Animationcited by 255
  7. 2022Thin-Plate Spline Motion Model for Image Animationcited by 210
  8. 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 197
  9. 2023On the Importance of Noise Scheduling for Diffusion Modelscited by 194
  10. 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 175
  11. 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
  12. 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
  13. 2019Towards Multi-pose Guided Virtual Try-on Networkcited by 95
  14. 2021Modeling Clothing as a Separate Layer for an Animatable Human Avatarcited by 66
  15. 2022AvatarGen: A 3D Generative Model for Animatable Human Avatarscited by 59
  16. 2020Pose-Guided Human Animation from a Single Image in the Wildcited by 53
  17. 20193D Guided Fine-Grained Face Manipulationcited by 45
  18. 2024Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignmentcited by 43
  19. 20213D Pose Transfer with Correspondence Learning and Mesh Refinementcited by 30
  20. 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatarscited by 28
  21. 2023Bidirectionally Deformable Motion Modulation For Video-based Human Pose Transfercited by 25
  22. 2022Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstructioncited by 21
  23. 2023XAGen: 3D Expressive Human Avatars Generationcited by 17
  24. 2023MoDA: Modeling Deformable 3D Objects from Casual Videoscited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 2.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Taming Consistency Distillation for Accelerated Human Image Animation
  2. 2025High-Fidelity and Long-Duration Human Image Animation with Diffusion Transformer
  3. 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation
  4. 2024VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation
  5. 2025Time-to-Move: Training-Free Motion Controlled Video Generation via Dual-Clock Denoising
  6. 2025TalkingPose: Efficient Face and Gesture Animation with Feedback-guided Diffusion Model
  7. 2025Stable Video-Driven Portraits
  8. 2026ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesis