High Quality Human Image Animation using Regional Supervision and Motion Blur Condition
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent advances in video diffusion models have enabled realistic and controllable human image animation with temporal coherence. Although generating reasonable results, existing methods often overlook the need for regional supervision in crucial areas such as the face and hands, and neglect the explicit modeling for motion blur, leading to unrealistic low-quality synthesis. To address these limitations, we first leverage regional supervision for detailed regions to enhance face and hand faithfulness. Second, we model the motion blur explicitly to further improve the appearance quality. Third, we explore novel training strategies for high-resolution human animation to improve the overall fidelity. Experimental results demonstrate that our proposed method outperforms state-of-the-art approaches, achieving significant improvements upon the strongest baseline by more than 21.0% and 57.4% in terms of reconstruction precision (L1) and perceptual quality (FVD) on HumanDance dataset. Code and model will be made available.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 41 of its 54 references that are in the map. First posted on arXiv 29 Sep 2024.
Builds on
41 of 54 references.
Closest ancestors · 5
Same direction, newest first
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar
- 2023DreaMoving: A Human Video Generation Framework based on Diffusion Models8 Dec
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation28 Nov
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model27 Nov
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
Other references · 36
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2020First Order Motion Model for Image Animationcited by 704
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
24 more
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
- 2018Everybody Dance Nowcited by 315
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
- 2022EDGE: Editable Dance Generation From Musiccited by 287
- 2021Motion Representations for Articulated Animationcited by 255
- 2022Thin-Plate Spline Motion Model for Image Animationcited by 210
- 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 197
- 2023On the Importance of Noise Scheduling for Diffusion Modelscited by 194
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 175
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2019Towards Multi-pose Guided Virtual Try-on Networkcited by 95
- 2021Modeling Clothing as a Separate Layer for an Animatable Human Avatarcited by 66
- 2022AvatarGen: A 3D Generative Model for Animatable Human Avatarscited by 59
- 2020Pose-Guided Human Animation from a Single Image in the Wildcited by 53
- 20193D Guided Fine-Grained Face Manipulationcited by 45
- 2024Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignmentcited by 43
- 20213D Pose Transfer with Correspondence Learning and Mesh Refinementcited by 30
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatarscited by 28
- 2023Bidirectionally Deformable Motion Modulation For Video-based Human Pose Transfercited by 25
- 2022Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstructioncited by 21
- 2023XAGen: 3D Expressive Human Avatars Generationcited by 17
- 2023MoDA: Modeling Deformable 3D Objects from Casual Videoscited by 13
Built on by
Citing papers per year: 2025: 5; 2026: 2.
7 papers.
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2025GAS: Generative Avatar Synthesis from a Single Imagecited by 19
- 2025X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latentscited by 13
- 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimizationcited by 7
- 2025GarmentX: Autoregressive Parametric Representations for High-Fidelity 3D Garment Generationcited by 3
- 2026MotionWeaver: Holistic 4D-Anchored Framework for Multi-Humanoid Image Animationcited by 3
- 2026IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animationcited by 1
- 2026MotionWeaver: Holistic 4D-Anchored Framework for Multi-Humanoid Image Animation11 Feb 2026
- 2026IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animation7 Feb 2026
- 2025X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latents12 Aug 2025
- 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimization15 May 2025
- 2025GarmentX: Autoregressive Parametric Representations for High-Fidelity 3D Garment Generation29 Apr 2025
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidance2 Apr 2025
- 2025GAS: Generative Avatar Synthesis from a Single Image10 Feb 2025
Similar, not cited
Close in wording, no citation either way
- 2025Taming Consistency Distillation for Accelerated Human Image Animation
- 2025High-Fidelity and Long-Duration Human Image Animation with Diffusion Transformer
- 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation
- 2024VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation
- 2025Time-to-Move: Training-Free Motion Controlled Video Generation via Dual-Clock Denoising
- 2025TalkingPose: Efficient Face and Gesture Animation with Feedback-guided Diffusion Model
- 2025Stable Video-Driven Portraits
- 2026ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesis