Automatic Animation of Hair Blowing in Still Portrait Photos
Not on the map. Why?
Abstract (arXiv)
We propose a novel approach to animate human hair in a still portrait photo. Existing work has largely studied the animation of fluid elements such as water and fire. However, hair animation for a real image remains underexplored, which is a challenging problem, due to the high complexity of hair structure and dynamics. Considering the complexity of hair structure, we innovatively treat hair wisp extraction as an instance segmentation problem, where a hair wisp is referred to as an instance. With advanced instance segmentation networks, our method extracts meaningful and natural hair wisps. Furthermore, we propose a wisp-aware animation module that animates hair wisps with pleasing motions without noticeable artifacts. The extensive experiments show the superiority of our method. Our method provides the most pleasing and compelling viewing experience in the qualitative experiments and outperforms state-of-the-art still-image animation methods by a large margin in the quantitative evaluation. Project url: urlhttps://nevergiveu.github.io/AutomaticHairBlowing/
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 41 of its 99 references that are in the map. First posted on arXiv 25 Sep 2023.
Builds on
41 of 99 references.
References · 41
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017Mask R-CNNcited by 7,277
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
29 more
- 2022OneFormer: One Transformer to Rule Universal Image Segmentationcited by 328
- 2019G-TAD: Sub-Graph Localization for Temporal Action Detectioncited by 249
- 2023Conditional Image-to-Video Generation with Latent Flow Diffusion Modelscited by 181
- 2019Improved Conditional VRNNs for Video Predictioncited by 104
- 2020Video Self-Stitching Graph Network for Temporal Action Localizationcited by 104
- 2020Blind Video Temporal Consistency via Deep Video Priorcited by 76
- 2018Photo Wake-Up: 3D Character Animation from a Single Photocited by 60
- 2020Animating Pictures with Eulerian Motion Fieldscited by 55
- 2023A Dynamic Multi-Scale Voxel Flow Network for Video Predictioncited by 53
- 2021ISTR: End-to-End Instance Segmentation with Transformerscited by 52
- 2021Stochastic Image-to-Video Synthesis using cINNscited by 49
- 2021Controllable Animation of Fluid Elements in Still Imagescited by 45
- 2022Region-Aware Face Swappingcited by 45
- 2021iPOKE: Poking a Still Image for Controlled Stochastic Video Synthesiscited by 42
- 2022Neural Strands: Learning Hair Geometry and Appearance from Multi-View Imagescited by 40
- 2019Face Parsing with RoI Tanh-Warpingcited by 33
- 2022NeuralHDHair: Automatic High-fidelity Hair Modeling from a Single Image Using Implicit Neural Representationscited by 32
- 2022NeuWigs: A Neural Dynamic Model for Volumetric Hair Capture and Animationcited by 30
- 2021HVH: Learning a Hybrid Neural Volumetric Representation for Dynamic Hair Performance Capturecited by 29
- 2020Edge-aware Graph Representation Learning and Reasoning for Face Parsingcited by 26
- 2022Decoupled Multi-task Learning with Cyclical Self-Regulation for Face Parsingcited by 26
- 2021AniGAN: Style-Guided Generative Adversarial Networks for Unsupervised Anime Face Generationcited by 25
- 2022Video Demoireing with Relation-Based Temporal Consistencycited by 24
- 2021K-Hairstyle: A Large-scale Korean Hairstyle Dataset for Virtual Hair Editing and Hairstyle Classificationcited by 18
- 2022Deep Video Prior for Video Consistency and Propagationcited by 18
- 2022StyleFaceV: Face Video Generation via Decomposing and Recomposing Pretrained StyleGAN3cited by 11
- 2019Towards Learning Structure via Consensus for Face Segmentation and Parsingcited by 8
- 2016Turning an Urban Scene Video into a Cinemagraphcited by 2
- 2017Personalized Cinemagraphs using Semantic Understanding and Collaborative Learningcited by 2
Built on by
Citing papers per year: 2023: 3; 2024: 6; 2025: 2; 2026: 2.
13 papers.
Sort:
By area:
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 89
- 2023AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidancecited by 66
- 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Promptscited by 52
- 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Modelcited by 40
- 2023PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Modelscited by 30
- 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generationcited by 16
- 2024Cinemo: Consistent and Controllable Image Animation with Motion Diffusion Modelscited by 14
- 2025Consistent and Controllable Image Animation with Motion Linear Diffusion Transformerscited by 3
- 2026Focal Guidance: Unlocking Controllability from Semantic-Weak Layers in Video Diffusion Modelscited by 1
- 2025Few-Shot-Based Modular Image-to-Video Adapter for Diffusion Modelscited by 0
- 2026Detangled: A Framework for Creating, Editing, and Inferencing Feature Rich Hair Strands10 Jul 2026
- 2026Focal Guidance: Unlocking Controllability from Semantic-Weak Layers in Video Diffusion Models12 Jan 2026
- 2025Few-Shot-Based Modular Image-to-Video Adapter for Diffusion Models23 Dec 2025
- 2025Consistent and Controllable Image Animation with Motion Linear Diffusion Transformers10 Aug 2025
- 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generation8 Dec 2024
- 2024Cinemo: Consistent and Controllable Image Animation with Motion Diffusion Models22 Jul 2024
- 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Model12 Jun 2024
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model30 May 2024
- 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Prompts13 Mar 2024
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modeling29 Jan 2024
- 2023PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Models21 Dec 2023
- 2023AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidance21 Nov 2023
1 more
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 89
- 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Modelcited by 40
- 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generationcited by 16
- 2024Cinemo: Consistent and Controllable Image Animation with Motion Diffusion Modelscited by 14
- 2025Consistent and Controllable Image Animation with Motion Linear Diffusion Transformerscited by 3
- 2026Focal Guidance: Unlocking Controllability from Semantic-Weak Layers in Video Diffusion Modelscited by 1
- 2025Few-Shot-Based Modular Image-to-Video Adapter for Diffusion Modelscited by 0
- 2026Focal Guidance: Unlocking Controllability from Semantic-Weak Layers in Video Diffusion Models12 Jan 2026
- 2025Few-Shot-Based Modular Image-to-Video Adapter for Diffusion Models23 Dec 2025
- 2025Consistent and Controllable Image Animation with Motion Linear Diffusion Transformers10 Aug 2025
- 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generation8 Dec 2024
- 2024Cinemo: Consistent and Controllable Image Animation with Motion Diffusion Models22 Jul 2024
- 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Model12 Jun 2024
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model30 May 2024
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct 2023
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
- 2023AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidancecited by 66
- 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Promptscited by 52
- 2023PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Modelscited by 30
- 2026Detangled: A Framework for Creating, Editing, and Inferencing Feature Rich Hair Strandscited by 0
- 2026Detangled: A Framework for Creating, Editing, and Inferencing Feature Rich Hair Strands10 Jul 2026
- 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Prompts13 Mar 2024
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modeling29 Jan 2024
- 2023PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Models21 Dec 2023
- 2023AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidance21 Nov 2023