Photo Wake-Up: 3D Character Animation from a Single Photo
Not on the map. Why?
Abstract (arXiv)
We present a method and application for animating a human subject from a single photo. E.g., the character can walk out, run, sit, or jump in 3D. The key contributions of this paper are: 1) an application of viewing and animating humans in single photos in 3D, 2) a novel 2D warping method to deform a posable template body model to fit the person's complex silhouette to create an animatable mesh, and 3) a method for handling partial self occlusions. We compare to state-of-the-art related methods and evaluate results with human studies. Further, we present an interactive interface that allows re-posing the person in 3D, and an augmented reality setup where the animated 3D person can emerge from the photo into the real world. We demonstrate the method on photos, posters, and art.
Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 12; 2023: 16; 2024: 13; 2025: 6; 2026: 3.
60 papers.
Sort:
By area:
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2023Learning Interactive Real-World Simulatorscited by 440
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
- 2023Generative Image Dynamicscited by 93
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 87
- 2023AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidancecited by 66
- 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 65
- 2022Drivable Volumetric Avatars using Texel-Aligned Featurescited by 62
38 more
- 2021S3: Neural Shape, Skeleton, and Skinning Fields for 3D Human Modelingcited by 59
- 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatarscited by 55
- 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Promptscited by 52
- 2023Breathing Life Into Sketches Using Text-to-Video Priorscited by 47
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 39
- 2022Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projectioncited by 39
- 2023High-Fidelity Clothed Avatar Reconstruction from a Single Imagecited by 38
- 2022Animatable Implicit Neural Representations for Creating Realistic Avatars from Videoscited by 33
- 2022Topologically-Aware Deformation Fields for Single-View 3D Reconstructioncited by 29
- 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 28
- 2023D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Fieldcited by 26
- 2021Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptationcited by 24
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
- 2023A Method for Animating Children's Drawings of the Human Figurecited by 20
- 2023Vision-Based Human Pose Estimation via Deep Learning: A Surveycited by 20
- 2022Audio-driven Neural Gesture Reenactment with Video Motion Graphscited by 18
- 2021HUMBI: A Large Multiview Dataset of Human Body Expressions and Benchmark Challengecited by 17
- 2021Action2video: Generating Videos of Human 3D Actionscited by 15
- 2022H4D: Human 4D Modeling by Learning Neural Compositional Representationcited by 15
- 2024Survey on Modeling of Human-made Articulated Objectscited by 14
- 2021MoCaNet: Motion Retargeting in-the-wild via Canonicalization Networkscited by 13
- 2023Automatic Animation of Hair Blowing in Still Portrait Photoscited by 13
- 2024CanonicalFusion: Generating Drivable 3D Human Avatars from Multiple Imagescited by 12
- 2024SpatialDreamer: Self-supervised Stereo Video Synthesis from Monocular Inputcited by 11
- 2021UltraPose: Synthesizing Dense Pose with 1 Billion Points by Human-body Decoupling 3D Modelcited by 9
- 2021Object Wake-up: 3D Object Rigging from a Single Imagecited by 8
- 2021Endless Loops: Detecting and Animating Periodic Patterns in Still Imagescited by 7
- 2022WarpingGAN: Warping Multiple Uniform Priors for Adversarial 3D Point Cloud Generationcited by 7
- 2023What Happened 3 Seconds Ago? Inferring the Past with Thermal Imagingcited by 7
- 2024Domain-Adaptive 2D Human Pose Estimation via Dual Teachers in Extremely Low-Light Conditionscited by 7
- 20253D Object Manipulation in a Single Image using Generative Modelscited by 7
- 2022Quantification of Occlusion Handling Capability of a 3D Human Pose Estimation Frameworkcited by 5
- 2022Bottom-Up 2D Pose Estimation via Dual Anatomical Centers for Small-Scale Personscited by 5
- 2023HMC: Hierarchical Mesh Coarsening for Skeleton-free Motion Retargetingcited by 5
- 2023Animating Street Viewcited by 3
- 2024PADS: Plug-and-Play 3D Human Pose Analysis via Diffusion Generative Modelingcited by 3
- 2024MoCap-to-Visual Domain Adaptation for Efficient Human Mesh Estimation from 2D Keypointscited by 3
- 2025MultiModal Action Conditioned Video Generationcited by 3
50 most cited of 60 All 60 (JSON)
- 2026Sketch2Motion: Text-driven 2D Sketch to 3D Animation via Diffusion-guided Skeleton Optimization27 May 2026
- 2026InterMesh: Explicit Interaction-Aware End-to-End Multi-Person Human Mesh Recovery6 May 2026
- 2026See-through: Single-image Layer Decomposition for Anime Characters3 Feb 2026
- 2025MultiModal Action Conditioned Video Generation2 Oct 2025
- 2025From Rigging to Waving: 3D-Guided Diffusion for Natural Animation of Hand-Drawn Characters8 Sep 2025
- 2025PARTE: Part-Guided Texturing for 3D Human Reconstruction from a Single Image23 Jul 2025
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Data26 May 2025
- 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Image26 Mar 2025
- 20253D Object Manipulation in a Single Image using Generative Models22 Jan 2025
- 2024SpatialDreamer: Self-supervised Stereo Video Synthesis from Monocular Input18 Nov 2024
- 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaboration7 Nov 2024
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation27 Sep 2024
38 more
- 2024Domain-Adaptive 2D Human Pose Estimation via Dual Teachers in Extremely Low-Light Conditions22 Jul 2024
- 2024CanonicalFusion: Generating Drivable 3D Human Avatars from Multiple Images5 Jul 2024
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model30 May 2024
- 2024MoCap-to-Visual Domain Adaptation for Efficient Human Mesh Estimation from 2D Keypoints10 Apr 2024
- 2024Survey on Modeling of Human-made Articulated Objects22 Mar 2024
- 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Prompts13 Mar 2024
- 2024Lester: rotoscope animation through video object segmentation and tracking15 Feb 2024
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modeling29 Jan 2024
- 2024TIFu: Tri-directional Implicit Function for High-Fidelity 3D Character Reconstruction25 Jan 2024
- 2024PADS: Plug-and-Play 3D Human Pose Analysis via Diffusion Generative Modeling17 Jan 2024
- 2023MagicScroll: Nontypical Aspect-Ratio Image Generation for Visual Storytelling via Multi-Layered Semantic-Aware Denoising18 Dec 2023
- 2023Breathing Life Into Sketches Using Text-to-Video Priors21 Nov 2023
- 2023AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidance21 Nov 2023
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct 2023
- 2023Animating Street View12 Oct 2023
- 2023Learning Interactive Real-World Simulators9 Oct 2023
- 2023Automatic Animation of Hair Blowing in Still Portrait Photos25 Sep 2023
- 2023Generative Image Dynamics14 Sep 2023
- 2023Vision-Based Human Pose Estimation via Deep Learning: A Survey26 Aug 2023
- 2023D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Field17 Aug 2023
- 2023DisCo: Disentangled Control for Realistic Human Dance Generation30 Jun 2023
- 2023What Happened 3 Seconds Ago? Inferring the Past with Thermal Imaging26 Apr 2023
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion12 Apr 2023
- 2023High-Fidelity Clothed Avatar Reconstruction from a Single Image8 Apr 2023
- 2023HMC: Hierarchical Mesh Coarsening for Skeleton-free Motion Retargeting20 Mar 2023
- 2023A Method for Animating Children's Drawings of the Human Figure7 Mar 2023
- 20223D Reconstruction of Sculptures from Single Images via Unsupervised Domain Adaptation on Implicit Models9 Oct 2022
- 2022Bottom-Up 2D Pose Estimation via Dual Anatomical Centers for Small-Scale Persons25 Aug 2022
- 2022Audio-driven Neural Gesture Reenactment with Video Motion Graphs23 Jul 2022
- 2022Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projection22 Jul 2022
- 2022Drivable Volumetric Avatars using Texel-Aligned Features20 Jul 2022
- 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars17 May 2022
- 2022Topologically-Aware Deformation Fields for Single-View 3D Reconstruction12 May 2022
- 2022WarpingGAN: Warping Multiple Uniform Priors for Adversarial 3D Point Cloud Generation24 Mar 2022
- 2022Animatable Implicit Neural Representations for Creating Realistic Avatars from Videos15 Mar 2022
- 2022Texture Generation Using Dual-Domain Feature Flow with Multi-View Hallucinations14 Mar 2022
- 2022Quantification of Occlusion Handling Capability of a 3D Human Pose Estimation Framework8 Mar 2022
- 2022H4D: Human 4D Modeling by Learning Neural Compositional Representation2 Mar 2022
50 newest of 60 All 60 (JSON)
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 87
- 20253D Object Manipulation in a Single Image using Generative Modelscited by 7
- 2024PADS: Plug-and-Play 3D Human Pose Analysis via Diffusion Generative Modelingcited by 3
- 2025From Rigging to Waving: 3D-Guided Diffusion for Natural Animation of Hand-Drawn Characterscited by 2
- 2025From Rigging to Waving: 3D-Guided Diffusion for Natural Animation of Hand-Drawn Characters8 Sep 2025
- 20253D Object Manipulation in a Single Image using Generative Models22 Jan 2025
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model30 May 2024
- 2024PADS: Plug-and-Play 3D Human Pose Analysis via Diffusion Generative Modeling17 Jan 2024
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct 2023
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion12 Apr 2023
- 2023Learning Interactive Real-World Simulatorscited by 440
- 2025MultiModal Action Conditioned Video Generationcited by 3
- 2025MultiModal Action Conditioned Video Generation2 Oct 2025
- 2023Learning Interactive Real-World Simulators9 Oct 2023
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
- 2023Generative Image Dynamicscited by 93
- 2023AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidancecited by 66
- 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 65
- 2022Drivable Volumetric Avatars using Texel-Aligned Featurescited by 62
- 2021S3: Neural Shape, Skeleton, and Skinning Fields for 3D Human Modelingcited by 59
- 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatarscited by 55
- 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Promptscited by 52
- 2023Breathing Life Into Sketches Using Text-to-Video Priorscited by 47
12 most cited of 52 All 52 (JSON)
- 2026Sketch2Motion: Text-driven 2D Sketch to 3D Animation via Diffusion-guided Skeleton Optimization27 May 2026
- 2026InterMesh: Explicit Interaction-Aware End-to-End Multi-Person Human Mesh Recovery6 May 2026
- 2026See-through: Single-image Layer Decomposition for Anime Characters3 Feb 2026
- 2025PARTE: Part-Guided Texturing for 3D Human Reconstruction from a Single Image23 Jul 2025
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Data26 May 2025
- 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Image26 Mar 2025
- 2024SpatialDreamer: Self-supervised Stereo Video Synthesis from Monocular Input18 Nov 2024
- 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaboration7 Nov 2024
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation27 Sep 2024
- 2024Domain-Adaptive 2D Human Pose Estimation via Dual Teachers in Extremely Low-Light Conditions22 Jul 2024
- 2024CanonicalFusion: Generating Drivable 3D Human Avatars from Multiple Images5 Jul 2024
- 2024MoCap-to-Visual Domain Adaptation for Efficient Human Mesh Estimation from 2D Keypoints10 Apr 2024
12 newest of 52 All 52 (JSON)